LeaderRebalancerTest.AddTserver: /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:432: Failure
Failed
Bad status: Remote error: Service unavailable: leadership transfer for b217e36f6e5e4fc38ba6e4ad89082fc6 already in progress
I20260501 14:00:59.079061  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
I20260501 14:00:59.079061  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:59.080014  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.936s (SENT)
I20260501 14:00:59.083684  7674 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260501 14:00:59.086184  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 373626us
I20260501 14:00:59.082455 13350 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.096071  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.082993 13365 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.087633 13325 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:59.100121  7753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.009s	sys 0.022s
W20260501 14:00:59.105121  7753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.009s	sys 0.023s
I20260501 14:00:59.107604 13000 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.108347 13000 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.097323 13350 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:59.109294  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.126971 13207 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.099696 13365 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.153156  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.104365 13325 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:59.170197  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 308613us
I20260501 14:00:59.170472 13383 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:59.176071 13343 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.187s	user 0.010s	sys 0.012s
I20260501 14:00:59.196152 13397 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.196924 13397 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.198698 13403 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.199393 13397 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.168601 13371 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.183517 13252 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.146461 13000 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.184333 13232 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:59.214629 13332 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.234212  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 148475us
I20260501 14:00:59.216734 13395 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.187927 13383 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.260797  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 172966us
I20260501 14:00:59.232355 13384 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:59.272833  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:59.276124 13350 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.224002 13252 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.285744  7792 connection.cc:254] RPC call timeout handler was delayed by -1.0361570879999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260501 14:00:59.218353 13403 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.297120  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:59.295192  7792 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.674s (SENT)
W20260501 14:00:59.273723 13375 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260501 14:00:59.296868  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.307667 13394 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:59.308233 13142 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.308884 13142 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.309945 13386 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.310501 13386 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.296785 13351 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.296s	user 0.006s	sys 0.014s
W20260501 14:00:59.311890 13366 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.495s	user 0.000s	sys 0.011s
I20260501 14:00:59.290944 13384 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.312132 13393 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.313139  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3623) took 1669 ms. Trace:
I20260501 14:00:59.313030 13393 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.314118 13384 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.244187 13332 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.315320 13393 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.316246  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3630) took 1431 ms. Trace:
I20260501 14:00:59.313553  7746 rpcz_store.cc:276] 0501 14:00:57.643429 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:57.643650 (+   221us) service_pool.cc:224] Handling call
0501 14:00:57.680439 (+ 36789us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:57.680858 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:57.680894 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:57.681421 (+   527us) log.cc:844] Serialized 26 byte log entry
0501 14:00:57.839745 (+158324us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:57.839785 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:57.839876 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.183835 (+1343959us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:59.312791 (+128956us) raft_consensus.cc:1685] finished
0501 14:00:59.312817 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.313053 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3686,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6515,"spinlock_wait_cycles":126639488,"thread_start_us":158011,"threads_started":1,"wal-append.queue_time_us":238736}
I20260501 14:00:59.316901 13386 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.316663  7752 rpcz_store.cc:276] 0501 14:00:57.884701 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:57.885446 (+   745us) service_pool.cc:224] Handling call
0501 14:00:57.919019 (+ 33573us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:58.075221 (+156202us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:58.075301 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:58.113084 (+ 37783us) log.cc:844] Serialized 26 byte log entry
0501 14:00:58.518084 (+405000us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:58.518126 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:58.518191 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.311265 (+793074us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:59.315898 (+  4633us) raft_consensus.cc:1685] finished
0501 14:00:59.315927 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.316178 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168089,"raft.queue_time_us":155498,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3864,"spinlock_wait_cycles":86869888,"thread_start_us":316504,"threads_started":1,"wal-append.queue_time_us":555544}
I20260501 14:00:59.318172 13332 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.319698 13393 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.320369 13365 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.322958  7824 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:59.323702  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.324154  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.324183  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.325104  7828 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 17: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:59.325470  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:59.326056  7821 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 13
I20260501 14:00:59.325824  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.326701  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.326825  7827 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19.
I20260501 14:00:59.328183  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.328823  8381 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:59.328985 13000 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.329628  7746 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260501 14:00:59.330104  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:59.328186  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.320375 13393 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.332157  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:59.333819 13378 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.211s	user 0.004s	sys 0.004s
I20260501 14:00:59.335150 13393 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.335853 13350 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.336024 13385 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:00:59.336422 13350 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.251788 13395 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.338469 13350 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.339200 13385 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:59.341204 13252 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.298332 13232 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.367715  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 890) took 1508 ms. Trace:
I20260501 14:00:59.297188 13127 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:59.373116  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1410) took 1026 ms. Trace:
W20260501 14:00:59.373395  7718 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.543s (SENT)
W20260501 14:00:59.375104  7718 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.037s (SENT)
I20260501 14:00:59.368432  7675 rpcz_store.cc:276] 0501 14:00:57.840269 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:57.840430 (+   161us) service_pool.cc:224] Handling call
0501 14:00:59.347866 (+1507436us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540004c9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:59.348095 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955914496}
I20260501 14:00:59.386457  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.387863  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.400072  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:59.400818  8380 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:59.402855  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:59.402891  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:59.403887  7746 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:59.306752 13205 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.410069  7823 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:00:59.348951 13289 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:59.398034 13350 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.414322 13350 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.415674 13205 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.416815 13350 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.417799 13205 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.419808 13142 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.421185  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:59.422820  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.407716  7821 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:59.434352  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:59.435268  8371 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:59.484850  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:59.486091  7821 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:59.373584  8375 rpcz_store.cc:276] 0501 14:00:58.347156 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.477296 (+130140us) service_pool.cc:224] Handling call
0501 14:00:58.477627 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:58.508570 (+ 30943us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:58.508609 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:58.509067 (+   458us) log.cc:844] Serialized 26 byte log entry
0501 14:00:58.865442 (+356375us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:58.865496 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:58.865572 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.333180 (+467608us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:59.362711 (+ 29531us) raft_consensus.cc:1685] finished
0501 14:00:59.362746 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.373039 (+ 10293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3775,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7605,"spinlock_wait_cycles":11153280,"thread_start_us":326472,"threads_started":1,"wal-append.queue_time_us":579809}
I20260501 14:00:59.429062  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:59.486651  8381 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:59.487447  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58478.3us
I20260501 14:00:59.488758  7819 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260501 14:00:59.489464  7718 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.525s (SENT)
W20260501 14:00:59.492491  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.805s (SENT)
I20260501 14:00:59.492374  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.493167  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.389598 13252 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.498725  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.501305 13224 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.410624 13124 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.407207 13127 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:59.517282  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.518389  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3633) took 1163 ms. Trace:
I20260501 14:00:59.518920  7751 rpcz_store.cc:276] 0501 14:00:58.343762 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.343976 (+   214us) service_pool.cc:224] Handling call
0501 14:00:59.507170 (+1163194us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54003ac0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:59.507348 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607998848}
I20260501 14:00:59.495790 13350 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.514747 13325 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.495674 13133 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:00:59.498420 13289 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:59.531849  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:59.503782 13395 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.516314 13224 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.546921  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:59.559454  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:00:59.565588  8380 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:59.531252 13257 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:59.560884  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.537233 13133 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:59.521250 13261 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260501 14:00:59.543262 13000 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.042s
I20260501 14:00:59.551360 13325 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260501 14:00:59.520844 13124 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.515120 13252 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.596365  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:00:59.542080 13224 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.538342 13350 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.605115  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:00:59.611016  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:59.592772 13133 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:00:59.605239  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.625319  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.626032  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.626840  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.627879  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.607461 13257 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.598686 13371 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:59.644573  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.646473  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.647464  7751 raft_consensus.cc:2410] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260501 14:00:59.652750  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 410208us
W20260501 14:00:59.654326  7792 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.825s (SENT)
I20260501 14:00:59.614416 13167 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:00:59.668706  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.913s (SENT) [suppressed 65 similar messages]
I20260501 14:00:59.658897  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.615007 13361 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.657326  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.674734  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:59.675877  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.679881  7792 leader_election.cc:400] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13.
I20260501 14:00:59.683131  7792 leader_election.cc:403] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:59.597080 13127 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.638739 13403 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.689786  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.695760  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.649274 13292 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.702028  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.703449  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.707176  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.708416  7821 raft_consensus.cc:2410] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260501 14:00:59.709019  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.704768 13385 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13.
W20260501 14:00:59.713976  8344 connection.cc:254] RPC call timeout handler was delayed by -1.1229096429999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2926s for a response
I20260501 14:00:59.714679  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:59.716091  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.717947  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.718691  7819 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 16.
I20260501 14:00:59.702003  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.651108 13257 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.722846  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.723517  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.724120  7827 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:59.701157 13325 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:59.618741 13289 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.730496  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.683682 13261 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260501 14:00:59.737392  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.742067  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.717582 13205 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.747886  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.688417 13361 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.768352  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.773610 13113 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260501 14:00:59.767969  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.785575  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.713109 13292 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.733774 13167 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260501 14:00:59.773813 13224 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.790584 13224 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.792891 13257 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.793298 13224 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.793816 13383 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.794734 13350 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.795292 13350 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.777559 13388 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.795740 13350 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.796150 13388 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.797935 13350 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.798226 13388 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.798415 13350 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.798933 13350 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.774246 13205 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.803413 13361 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.776654 13407 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.797956 13124 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.810341  7746 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:59.815716  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.766986 13325 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:59.803658 13205 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.811645 13167 consensus_queue.cc:1243] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260501 14:00:59.809989 13407 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.860306  7745 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 16. Current term is 17. Ops: []
W20260501 14:00:59.843039 13379 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260501 14:00:59.825858 13124 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.813596 13404 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:59.877003  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.842634 13388 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.886130  7746 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:59.856575 13123 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.855409 13252 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.895159  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.880501 13332 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.898571 13388 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.910279 13252 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.918995 13410 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.207s	user 0.003s	sys 0.003s
I20260501 14:00:59.886001 13124 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.899145 13123 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.914405 13269 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260501 14:00:59.943198  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 57412.3us
I20260501 14:00:59.945883 13392 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:59.946556 13392 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.947613 13421 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260501 14:00:59.947692 13124 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:59.948627 13392 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.949204 13437 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.949708 13437 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.952579 13292 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.953747 13350 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.954272 13350 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.954661 13350 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.932610 13252 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.956934 13429 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.957655 13252 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.912806 13325 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.958349 13424 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.924551 13332 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.937700 13428 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.964319  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:00.004015  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1407) took 1747 ms. Trace:
W20260501 14:00:59.997228  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1675855529999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260501 14:01:00.005159  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1486855530000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260501 14:00:59.951656 13437 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.010465  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:00.004420  8374 rpcz_store.cc:276] 0501 14:00:58.249747 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.255559 (+  5812us) service_pool.cc:224] Handling call
0501 14:00:58.256086 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:58.256581 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:58.256624 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:59.299560 (+1042936us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b2c0001ced8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:00:59.349535 (+ 49975us) log.cc:844] Serialized 26 byte log entry
0501 14:00:59.588717 (+239182us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:59.588774 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:59.588863 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.958804 (+369941us) raft_consensus.cc:1685] finished
0501 14:00:59.958834 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.997184 (+ 38350us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37859,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":13218,"spinlock_wait_cycles":4590464,"thread_start_us":173148,"threads_started":1,"wal-append.queue_time_us":350178}
I20260501 14:01:00.008389 13424 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.016113 13436 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.016793 13436 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.018129 13123 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:00.018970 13436 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.020232 13414 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:00.021483 13388 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:00.025295 13407 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.028167 13428 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.030993 13428 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.033758 13332 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.038964  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:00.001917 13416 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260501 14:01:00.060633  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.060907  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:59.999485 13429 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.064282 13124 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:01:00.104553  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.132761  8371 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:01:00.003654 13252 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.071694 13332 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:01:00.041287 13391 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.023440 13205 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:00.137859  7747 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
I20260501 14:01:00.105345  8375 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 19.
I20260501 14:01:00.144519  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.111423 13269 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.174165  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.172380  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.141490 13257 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.172573 13350 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.195366  7823 pending_rounds.cc:85] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 11
W20260501 14:01:00.178386 13434 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260501 14:01:00.142082 13332 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:01:00.173640 13433 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.002s
I20260501 14:01:00.165277 13168 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.168138 13397 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.180908 13424 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.200711  7823 pending_rounds.cc:107] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260501 14:01:00.218528  7823 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:01:00.165735 13265 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.223109 13429 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.223050 13265 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.165560 13384 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.172720 13409 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:01:00.212898 13292 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:00.146257 13252 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.205025 13403 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.213407 13361 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.155361 13205 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.187628 13269 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.213217 13332 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:00.200084 13257 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:00.293056  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 63454.4us
I20260501 14:01:00.296075  8376 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:01:00.292055  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.293565  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:00.300313  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 47897.5us
I20260501 14:01:00.295095  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.151852 13391 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:00.237514 13133 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.001s
I20260501 14:01:00.312309  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:00.313452  8371 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:00.267639 13429 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.322391  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.323096  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19.
I20260501 14:01:00.228085 13397 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.220000 13168 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.291548 13252 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.343696  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.305163 13424 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.338366  7752 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260501 14:01:00.360934 13424 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.362115  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.265985 13384 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.318760 13133 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.361475 13397 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.363786 13424 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.281577 13292 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.372605  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.375947  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.404098  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.405248  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.300400 13361 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.408687  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:00.383284  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.409523  7826 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:00.409754  7748 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:00.367864  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.367487  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.370121  7754 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 20: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:00.372529  7821 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260501 14:01:00.411188  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:00.399067  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.366506  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2353) took 1044 ms. Trace:
I20260501 14:01:00.399354  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.296265 13403 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.407567  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.418641  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.418951  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.413401  7747 rpcz_store.cc:276] 0501 14:00:59.322367 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:59.325923 (+  3556us) service_pool.cc:224] Handling call
0501 14:00:59.326210 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:01:00.148939 (+822729us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:00.366276 (+217337us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400116554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:01:00.366447 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866123008}
I20260501 14:01:00.412761  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.419781  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.365823 13384 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.368868 13168 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.427189  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.427211  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.432400  7828 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:01:00.335240 13429 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.435119  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.375453 13269 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.369764 13133 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.437183  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.440871  7752 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:01:00.382867  8380 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:01:00.408432 13252 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.434499 13436 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260501 14:01:00.425773 13233 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:00.425493 13350 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:00.376511 13205 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.439424  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.368019 13123 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260501 14:01:00.412931 13424 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.453326 13257 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.453989 13397 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:01:00.455058 13292 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.434854 13428 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:01:00.458937  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.444612  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.460155 13436 consensus_queue.cc:1243] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260501 14:01:00.439654 13391 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.464952  7821 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260501 14:01:00.445770  8371 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:01:00.452652  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.447345  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.434759 13437 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.453136 13294 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:01:00.478504 13294 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:00.479038 13294 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:00.479707  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.435693 13261 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260501 14:01:00.470201  7826 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 20.
I20260501 14:01:00.488986  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.493636  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.495474  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.501082  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.484601 13265 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.494843 13257 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.494470 13428 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.495240 13409 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:00.497634 13437 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:01:00.534325  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.502265 13350 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.522091  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.533407  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.533401  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.507324 13407 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260501 14:01:00.504626 13384 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:01:00.537098  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.537989  8374 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260501 14:01:00.541311  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.542824  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.543318  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.500140 13325 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260501 14:01:00.551246  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.555620  8374 raft_consensus.cc:2410] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260501 14:01:00.551914  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.552057  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.559384  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.562078  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.534871 13437 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:00.540004 13124 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:00.616207  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.552858 13257 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:01:00.550627 13384 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:00.535655 13428 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.614756 13437 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:00.613453 13232 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.549283 13350 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.619240 13406 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.634770  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.620380 13257 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.621946 13403 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.640435  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.625070 13361 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.642756  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.646232  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.648301  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 198240us
I20260501 14:01:00.648906  7752 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 16: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:00.650151  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.635181 13429 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.651383  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3650) took 1245 ms. Trace:
I20260501 14:01:00.651262  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.653573  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:00.637915 13257 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:00.651870  7754 rpcz_store.cc:276] 0501 14:00:59.406135 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:59.492029 (+ 85894us) service_pool.cc:224] Handling call
0501 14:01:00.651163 (+1159134us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b540012c5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:01:00.651320 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015598848}
I20260501 14:01:00.655167  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.664269  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.668151  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.647882 13436 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.633538 13232 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.671983  7754 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260501 14:01:00.676483  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.653752 13390 raft_consensus.cc:2764] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260501 14:01:00.639709 13406 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.677279  7747 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:01:00.681484  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.684554  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.685161  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.745913  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 244931us
I20260501 14:01:00.798357  7754 raft_consensus.cc:2410] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260501 14:01:00.740885  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.697018 13448 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260501 14:01:00.680184 13436 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:00.695885 13440 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260501 14:01:00.755788 13437 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.743023 13350 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:00.768999 13447 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260501 14:01:00.776428 13252 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:01:00.785917 13232 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:00.663218 13384 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.793460 13294 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.668174 13338 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:00.684554  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.798946  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.801399  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.805783  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.846568  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:00.835935 13454 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260501 14:01:00.808630  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.818437  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.818693  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.820268  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.853631  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.835693  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.855737  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56923.2us
I20260501 14:01:00.857189  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.839998 13133 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:00.837903 13252 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:00.859155  7820 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:00.838150 13265 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:00.860972  7828 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:01:00.805770  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.862939 13332 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.001s
I20260501 14:01:00.910633  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.862198 13224 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:00.911733  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.909478  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:00.913547  8374 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:00.914682  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.910220  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:00.916803  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:00.922333  8371 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:01:00.930737  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.931478  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.884595 13407 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.906895 13350 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.911898 13428 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.865973 13133 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.905723 13265 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.935539 13404 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:00.919390 13332 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.935911 13424 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.994558 13294 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.969427  8374 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 20.
W20260501 14:01:01.000478 13457 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260501 14:01:01.001147 13436 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.010329 13265 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.011332 13437 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:01.025628  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 346320us
I20260501 14:01:00.963446 13350 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:01.063164 13350 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.063795 13252 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:01.026180 13424 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.118331  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.070621 13252 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:01.122962  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.130371  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:01:01.132992  7792 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.132609  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 178945us
I20260501 14:01:01.117444 13350 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:01.136725  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 184019us
W20260501 14:01:01.138160  7792 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.139431  7792 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.138201  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.140311  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.140565  7792 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.141424  8344 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.141670  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.141844  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.139689  7718 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.563s (SENT)
I20260501 14:01:01.142280  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:01.143689  7792 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.145216  7792 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.146682  7792 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.147114  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.117825 13437 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:01.148125  7792 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.124182 13428 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.158684  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:01.135143 13429 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.205144  8377 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:01:01.153342 13124 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.226164 13428 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:01.123808 13436 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260501 14:01:01.234185  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:01.153529 13294 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.150080 13463 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:01.241390  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 72226.1us
I20260501 14:01:01.169498 13474 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
W20260501 14:01:01.244976 13468 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260501 14:01:01.245657 13424 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:01.246532 13470 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260501 14:01:01.227182 13428 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:01.248612  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52036.9us
W20260501 14:01:01.232641 13257 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.004s
W20260501 14:01:01.254148  8344 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.242381 13133 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.159022 13350 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:01.261457 13453 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260501 14:01:01.163961 13437 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.229043 13429 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:01:01.229313 13390 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:01.163093 13397 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
W20260501 14:01:01.262120 13451 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260501 14:01:01.262032 13465 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260501 14:01:01.293344  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:01.299019  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44921.6us
I20260501 14:01:01.301195  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.268182 13424 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:01:01.270740 13133 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:01.312346  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.315460  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:01.315779  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 185476us
I20260501 14:01:01.280637 13390 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:01.262152 13257 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.285754 13332 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:01.284858 13429 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.305130 13424 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.319140  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.331334  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.345412  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.318478 13463 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.343086  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.347437  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.348920  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.327742 13390 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:01.316928 13479 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.365917  7753 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 17: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:01:01.343371 13452 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.573s	user 0.008s	sys 0.000s
I20260501 14:01:01.335846 13391 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:01.377597  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.324024 13133 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.431646  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:01.432649  8379 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 13
I20260501 14:01:01.409827 13474 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.440855 13384 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:01.446928 13465 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260501 14:01:01.438139 13350 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.425925 13391 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.478066 13391 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:01.480973 13480 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260501 14:01:01.481328  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 860) took 1182 ms. Trace:
I20260501 14:01:01.481881  8376 rpcz_store.cc:276] 0501 14:01:00.298788 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.363159 (+ 64371us) service_pool.cc:224] Handling call
0501 14:01:00.370499 (+  7340us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:01:00.377102 (+  6603us) raft_consensus.cc:1534] Early marking committed up to index 13
0501 14:01:00.646531 (+269429us) log.cc:844] Serialized 14 byte log entry
0501 14:01:00.980583 (+334052us) log.cc:844] Serialized 14 byte log entry
0501 14:01:00.992858 (+ 12275us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:01:01.121294 (+128436us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b2c0001ced8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:01:01.134731 (+ 13437us) log.cc:844] Serialized 26 byte log entry
0501 14:01:01.135054 (+   323us) raft_consensus.cc:1645] Marking committed up to 13
0501 14:01:01.135115 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:01.135293 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:01:01.481012 (+345719us) raft_consensus.cc:1685] finished
0501 14:01:01.481058 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:01:01.481245 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30295,"prepare.queue_time_us":108684,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":2450,"raft.queue_time_us":36412,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":24072,"spinlock_wait_cycles":6892416,"thread_start_us":573656,"threads_started":2,"wal-append.queue_time_us":416579}
I20260501 14:01:01.503963 13428 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.457509 13482 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
W20260501 14:01:01.510452  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 161609us
W20260501 14:01:01.515519 13471 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
W20260501 14:01:01.524407  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 110541us
I20260501 14:01:01.445842 13424 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.521010  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.517336 13437 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.540585  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.548360  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.553036  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.510049 13429 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.555876  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.557354  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 227805us
I20260501 14:01:01.557850  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.548789 13437 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.547986  8379 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:01.559593  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.546873 13257 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.535581 13428 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260501 14:01:01.544895 13490 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.558830 13487 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.558858 13474 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:01:01.559491 13350 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:01.561290 13488 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.006s
I20260501 14:01:01.563201 13437 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.574990  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.577734 13491 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.566550 13406 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:01.566848 13428 consensus_queue.cc:1243] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260501 14:01:01.586763  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 854) took 1293 ms. Trace:
I20260501 14:01:01.587411  8377 rpcz_store.cc:276] 0501 14:01:00.293093 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.293796 (+   703us) service_pool.cc:224] Handling call
0501 14:01:00.294248 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:01:01.232885 (+938637us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:01.586459 (+353574us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400659354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:01:01.586695 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710996736}
I20260501 14:01:01.589911 13390 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.595038  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:01.561780 13265 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:01.607009  7825 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 17. Current term is 18. Ops: []
I20260501 14:01:01.579670  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.620613  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.621492  8373 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:01:01.619192  8379 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260501 14:01:01.631182  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:01.594378 13133 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:01.636145  7718 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.172s (SENT)
I20260501 14:01:01.640909  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2195) took 1101 ms. Trace:
W20260501 14:01:01.642544  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.806s (SENT)
I20260501 14:01:01.640910  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:01.641577  7820 rpcz_store.cc:276] 0501 14:01:00.532897 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.533019 (+   122us) service_pool.cc:224] Handling call
0501 14:01:01.634466 (+1101447us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b540028e954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:01:01.634643 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723062016}
I20260501 14:01:01.639025 13489 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.613394 13265 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260501 14:01:01.648941  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:01.672129  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.677563  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:01:01.678887  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 121096us
I20260501 14:01:01.680673  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.684397  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:01.668098 13499 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:01:01.668157 13493 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:01:01.687415  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.688880  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.688299 13252 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.690922 13482 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:01.694918 13265 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:01:01.692044 13493 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:01.715328  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.700116 13429 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:01.717796  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.720293  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.724684  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.718021 13265 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:01.720947 13350 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:01.736608 13500 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260501 14:01:01.724453 13252 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.725683 13474 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:01:01.716979 13437 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260501 14:01:01.736940 13265 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:01:01.737306 13429 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.740309 13390 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.759333 13474 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:01.736351 13493 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:01.788353 13502 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260501 14:01:01.789166 13496 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260501 14:01:01.776717 13437 consensus_queue.cc:1243] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260501 14:01:01.823210  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.824543  7747 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:01:01.825531  7824 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:01:01.826396  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:01.824422  8380 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:01:01.830273  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:01.832233  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.838774  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.840058  8380 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:01:01.840812  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.841343  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.791291 13474 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:01.843621  7824 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 16. Current term is 17. Ops: []
W20260501 14:01:01.854362  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 176877us
I20260501 14:01:01.855952 13436 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:01:01.856451 13436 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.856207 13127 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:01:01.857331 13436 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.858915  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.860080  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.862344  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.863922  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.865641  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.867405  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.861976  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.872121  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.877470  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.882603  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.861353 13493 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:01.884135  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.884203  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.888582  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.870843 13499 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:01:01.909358 13505 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260501 14:01:01.914026  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.915933  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.918260  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.920985  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.921763  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.924543  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.927402  7562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 93967.3us
I20260501 14:01:01.922643 13325 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260501 14:01:01.918460 13252 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:01.919931 13437 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.927386 13519 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260501 14:01:01.935667 13265 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:01.939226  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 239565us
I20260501 14:01:01.921851 13350 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:01.940445  7718 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.007s (SENT)
I20260501 14:01:01.942451  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.944540  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.080s (SENT)
I20260501 14:01:01.947489  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.947141  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.927560 13429 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.948127 13437 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:01:01.957021 13436 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:01:01.961107  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3680) took 1286 ms. Trace:
I20260501 14:01:01.945012 13482 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.961565  7753 rpcz_store.cc:276] 0501 14:01:00.674503 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.675355 (+   852us) service_pool.cc:224] Handling call
0501 14:01:01.960909 (+1285554us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540012cad4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:01:01.961037 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304740224}
I20260501 14:01:01.964449 13501 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:01:01.964972 13501 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.965926 13501 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:01.967326 13501 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:01.938968 13499 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.970129  7745 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 16. Current term is 17. Ops: []
I20260501 14:01:01.973336  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.975247  7754 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:01.972841  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.942370 13124 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:01.978410 13482 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:01:01.979143  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.979986  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:01.982560 13350 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.982791  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:01.981828  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.976440 13429 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.985997 13350 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:01.980543 13124 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.988183 13265 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.980296 13203 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:01.987246  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.991287  7747 raft_consensus.cc:2410] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260501 14:01:01.991441  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:01.994475 13124 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:01.994735 13467 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.828s	user 0.003s	sys 0.004s
I20260501 14:01:01.997031  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2587) took 1358 ms. Trace:
I20260501 14:01:01.997130 13350 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.997493  7827 rpcz_store.cc:276] 0501 14:01:00.638455 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.638591 (+   136us) service_pool.cc:224] Handling call
0501 14:01:00.638928 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:01:00.740246 (+101318us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:01:00.740283 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:01:00.743073 (+  2790us) log.cc:844] Serialized 26 byte log entry
0501 14:01:01.022725 (+279652us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:01:01.022790 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:01.450599 (+427809us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400297f54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:01:01.450669 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:01:01.994082 (+543413us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:01:01.996767 (+  2685us) raft_consensus.cc:1685] finished
0501 14:01:01.996797 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:01:01.996939 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":11460,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":433912576,"thread_start_us":279142,"threads_started":1,"wal-append.queue_time_us":341917}
I20260501 14:01:02.004323  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.033044  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.059142  8376 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:01:02.066988 13350 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:01:02.068604  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 53447.2us
I20260501 14:01:02.071339 13437 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:02.072613  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 70811us
W20260501 14:01:02.073422  7718 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.074755  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.075795  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.118009  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.118914  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.119650  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.120283  7718 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.120927  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:01:02.121336  7718 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.121989  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.122833 13265 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:02.123451  7718 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.124653  7718 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.125591  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.126564  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.128234  7718 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.129371  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.130021  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.132763 13437 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:01:02.135567 13437 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:02.135978 13437 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:01:02.132483  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.137795 13429 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.140354  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.142436 13350 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.146368 13437 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.149708 13437 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.132967  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.150524  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.152077 13493 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.153852  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.154446  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.156344  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77553.1us
W20260501 14:01:02.158687  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 95989.6us
I20260501 14:01:02.164188  7826 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260501 14:01:02.115231 13501 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:02.167618  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.170830  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.172009 13437 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.172442  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.173504 13437 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.174124  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.175181 13437 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.169888  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.157667 13265 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.167506 13493 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:02.167989  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.159083 13429 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:02.175786  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:02.177086  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.306653  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 129471us
I20260501 14:01:02.182600  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.308125  7792 consensus_peers.cc:407] unable to start election on peer bc1b0a0a152e46fea4bd4934ba9976ed: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.188408 13436 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.205503 13474 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.178781 13501 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.319216 13474 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.310721  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 142578us
I20260501 14:01:02.310883 13409 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.312492 13436 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:02.314661  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 138803us
I20260501 14:01:02.315549 13429 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.330205  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.182420 13493 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.331699 13429 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.333177  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.334133 13493 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.334342  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.204188 13514 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.106s
I20260501 14:01:02.335425  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.335743  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.322942  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.338140  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.338318  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.339505 13409 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:01:02.340760  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.342926  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.330916 13436 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.344485 13501 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.227677 13203 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.348258 13224 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Stepping down as leader of term 17
I20260501 14:01:02.348866 13224 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:01:02.357926  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.358867  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.361771 13424 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:01:02.366174 13503 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.603s	user 0.000s	sys 0.006s
I20260501 14:01:02.367985 13436 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:02.372852 13504 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.632s	user 0.003s	sys 0.004s
W20260501 14:01:02.367494  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.350862 13224 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.380529 13332 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.383980 13436 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.385035 13436 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.389351 13436 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.373785  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:02.407157  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.408004  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:02.410646  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.413671  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.413234  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.415148 13428 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:01:02.415462  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.416267  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.417083  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.419957  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.420620  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.412567 13332 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.421794 13519 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.423444 13519 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.425307  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.428241  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.429270  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.429452  7745 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:01:02.431136 13428 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:02.432665  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.433528  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.434461  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.417692 13436 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:01:02.439023  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.440972 13224 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:02.434631 13428 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.449385  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.461179  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.473526 13519 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.479404  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:02.481060  7749 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:02.489270  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:02.490127  8377 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:01:02.500720  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.501205  8379 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:01:02.501005  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:02.504916  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.506245  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.506363  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.507972  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.508205  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:02.508721  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:02.508006  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 80179.7us
I20260501 14:01:02.516027  7577 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:02.524345  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 85450.1us
W20260501 14:01:02.526530  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.527211  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:02.510051  8344 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.529341  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.530606 13332 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:02.534947  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.535624  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:02.537652  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.538945 13406 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.564124  7574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 200) took 11265 ms (client timeout 15000 ms). Trace:
I20260501 14:01:02.569011  7577 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.543609  7792 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.571873 13436 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.573137  8377 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:01:02.574610  7577 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.578043 13332 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:01:02.585825  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.583206  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.589135  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.589962  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.564771  7574 rpcz_store.cc:269] 0501 14:00:51.298263 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:51.315309 (+ 17046us) service_pool.cc:224] Handling call
0501 14:01:02.563866 (+11248557us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:57.474831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:57.475518 (+   687us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:57.475584 (+    66us) write_op.cc:435] Acquired schema lock
0501 14:00:57.475614 (+    30us) tablet.cc:662] Decoding operations
0501 14:00:57.556233 (+ 80619us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:57.556316 (+    83us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:57.556347 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0501 14:00:57.563276 (+  6929us) tablet.cc:701] Row locks acquired
0501 14:00:57.564234 (+   958us) write_op.cc:260] PREPARE: finished
0501 14:00:57.577413 (+ 13179us) write_op.cc:270] Start()
0501 14:00:57.592763 (+ 15350us) write_op.cc:276] Timestamp: P: 1777644057575732 usec, L: 0
0501 14:00:57.592786 (+    23us) op_driver.cc:348] REPLICATION: starting
0501 14:00:57.656679 (+ 63893us) log.cc:844] Serialized 5474 byte log entry
0501 14:00:59.131117 (+1474438us) op_driver.cc:464] REPLICATION: finished
0501 14:00:59.487319 (+356202us) write_op.cc:301] APPLY: starting
0501 14:00:59.494176 (+  6857us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:00.179627 (+685451us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:00.179754 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:01.246698 (+1066944us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:01.247008 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0501 14:01:01.247053 (+    45us) write_op.cc:312] APPLY: finished
0501 14:01:01.247419 (+   366us) log.cc:844] Serialized 129 byte log entry
0501 14:01:01.379332 (+131913us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:01.430877 (+ 51545us) write_op.cc:454] Released schema lock
0501 14:01:01.443910 (+ 13033us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:01.468126 (+ 24216us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:01.469505 (+  1379us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":621247,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":260414,"apply.run_cpu_time_us":79385,"apply.run_wall_time_us":2050214,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62563,"num_ops":14,"prepare.queue_time_us":181238,"prepare.run_cpu_time_us":35602,"prepare.run_wall_time_us":426614,"raft.queue_time_us":800914,"raft.run_cpu_time_us":12025,"raft.run_wall_time_us":87785,"replication_time_us":1529911,"thread_start_us":931827,"threads_started":5,"wal-append.queue_time_us":584341,"wal-append.run_cpu_time_us":23798,"wal-append.run_wall_time_us":3048542}]]}
I20260501 14:01:02.599673 13332 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.603739  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.593989  7577 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 13, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:02.605628 13406 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.606884  8344 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.607739  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:02.612685  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.613517  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.614198  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.614668  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.616093  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:02.618183  7718 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.618793  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.619678 13332 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:02.621024 13514 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:01:02.625322  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.625945  7792 leader_election.cc:336] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.626545  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.626186  7577 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 13, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.627676 13406 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:02.628513  7792 leader_election.cc:336] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.628731  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.640434  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.641322  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.642102 13436 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:01:02.642756  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.643435  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:01:02.640398  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.651630 13406 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.644383  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.652734  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.653558  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.648041 13436 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:01:02.656339  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.656836 13436 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:02.657392 13534 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.658181  7718 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.648548  7577 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 14 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.655704  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.645649  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.660111  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.661679  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.658429 13436 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.663096 13424 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:02.666774 13406 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.668021  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.668102 13534 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.669157  7718 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.669835  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.668639  7577 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 17, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 17 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.674623  7577 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.671751  7718 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.668187  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.679665  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.679704  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.676241 13534 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.684456 13517 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.684835  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.687449 13519 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:02.690045  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.690683 13519 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.691038 13428 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260501 14:01:02.686256  7577 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 16, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.694072 13390 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.694458 13479 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.681627 13424 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260501 14:01:02.695109 13479 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.695145  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.695545 13409 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260501 14:01:02.701577  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.695508 13436 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.700858 13463 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:01:02.704257 13463 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:01:02.701009 13428 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.700866 13519 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:02.703146 13429 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.705619 13463 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:02.724189  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.724723  7625 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.725026  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.705596  7577 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.740028 13436 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:02.741492 13436 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.718268 13463 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:02.749559  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:02.740765  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69081.1us
W20260501 14:01:02.751627  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.752416  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.740485 13479 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:02.742523  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 74424.1us
I20260501 14:01:02.752928  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.760578 13534 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.761160  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.761741  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.762553 13534 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.760560  7577 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:02.763218  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.764822 13436 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:02.764544  7577 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 15, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 15 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.766400  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:02.716398 13514 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:01:02.755288  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.768338  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.770970 13406 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260501 14:01:02.771452 13436 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:02.773785  7577 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.771746  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 73654us
I20260501 14:01:02.809569  7577 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 11, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:02.818991  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:02.820020  8381 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:01:02.819065  7577 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:02.822677  7577 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.837018  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:02.850262  7824 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 16. Current term is 17. Ops: []
I20260501 14:01:02.856906  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.859498  7750 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:01:02.867271  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.870487  7754 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.878710  7577 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 15, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 15 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:02.890509  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.896236  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.897836  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.898550  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.897634  7577 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 9, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:02.900570  7577 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 14, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.899055  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.902791  7577 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.908900  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.909684  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.910730 13409 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.912376  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.912638  8375 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:01:02.912945  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.909000 13539 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.915436 13397 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:01:02.909004  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.920792  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.930680  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.933480  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.934082  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.936022 13397 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.943969  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.945164 13388 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:02.945632  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.946779  7792 leader_election.cc:336] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.947227  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.948256 13429 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.948585  7824 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260501 14:01:02.948941 13429 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.954365  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:02.956408  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.958138  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.959486 13224 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:01:02.962256  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.962352  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.962774  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.965209 13424 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.951313 13429 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.960438 13388 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:02.960919 13224 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:02.966555 13224 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:02.965797 13424 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.968231  7577 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.969486 13424 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:02.969950  7577 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.976974 13224 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.981118  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.981364 13224 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:02.971432  7577 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 16, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.977890 13424 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.978049 13463 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.979458  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.987865  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:02.988572  7749 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:02.989384 13424 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.989985 13424 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.991782  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:02.992185 13424 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:02.993978  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.994565  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.997795 13424 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:03.001947 13514 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260501 14:01:03.003051  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.020160  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:03.021559  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:03.022158  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.023424 13424 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:03.025597  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.026134  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:03.027107 13388 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.036283  7749 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:01:03.040688  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:03.041709 13224 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:01:03.042337 13224 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:01:03.043398 13224 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.053946  8377 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:01:03.055404 13424 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:01:03.088547 13424 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.089216 13424 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.091392 13424 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.096688  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.099007  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.099758  7749 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:01:03.124318  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:03.129949  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 53758.4us
I20260501 14:01:03.132120 13429 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.132896 13429 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.135149 13429 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.142191  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.143675  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.131676 13424 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:03.159749  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.164743 13429 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.187590 13384 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:03.199311  7824 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:03.209594 13428 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.210556  7754 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:01:03.210470 13428 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.213367 13428 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.215400  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.215641  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.218116 13428 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.218792 13428 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.222443 13428 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.228415 13428 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:01:03.231151  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.231802  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.236516 13424 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:03.236611  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.239643  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.243243 13428 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:03.243836 13436 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.242594 13424 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.244519 13436 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.251891 13436 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:03.256744  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet c91be7730b684fbd94e69655ab35fd61, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:03.257207  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet c91be7730b684fbd94e69655ab35fd61, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.261508 13514 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.262125 13514 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.264719 13514 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.265296 13553 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:01:03.266790  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.267488  8377 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:01:03.267921  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.268800  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:03.269069  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.269851 13384 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:01:03.270463 13384 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:03.271229 13384 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:01:03.275159  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.279975  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.283176 13424 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:03.285144  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:03.295859  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 14:01:03.296574  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet ac3b0214563f48f689fc427a69b7b5dd, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:03.297326  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet ac3b0214563f48f689fc427a69b7b5dd, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.330261 13384 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.358139  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:03.359833  8377 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:03.363952 13384 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:03.390977  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.393194  8377 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:01:03.395298  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:03.397044 13384 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:01:03.397760 13384 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:03.399121 13384 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.423902 13517 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.424875 13517 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.431190  7754 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:01:03.432535 13517 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.435215  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.435963  8377 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:01:03.436858  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:03.437075 13224 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:01:03.440096  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.449821  7824 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:03.442386 13534 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:03.453423 13534 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.453843 13534 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:03.534165 13534 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.536759 13534 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.553357  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:03.554486  7824 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:03.553539  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:03.568022  8377 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:01:03.570719 13424 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.571388 13424 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.572834  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.577525 13563 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:01:03.578120 13563 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:03.573758 13424 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.579147 13563 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.589340  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.591962  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:03.594381  6454 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 7704)
I20260501 14:01:03.597744  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.598878 13424 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:03.600755  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:03.604373  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 317) took 5601 ms. Trace:
I20260501 14:01:03.599889  7575 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:03.609310  7577 rpcz_store.cc:276] 0501 14:00:58.003154 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.059923 (+ 56769us) service_pool.cc:224] Handling call
0501 14:01:03.604272 (+5544349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:01:03.076726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:01:03.077527 (+   801us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:01:03.077583 (+    56us) write_op.cc:435] Acquired schema lock
0501 14:01:03.077611 (+    28us) tablet.cc:662] Decoding operations
0501 14:01:03.079414 (+  1803us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:01:03.079531 (+   117us) write_op.cc:641] Partition lock acquired for write op
0501 14:01:03.079571 (+    40us) tablet.cc:685] Acquiring locks for 23 operations
0501 14:01:03.086229 (+  6658us) tablet.cc:701] Row locks acquired
0501 14:01:03.086250 (+    21us) write_op.cc:260] PREPARE: finished
0501 14:01:03.086424 (+   174us) write_op.cc:270] Start()
0501 14:01:03.086584 (+   160us) write_op.cc:276] Timestamp: P: 1777644063086353 usec, L: 0
0501 14:01:03.086644 (+    60us) op_driver.cc:348] REPLICATION: starting
0501 14:01:03.087437 (+   793us) log.cc:844] Serialized 9053 byte log entry
0501 14:01:03.251208 (+163771us) op_driver.cc:464] REPLICATION: finished
0501 14:01:03.319039 (+ 67831us) write_op.cc:301] APPLY: starting
0501 14:01:03.319137 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:03.400367 (+ 81230us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:03.400537 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:03.455389 (+ 54852us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:03.456180 (+   791us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0501 14:01:03.456252 (+    72us) write_op.cc:312] APPLY: finished
0501 14:01:03.456853 (+   601us) log.cc:844] Serialized 204 byte log entry
0501 14:01:03.474335 (+ 17482us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.495715 (+ 21380us) write_op.cc:454] Released schema lock
0501 14:01:03.515528 (+ 19813us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:03.528229 (+ 12701us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.528276 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18126,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":65462,"apply.run_cpu_time_us":33966,"apply.run_wall_time_us":209043,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":81483,"prepare.run_cpu_time_us":16886,"prepare.run_wall_time_us":84564,"raft.queue_time_us":73163,"raft.run_cpu_time_us":7663,"raft.run_wall_time_us":65039,"replication_time_us":164339,"thread_start_us":223093,"threads_started":4,"wal-append.queue_time_us":65433}]]}
I20260501 14:01:03.623742 13424 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.623991 13436 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.611971  7575 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 14 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 15 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.624792 13436 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.626210  7575 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 14 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 15 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.624707 13424 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.629560 13424 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.627275 13436 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.629622  7575 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 9 to 10, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:03.633196  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.633757  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.635051  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.635381  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.645953  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.646857 13436 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:03.648263  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.649217 13436 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:03.721750  7575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 305) took 11414 ms (client timeout 15000 ms). Trace:
I20260501 14:01:03.722741  7574 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 14, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 14 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.734386 13436 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.735116 13436 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.735229  7574 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 17 to 20, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.737401 13436 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.738287  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.738546 13428 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.739131 13428 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.739735  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.741050  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.741768 13428 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.741979 13436 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.737658  7574 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.744225  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.745999  7574 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:03.734452  7575 rpcz_store.cc:269] 0501 14:00:52.307041 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:52.307380 (+   339us) service_pool.cc:224] Handling call
0501 14:01:03.721663 (+11414283us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:01:03.650916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:01:03.651531 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:01:03.651572 (+    41us) write_op.cc:435] Acquired schema lock
0501 14:01:03.651593 (+    21us) tablet.cc:662] Decoding operations
0501 14:01:03.652260 (+   667us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:01:03.652331 (+    71us) write_op.cc:641] Partition lock acquired for write op
0501 14:01:03.652362 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0501 14:01:03.652803 (+   441us) tablet.cc:701] Row locks acquired
0501 14:01:03.652824 (+    21us) write_op.cc:260] PREPARE: finished
0501 14:01:03.652982 (+   158us) write_op.cc:270] Start()
0501 14:01:03.653109 (+   127us) write_op.cc:276] Timestamp: P: 1777644063652929 usec, L: 0
0501 14:01:03.653129 (+    20us) op_driver.cc:348] REPLICATION: starting
0501 14:01:03.653821 (+   692us) log.cc:844] Serialized 1684 byte log entry
0501 14:01:03.661380 (+  7559us) op_driver.cc:464] REPLICATION: finished
0501 14:01:03.662569 (+  1189us) write_op.cc:301] APPLY: starting
0501 14:01:03.662675 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:03.665376 (+  2701us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:03.665476 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:03.675512 (+ 10036us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:03.675740 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0501 14:01:03.675796 (+    56us) write_op.cc:312] APPLY: finished
0501 14:01:03.676135 (+   339us) log.cc:844] Serialized 49 byte log entry
0501 14:01:03.678273 (+  2138us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.678391 (+   118us) write_op.cc:454] Released schema lock
0501 14:01:03.678438 (+    47us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:03.678895 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.678923 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":319451,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":928,"apply.run_cpu_time_us":6819,"apply.run_wall_time_us":16277,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":309,"prepare.run_cpu_time_us":3261,"prepare.run_wall_time_us":14396,"replication_time_us":8080}]]}
I20260501 14:01:03.760813  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.766371  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.753252  7574 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 13, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.778380  7574 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.788552  7574 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.793326 13436 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.798707  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.800385  7574 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.802168  7574 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.805996 13428 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:03.806283  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:03.802727 13436 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.810976 13436 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.812443  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.813689  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.814330  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.815078  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.815023  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.823616  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.824783 13428 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.826859 13428 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.827486 13428 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.827785  6454 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.831940  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.852809  6454 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.833218  8377 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:01:03.853614  6454 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.838994  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.850850 13436 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.856720 13517 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:01:03.857834 13436 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.831105 13428 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.860631 13436 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.863998  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.808391  7574 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 13 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.870499  7574 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 13, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.876380  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.888592 13436 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.889127  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.873152  7574 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.889446 13436 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.890736 13428 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:03.890532  7574 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.890717  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.889415  6454 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.892880 13428 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.897990 13436 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.898152  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.898665 13436 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.900696  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.899264 13436 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.901808  6454 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.902812  6454 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.903707 13436 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.905367  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.911432  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.912451  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.913792 13428 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.916525 13424 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.917886 13424 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.923794 13424 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.927107  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.928411  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.929801  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.930518 13424 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.931074 13424 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.933252 13424 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.933943  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.935137  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.936362  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.927306  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.944389  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.944517  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.946121 13424 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:03.947798  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:03.952224  6454 tablet_replica.cc:333] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.953438  6454 raft_consensus.cc:2243] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.954203  6454 raft_consensus.cc:2272] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.957944  6454 tablet_replica.cc:333] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.959860  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:03.960752  7643 raft_consensus.cc:2686] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260501 14:01:03.961452  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.962249 13436 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.958913  6454 raft_consensus.cc:2243] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.969614  6454 pending_rounds.cc:70] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:03.969894  6454 pending_rounds.cc:77] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7281230012093726720 op_type: NO_OP noop_request { }
I20260501 14:01:03.970501  6454 raft_consensus.cc:2889] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:03.970937  6454 raft_consensus.cc:2272] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.973429 13436 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.974092 13436 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.981587  8377 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260501 14:01:03.982579 13436 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.984608 13534 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:01:03.984854  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.986771  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.988915  6454 tablet_replica.cc:333] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.992362  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:03.993566 13436 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:04.003566  6454 raft_consensus.cc:2243] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.004737  6454 raft_consensus.cc:2272] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.009502 13436 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.010162 13436 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.012465 13436 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.014952  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.014798  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.026732  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.029686 13388 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.030349 13388 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.028460 13436 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:04.035723 13388 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.032522  7576 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 11 to 12, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:04.040256  6454 tablet_replica.cc:333] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.041612  6454 raft_consensus.cc:2243] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.045634  6454 raft_consensus.cc:2272] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.047631  8377 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.063361  7824 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260501 14:01:04.064826 13436 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.065506 13436 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.066936 13534 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:01:04.069963 13436 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.080821  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.084314  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.085467  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.086488  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.087248  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.088143 13436 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.085803 13384 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.088936 13384 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.091233 13384 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.092693  7819 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260501 14:01:04.095463  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.095932  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.096232  8376 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:01:04.096616  7819 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:01:04.099752 13539 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260501 14:01:04.103529  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:04.104771 13563 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:04.104817  7745 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260501 14:01:04.105289 13563 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:04.105867 13563 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:04.107441 13332 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:01:04.134948 13436 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.135995 13436 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.172822 13424 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.173496 13424 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.175769 13424 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.175858  7577 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 17, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.177407  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.181679  7577 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 17, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.186385  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.188719  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.189044  8375 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:01:04.188186 13436 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.087493  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.190428  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 13, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.192811  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.192535  7577 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.194224  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.195209 13436 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:04.185748  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 286) took 8791 ms. Trace:
I20260501 14:01:04.194336  7577 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.202323  7577 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 16, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.206403  7577 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.210613  7577 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.214681  6454 tablet_replica.cc:333] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.214850  7577 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.216256  6454 raft_consensus.cc:2243] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.197988  7576 rpcz_store.cc:276] 0501 14:00:55.394166 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:55.395443 (+  1277us) service_pool.cc:224] Handling call
0501 14:01:04.185663 (+8790220us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:01:04.055995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:01:04.056570 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:01:04.056614 (+    44us) write_op.cc:435] Acquired schema lock
0501 14:01:04.056632 (+    18us) tablet.cc:662] Decoding operations
0501 14:01:04.057043 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:01:04.057103 (+    60us) write_op.cc:641] Partition lock acquired for write op
0501 14:01:04.057129 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0501 14:01:04.057335 (+   206us) tablet.cc:701] Row locks acquired
0501 14:01:04.057353 (+    18us) write_op.cc:260] PREPARE: finished
0501 14:01:04.057511 (+   158us) write_op.cc:270] Start()
0501 14:01:04.057621 (+   110us) write_op.cc:276] Timestamp: P: 1777644064057461 usec, L: 0
0501 14:01:04.057640 (+    19us) op_driver.cc:348] REPLICATION: starting
0501 14:01:04.058332 (+   692us) log.cc:844] Serialized 533 byte log entry
0501 14:01:04.060210 (+  1878us) op_driver.cc:464] REPLICATION: finished
0501 14:01:04.061954 (+  1744us) write_op.cc:301] APPLY: starting
0501 14:01:04.062039 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:04.062920 (+   881us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:04.063014 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:04.064855 (+  1841us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:04.065052 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0501 14:01:04.065104 (+    52us) write_op.cc:312] APPLY: finished
0501 14:01:04.065305 (+   201us) log.cc:844] Serialized 25 byte log entry
0501 14:01:04.066301 (+   996us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:04.066401 (+   100us) write_op.cc:454] Released schema lock
0501 14:01:04.066447 (+    46us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:04.068467 (+  2020us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:04.068500 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":1494,"apply.run_cpu_time_us":3041,"apply.run_wall_time_us":4829,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2691,"prepare.run_wall_time_us":2690,"replication_time_us":2437}]]}
I20260501 14:01:04.219349  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.223287  7577 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 11, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.227574  7577 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.232803  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.234763  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.234181  7577 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 16, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 16 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.242121  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:04.238245  7577 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 14, term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.248945  6454 raft_consensus.cc:2272] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.241823 13436 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:04.247129 13390 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:04.251874 13390 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:04.252391 13390 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:04.219064 13563 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:04.266891  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49338.7us
I20260501 14:01:04.272699 13563 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.278450  6454 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.279572  6454 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.280570  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:04.283991  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.290027 13436 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.293767 13539 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.298990  7819 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.302809  7753 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 18: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:04.307179  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:04.307869  8377 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:04.311378 13428 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.311980 13428 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.312039 13436 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.314898  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.316099 13436 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.317253  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.314128 13428 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.322106  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.325245  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.325378  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.326630 13428 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.327448  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.328225  6454 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.328294 13428 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.331183  6454 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.334596 13390 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.336182  7824 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:04.335942  8377 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:01:04.366707  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.368036 13397 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:01:04.369185 13397 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:04.377523  6454 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.373361 13397 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.400344 13390 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.402209  7746 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.404810  6454 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.408419  6454 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.409337  6454 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.409945  6454 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.425348  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 93b661856a9e45bf823981177d99ae0c with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260501 14:01:04.427484  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:04.429756  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:04.431684  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:04.432519  8377 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 18: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:04.433365  6454 tablet_replica.cc:333] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.434931  6454 raft_consensus.cc:2243] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.436582 13428 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.437224 13428 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.439342 13428 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.443536  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.455448  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.456305  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.456526 13388 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260501 14:01:04.458050  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.458801 13428 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:04.474750  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:04.481089  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:04.486447  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:04.481350  6454 raft_consensus.cc:2272] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.491114  6454 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.509030  7574 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 17 to 18, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 18 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.511803  7574 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.514870  7574 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.516350 13428 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.510175  6454 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.527088 13428 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.527581  6454 pending_rounds.cc:70] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:04.528911  6454 pending_rounds.cc:77] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 8 index: 8 } timestamp: 7281230018853801984 op_type: NO_OP noop_request { }
I20260501 14:01:04.529259  6454 raft_consensus.cc:2889] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:04.529693  6454 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.534550 13428 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.536259  7574 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.545840  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.550259  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.557000  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.557886 13428 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.587039 13428 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.587690 13428 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.589948 13428 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.586695  6454 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.594022  7746 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:04.594949  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.596686  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.602337  6454 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.604770  6454 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.610478  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.614578  6454 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.616688 13428 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:04.615621  6454 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.626606  6454 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.666208  7819 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260501 14:01:04.679468 13563 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260501 14:01:04.682677  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c91be7730b684fbd94e69655ab35fd61. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:04.682211  7575 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.695274  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
W20260501 14:01:04.696017  8344 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 257 similar messages]
I20260501 14:01:04.696488  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.712827  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:04.853816  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:04.868410 13587 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.861195 13590 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:04.872131 13590 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.879107 13590 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.872223 13587 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.881631 13587 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.890484 13590 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.891491 13590 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.896741 13590 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.924809  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:04.928370  7562 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 88592.9us
I20260501 14:01:04.972750  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.981861  6454 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
W20260501 14:01:04.988411  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:04.992478  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:05.003806  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.008627  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 16 to 18, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 18 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.020977  6454 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:05.027392  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.034205  6454 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.033732  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:05.039964  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260501 14:01:05.069096  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.061343 13592 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:05.093298  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 54768.9us
I20260501 14:01:05.119408  8377 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260501 14:01:05.119462  6454 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.121904  6454 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.122541  6454 pending_rounds.cc:70] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.122802  6454 pending_rounds.cc:77] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7281230012247425024 op_type: NO_OP noop_request { }
I20260501 14:01:05.123149  6454 raft_consensus.cc:2889] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.126639  6454 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.134630  7819 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260501 14:01:05.140717  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.095745 13592 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:05.156641  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.158466  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.159796  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.162752 13587 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:05.117625 13595 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.173750 13592 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.176568  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.179752  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.183926  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:05.184739  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.191895 13587 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:05.195766  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.185492 13592 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:05.203246  6454 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.204290  6454 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:05.205513  6454 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.208005  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.210420 13592 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:05.213083  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.213721  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.215575  6454 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.216668  6454 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.217696  6454 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.220795  6454 tablet_replica.cc:333] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.234874  6454 raft_consensus.cc:2243] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.234169  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 14 to 15, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.235541  6454 pending_rounds.cc:70] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.235800  6454 pending_rounds.cc:77] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 16 index: 9 } timestamp: 7281230056671744000 op_type: NO_OP noop_request { }
I20260501 14:01:05.236172  6454 raft_consensus.cc:2889] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.236536  6454 raft_consensus.cc:2272] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.242470 13592 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.243018 13592 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:05.245136 13592 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.252025  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.261778  7826 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.239707  6454 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.266909  6454 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.273808  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.276633  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.278855 13592 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:05.279147 13605 ts_tablet_manager.cc:933] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:05.281163  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.282634  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.283386  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.287003 13603 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260501 14:01:05.293558  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.295356  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.302596  6454 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.309187  6454 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.308200 13603 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260501 14:01:05.310261  6454 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.310901  6454 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.312315 13605 tablet_copy_client.cc:323] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:01:05.315424  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet c91be7730b684fbd94e69655ab35fd61 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:01:05.316051  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet c91be7730b684fbd94e69655ab35fd61 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-c91be7730b684fbd94e69655ab35fd61
I20260501 14:01:05.327168  7764 tablet_copy_source_session.cc:215] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
W20260501 14:01:05.330821  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.335453  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.336755  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.333596 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c91be7730b684fbd94e69655ab35fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:05.341572 13592 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.342142 13592 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:05.341903  7753 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:05.344184 13592 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:05.334106  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.345577  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.346381  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.346984  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.347599  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.349938  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.354256  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:05.363113  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.362322  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:05.370738  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.371749  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:05.367923  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.372740 13592 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:05.374118 13592 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.374606 13592 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:05.376433  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.377605  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.376590 13592 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.383733  6454 pending_rounds.cc:70] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.383420  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.384202  6454 pending_rounds.cc:77] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7281230000561123328 op_type: NO_OP noop_request { }
I20260501 14:01:05.384913  6454 raft_consensus.cc:2889] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.385919  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.388571  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.389925  7824 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:01:05.390619  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:05.391306  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.392961 13592 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:05.395164  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.397136 13594 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260501 14:01:05.401371  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47951612b03c496aa487574a115ca380. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:05.408891  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.417897  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.423511  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.434108  6454 tablet_replica.cc:333] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
W20260501 14:01:05.438125  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.438959 13592 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.439617 13592 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:05.441741 13592 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.439137  6454 raft_consensus.cc:2243] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.443569  6454 raft_consensus.cc:2272] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.445580  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.458218  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.462159 13605 tablet_copy_client.cc:806] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:05.462957 13605 tablet_copy_client.cc:670] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:05.463406  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.464429 13592 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:05.466650  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.475241  6454 tablet_replica.cc:333] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.476310  6454 raft_consensus.cc:2243] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.476866  6454 raft_consensus.cc:2272] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.478343 13605 tablet_copy_client.cc:538] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:05.478992 13595 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 14:01:05.489003  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.489658  6454 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.491869  7826 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 14:01:05.493152  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.494292  6454 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.494949  6454 pending_rounds.cc:70] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.495253  6454 pending_rounds.cc:77] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7281230040542085120 op_type: NO_OP noop_request { }
I20260501 14:01:05.495622  6454 raft_consensus.cc:2889] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.496042  6454 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.499514  6454 tablet_replica.cc:333] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.500387  6454 raft_consensus.cc:2243] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.500986  6454 raft_consensus.cc:2272] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.504443  6454 tablet_replica.cc:333] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.505424  6454 raft_consensus.cc:2243] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.506435  6454 raft_consensus.cc:2272] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.510191  6454 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.511077  6454 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.511622  6454 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.514829  6454 tablet_replica.cc:333] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.515772  6454 raft_consensus.cc:2243] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.516296 13592 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:05.517060 13592 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:05.519065 13592 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.520608  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.523259  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.524756  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.526003 13592 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:05.533754  6454 raft_consensus.cc:2272] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.540767  7824 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 14:01:05.544508  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.549556  7576 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 9, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.552098 13605 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 14:01:05.564493  6454 tablet_replica.cc:333] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.572728  6454 raft_consensus.cc:2243] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.573756  6454 pending_rounds.cc:70] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.574046  6454 pending_rounds.cc:77] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7281229956481773568 op_type: NO_OP noop_request { }
I20260501 14:01:05.574498  6454 raft_consensus.cc:2889] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.574909  6454 raft_consensus.cc:2272] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.599200  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.602998  7747 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260501 14:01:05.605111  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f623f4077ef4ffdad05ca3c40797b9f. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.608609 13406 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260501 14:01:05.612084  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.616287  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.617388  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.618178  6454 pending_rounds.cc:70] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 2 pending ops.
I20260501 14:01:05.618464  6454 pending_rounds.cc:77] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7281229952021377024 op_type: NO_OP noop_request { }
I20260501 14:01:05.624356  6454 raft_consensus.cc:2889] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.624727  6454 pending_rounds.cc:77] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 7 index: 7 } timestamp: 7281229908334153728 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c445f628c10d40b5a232bb391c4c92de" old_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } } }
I20260501 14:01:05.631495  6454 raft_consensus.cc:2917] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted
I20260501 14:01:05.632006  6454 raft_consensus.cc:2889] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.632349  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.635499  6454 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.636410  6454 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.637203  6454 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.640347  6454 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.641902  6454 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:05.642794  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.644142  6454 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.648993 13585 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.653429  6454 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.654421  6454 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.655097  6454 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.658414  6454 tablet_replica.cc:333] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.664476  7747 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.678455  6454 raft_consensus.cc:2243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.679387  6454 raft_consensus.cc:2272] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.689962  6454 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.690899  6454 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.693842  6454 pending_rounds.cc:70] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 2 pending ops.
I20260501 14:01:05.694460  6454 pending_rounds.cc:77] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7281229974682984448 op_type: NO_OP noop_request { }
I20260501 14:01:05.694952  6454 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.697265  7576 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 8, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.700569  6454 pending_rounds.cc:77] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7281229922317611008 op_type: NO_OP noop_request { }
I20260501 14:01:05.701092  6454 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.701493  6454 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.704658  6454 tablet_replica.cc:333] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.712864  6454 raft_consensus.cc:2243] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.713713  6454 raft_consensus.cc:2272] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.722558  7747 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 14:01:05.747807  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.765574  6454 tablet_replica.cc:333] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.775884  6454 raft_consensus.cc:2243] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.776736  6454 raft_consensus.cc:2272] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.808246  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.815259  6454 tablet_replica.cc:333] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.815706  7824 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:01:05.829519  6454 raft_consensus.cc:2243] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.830626  6454 raft_consensus.cc:2272] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.823676  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 959ae22d6e614940b93df344dbf7fa20. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.840415  6454 tablet_replica.cc:333] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.841410  6454 raft_consensus.cc:2243] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.842124  6454 raft_consensus.cc:2272] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.846681 13563 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:01:05.854604 13605 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:01:05.855908 13605 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:05.856832 13605 ts_tablet_manager.cc:1403] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.349s	user 0.049s	sys 0.021s
W20260501 14:01:05.874256  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.880978 13618 ts_tablet_manager.cc:933] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:05.892746 13592 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.893908 13592 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:05.901284  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.898947  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.909674  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:05.910558  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.912338  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:05.897771 13592 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:05.914582 13592 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:05.915490 13618 tablet_copy_client.cc:323] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:01:05.917352  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 47951612b03c496aa487574a115ca380 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:01:05.917893  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 47951612b03c496aa487574a115ca380 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-47951612b03c496aa487574a115ca380
I20260501 14:01:05.925312  6454 pending_rounds.cc:70] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 3 pending ops.
I20260501 14:01:05.925684  6454 pending_rounds.cc:77] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7281229884388577280 op_type: NO_OP noop_request { }
I20260501 14:01:05.926151  6454 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.926486  6454 pending_rounds.cc:77] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7281229866539462656 op_type: NO_OP noop_request { }
I20260501 14:01:05.926833  6454 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.927130  6454 pending_rounds.cc:77] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7281229836714962944 op_type: NO_OP noop_request { }
I20260501 14:01:05.927465  6454 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.928623  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.892916 13605 raft_consensus.cc:359] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:05.931982  6454 tablet_replica.cc:333] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.937633  6454 raft_consensus.cc:2243] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.936668 13605 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:05.941372 13605 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:05.943496 13563 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 8 to 11, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.947054  7764 tablet_copy_source_session.cc:215] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:01:05.959180 13605 ts_tablet_manager.cc:1434] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.004s
I20260501 14:01:05.946941  7825 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 8 to 11, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.964408  6454 raft_consensus.cc:2272] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.978739  7576 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 8 to 11, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.983273 13618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47951612b03c496aa487574a115ca380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:05.998267  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-c91be7730b684fbd94e69655ab35fd61 received from {username='slave'} at 127.0.0.1:42716
I20260501 14:01:06.000469  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-c91be7730b684fbd94e69655ab35fd61 on tablet c91be7730b684fbd94e69655ab35fd61 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:06.004241  6454 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:06.007341  6454 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:06.008035  6454 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:06.011000  6454 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:06.030992  6454 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:06.056041  6454 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:06.085608  6454 tablet_replica.cc:333] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:06.086344  6454 raft_consensus.cc:2243] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:06.086998  6454 raft_consensus.cc:2272] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:06.103541  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 66613.3us
W20260501 14:01:06.121217  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:06.156042 13618 tablet_copy_client.cc:806] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:06.156862 13618 tablet_copy_client.cc:670] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:06.179775  8376 raft_consensus.cc:1217] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
I20260501 14:01:06.194962 13605 ts_tablet_manager.cc:933] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:06.204973 13618 tablet_copy_client.cc:538] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:06.243253 13618 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 14:01:06.272454 13605 tablet_copy_client.cc:323] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 14:01:06.282177  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 0f623f4077ef4ffdad05ca3c40797b9f from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 14:01:06.282802  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 0f623f4077ef4ffdad05ca3c40797b9f from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-0f623f4077ef4ffdad05ca3c40797b9f
I20260501 14:01:06.300866  7838 tablet_copy_source_session.cc:215] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:01:06.304888 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f623f4077ef4ffdad05ca3c40797b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:06.306664 13626 ts_tablet_manager.cc:933] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:06.323971 13626 tablet_copy_client.cc:323] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:01:06.331117  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 959ae22d6e614940b93df344dbf7fa20 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:01:06.331758  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 959ae22d6e614940b93df344dbf7fa20 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-959ae22d6e614940b93df344dbf7fa20
I20260501 14:01:06.341646  7764 tablet_copy_source_session.cc:215] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:01:06.353554 13626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959ae22d6e614940b93df344dbf7fa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:06.382043 13605 tablet_copy_client.cc:806] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:06.382927 13605 tablet_copy_client.cc:670] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:06.389230 13605 tablet_copy_client.cc:538] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:06.424685 13563 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.425390 13563 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.427486 13563 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:06.434064  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:06.437371  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:06.447077  7562 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51280.4us
I20260501 14:01:06.451634 13605 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
W20260501 14:01:06.458642  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.460539  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:06.461484 13624 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:06.487511 13626 tablet_copy_client.cc:806] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:06.493558 13626 tablet_copy_client.cc:670] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:06.496685 13622 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.497385 13622 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.501539  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:06.502285  7752 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:01:06.499567 13622 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:06.504329  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:01:06.506237  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260501 14:01:06.506572 13624 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.508553 13624 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.510308 13622 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:01:06.510747 13626 tablet_copy_client.cc:538] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:06.510869 13624 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:06.512241  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:06.513195  8375 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:01:06.510807 13622 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.518416 13622 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:06.515864  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:06.523568 13563 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:06.524005 13563 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.524371 13563 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:06.528254 13618 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260501 14:01:06.529119  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.529418 13618 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:06.530318 13618 ts_tablet_manager.cc:1403] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.287s	user 0.031s	sys 0.013s
W20260501 14:01:06.534396  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.539655 13618 raft_consensus.cc:359] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.550490 13563 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.558020 13622 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.563012 13563 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:06.564114 13626 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
W20260501 14:01:06.567970  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.570655  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:06.571288  8375 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:06.580874  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.540731 13618 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:06.585017 13622 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:06.586897  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:06.587534  7752 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:06.594897  8375 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:01:06.583808 13618 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.596694  7752 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:01:06.598167 13618 ts_tablet_manager.cc:1434] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260501 14:01:06.598948  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:06.599958 13624 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:01:06.600455 13624 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:06.598995  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:06.601732 13622 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:01:06.601305 13624 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.602432 13622 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:01:06.603343 13622 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.603787  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-47951612b03c496aa487574a115ca380 received from {username='slave'} at 127.0.0.1:42716
I20260501 14:01:06.604306  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-47951612b03c496aa487574a115ca380 on tablet 47951612b03c496aa487574a115ca380 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:06.632114  8376 raft_consensus.cc:1217] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260501 14:01:06.659969  7575 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 14 to 15, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 15 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:06.692782 13605 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:01:06.713414  7576 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:06.744362 13605 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:06.745729 13605 ts_tablet_manager.cc:1403] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.294s	user 0.035s	sys 0.010s
I20260501 14:01:06.792030 13605 raft_consensus.cc:359] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.793962 13605 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:06.794792 13605 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.797473 13605 ts_tablet_manager.cc:1434] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260501 14:01:06.805284  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-0f623f4077ef4ffdad05ca3c40797b9f received from {username='slave'} at 127.0.0.1:45436
I20260501 14:01:06.805862  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-0f623f4077ef4ffdad05ca3c40797b9f on tablet 0f623f4077ef4ffdad05ca3c40797b9f with peer 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:06.856209  7718 connection.cc:744] client connection to 127.6.77.129:36443 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260501 14:01:06.858227  7792 connection.cc:570] client connection to 127.6.77.129:36443 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260501 14:01:06.858530  8344 connection.cc:570] client connection to 127.6.77.129:36443 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260501 14:01:06.912830  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44457us
W20260501 14:01:06.912446  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53350.5us
W20260501 14:01:06.994679  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:06.999989 13644 raft_consensus.cc:1064] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.002620 13644 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:07.040093  8375 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260501 14:01:07.055491 13639 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:01:07.091728  8376 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260501 14:01:07.095831  7824 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260501 14:01:07.098436  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:07.116497 13638 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260501 14:01:07.127210  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:07.139484  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:07.156172  8376 raft_consensus.cc:1217] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260501 14:01:07.161159  7745 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:01:07.170288 13622 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260501 14:01:07.182116  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54415.5us
I20260501 14:01:07.215973 13626 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:01:07.217263 13626 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:07.218111 13626 ts_tablet_manager.cc:1403] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.683s	user 0.050s	sys 0.029s
I20260501 14:01:07.223469 13638 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260501 14:01:07.253715 13626 raft_consensus.cc:359] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:07.254727 13626 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:07.255451 13626 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:07.277609 13626 ts_tablet_manager.cc:1434] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.003s
I20260501 14:01:07.283459  8376 raft_consensus.cc:1217] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260501 14:01:07.315940  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-959ae22d6e614940b93df344dbf7fa20 received from {username='slave'} at 127.0.0.1:42716
I20260501 14:01:07.316591  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-959ae22d6e614940b93df344dbf7fa20 on tablet 959ae22d6e614940b93df344dbf7fa20 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:07.338843 13638 raft_consensus.cc:1064] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.341989 13638 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.363695  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.370923  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.371595  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.381678  8380 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:01:07.383889  7826 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260501 14:01:07.388872  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.391709  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.412003 13659 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.005s
W20260501 14:01:07.426680 13661 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.008s
W20260501 14:01:07.444607  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55189.7us
I20260501 14:01:07.476502 13563 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260501 14:01:07.489882  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.492897 13603 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:01:07.493086 13563 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.487388  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.501752  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.503656  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.521867  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:07.523541  8380 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.557150  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.567052 13645 raft_consensus.cc:1064] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.569700 13645 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:07.572041  7575 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.607057  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.610231  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.610834  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.613629 13641 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.629499  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.642766  7824 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.658025  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.659853  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.668828  8380 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.683195  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.683350  8375 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:01:07.686484  7752 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260501 14:01:07.689654  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:07.692028 13635 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:01:07.695236 13586 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260501 14:01:07.704221  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:07.705132  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.716518  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.727020  7824 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.729776 13641 raft_consensus.cc:1064] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.732808 13641 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.765131  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.762470 13586 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.767930  7752 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.780670  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.785458  8377 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:01:07.794123  7819 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:01:07.796641 13563 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:07.807576  7747 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.808193  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:07.815779  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.822592  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.820456  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.827147  7826 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260501 14:01:07.833449 13642 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260501 14:01:07.837558 13642 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:07.842381 13642 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.848603  8380 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260501 14:01:07.857532  7576 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.867836  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c91be7730b684fbd94e69655ab35fd61 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 14:01:07.876533  7826 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.897802  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.903759  7745 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.906468  7562 catalog_manager.cc:5194] ChangeConfig:REMOVE_PEER RPC for tablet c91be7730b684fbd94e69655ab35fd61 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER failed with leader 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 16 but the committed config has opid_index of 17
I20260501 14:01:07.912238  7575 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:07.916620  8376 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.921732 13644 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260501 14:01:07.934760  7824 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:01:07.938017 13639 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:01:07.944322  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.958500  8380 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260501 14:01:07.962517  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.963342  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.970883  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.971437 13563 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.966084  8375 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.979949 13639 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:01:07.980904  6454 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7700)
I20260501 14:01:07.980803  7825 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:08.012225  8376 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.033407  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.035247 13641 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.050062  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.055552  7819 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.063465  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.079927  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:08.093274  7575 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:01:08.094561  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.107372  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 87708.4us
I20260501 14:01:08.116856  8377 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.122797  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.148713  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 47951612b03c496aa487574a115ca380 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260501 14:01:08.150117  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.163349  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.240207  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.254669  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.255661  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.429575  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.602062  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.823354  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.845779  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 47951612b03c496aa487574a115ca380: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:08.981439  6454 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:09.327649  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.400453  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:09.640372  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46776.5us
W20260501 14:01:09.676142  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 91267.9us
W20260501 14:01:09.699769  7792 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 475 similar messages]
W20260501 14:01:09.739727  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.739966  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.748536  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:09.825944  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.849982  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.894575  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.917759  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.923979  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.978175  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.982007  6454 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:10.027640  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.030989  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.043561  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.047749  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.048406  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.049279  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.079704  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.191143  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.210150  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.237382  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.249926  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.263300  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:10.289497  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.329524  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:10.334853  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.340265  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.391175  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.394626  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.404502  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.419376  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.451807  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.484717  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.491974  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:10.503185  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.562783  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.635094  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.704424  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.710834  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.743428  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.836331  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48624.9us
W20260501 14:01:10.854360  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46222.6us
W20260501 14:01:10.868196  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.889374  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.896175  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.982540  6454 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:11.021863  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.055548  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.132928  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.268745  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.385846  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 50119.6us
W20260501 14:01:11.927327  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:11.942795  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:11.983103  6454 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:12.044150  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.130812  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.136227  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.166299  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.211170  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.223889  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:12.303383  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.423373  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:12.507285  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49135.6us
W20260501 14:01:12.543771  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.582154  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.614598  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.622877  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.646340  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.676853  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.690066  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.691045  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.691743  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.696451  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.786450  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.810890  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.826864  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.832794  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.874372  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.880191  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:12.919562  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.944696  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.984261  6454 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:12.997830  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.036773  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.071470  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.089917  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.116868  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.153345  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:13.155997  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.189810  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.236925  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.268074  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.278710  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.297087  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.349522  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.392750  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.448634  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.514793  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.599931  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.645473  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.699363  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 45466.4us
W20260501 14:01:13.984862  6454 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:13.989826  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:14.180544  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:14.243701  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:14.372412  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.562232  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.600178  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.616603  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.706779  8344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260501 14:01:14.724450  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:14.759413  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.823525  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.824623  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.858657  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.966339  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.977592  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.985838  6454 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:15.018424  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.115307  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.158092  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.233549  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.241230  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.312170  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.331571  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.384745  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:15.398001  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.408030  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.412535  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.413230  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.456373  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.481004  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.544287  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.573292  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.593894  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.617447  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.618911  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.628577  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.629864  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.661595  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:15.697173  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.722658  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.770648  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.773875  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.855104  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.890616  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.897985  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.987354  6454 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:16.049592  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.118453  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.217177  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.259294  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.575413  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:16.714834  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:16.737422  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:16.738008  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.958657  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.062291  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.116359  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:17.548942  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.574361  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.707562  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:18.242635 13723 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.244079 13723 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.276892 13723 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.297637 13725 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.298784 13723 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.301868 13723 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:18.299688  7793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.041s	sys 0.058s
W20260501 14:01:18.303900  7793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.041s	sys 0.060s
I20260501 14:01:18.299430 13725 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.291102 13724 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.306139 13724 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.307948 13725 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.305311 13723 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.310151 13724 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.319765 13730 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.320498 13730 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.327046 13730 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.331467 13730 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.332121 13730 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.334406 13730 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.338975 13731 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.339481 13732 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.339663 13731 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.340066 13732 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.342350 13731 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.342407 13732 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.357210 13735 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.358011 13735 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.361243 13735 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:18.490715  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.018s	sys 0.071s
W20260501 14:01:18.491752  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.019s	sys 0.071s
I20260501 14:01:18.493330 13727 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.494038 13727 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.495790 13727 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.499094 13730 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.500655 13730 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.502068 13728 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.502321 13723 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.506798 13733 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.506582 13728 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.507375 13733 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.509006 13728 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.502740 13727 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.511299 13727 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.512327 13733 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.510048 13731 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.513044 13731 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.513502 13727 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.518217 13731 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.647804 13731 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.648873 13731 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.651899 13731 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.510711 13737 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.789692 13737 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.792949 13737 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.710246 13733 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.796281 13733 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.624681 13723 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.799153 13723 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.775981 13732 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.800123 13732 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.510739 13730 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.802654 13732 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.806268 13733 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.884299 13730 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.884951 13730 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.887178 13730 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.897681 13737 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.898527 13737 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.901229 13737 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.902753 13737 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.903537 13737 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.909691 13737 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.912698 13737 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.910358 13740 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.913899 13740 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.922072 13740 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.913300 13737 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.924692 13737 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:18.919595  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.012s	sys 0.005s
I20260501 14:01:18.927538 13736 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.928159 13736 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.931280 13736 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.946888 13736 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.947929 13729 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.948184 13731 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.947458 13736 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.948743 13729 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.950930 13736 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.951052 13729 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.951530 13736 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.948832 13731 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.947881 13741 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.954562 13731 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.954788 13741 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.952085 13736 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.956933 13741 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.957430 13741 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.957901 13741 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:18.961221  7792 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.010s
I20260501 14:01:18.962683 13736 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:18.963179  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.003s
W20260501 14:01:18.963708  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.003s
W20260501 14:01:18.961725  7792 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.011s
I20260501 14:01:18.971928 13729 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.973196 13729 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.976580 13729 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.981182 13731 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.981882 13731 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.984261 13731 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.988081 13730 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.988708 13730 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.989723 13743 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.990309 13743 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.990847 13728 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.991000 13723 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.991506 13728 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.991658 13723 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.992555 13743 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.993608 13728 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.993817 13723 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.994190 13728 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.994445 13723 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.994751 13728 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.994959 13723 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.990789 13730 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.998198 13723 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.999275 13739 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.000026 13739 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.010497 13728 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.011341 13739 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.012883 13744 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:01:19.026206  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8720 after lost signal to thread 6457
I20260501 14:01:19.026418  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.027834  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800040cc0 after lost signal to thread 7611
W20260501 14:01:19.029970  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800227220 after lost signal to thread 7778
I20260501 14:01:18.961710 13741 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:19.033806  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080027d540 after lost signal to thread 7852
I20260501 14:01:19.034464  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.018081  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.024931 13746 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.993854 13743 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.033547  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.037147 13743 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.039481 13743 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.039986 13743 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.040509 13743 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.026093 13744 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.043325 13744 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.043860 13744 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.044332 13744 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.046257 13744 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.046747 13744 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.016911 13745 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.048323 13745 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.050369 13745 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.050812 13745 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.051246 13745 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.048347  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.047217 13744 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.062341 13748 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.063025  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.079012  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf0e0 after lost signal to thread 8405
I20260501 14:01:19.064849  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.065078  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.084395 13744 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.064626 13745 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.085706 13745 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.086323 13745 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.088088 13622 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.088711 13622 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.090476 13745 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.061031 13746 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.091163 13745 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.092743 13746 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.092530 13745 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.090685 13622 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.094216 13746 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.094820 13746 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.096421 13745 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:01:19.085033 13744 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.097132 13746 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.101632  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.064288 13743 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.105209 13744 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.109900 13744 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.063246 13748 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.112725 13748 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.107025  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.124542 13746 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.125576 13746 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.132990  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.135998 13743 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.136132  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.136749 13743 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.138432 13746 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.146651  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.148471 13743 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.161981  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.162618  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.163676 13746 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.164000 13751 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.164295 13746 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.164726 13751 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.165503  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.166496 13746 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.168823  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.169386 13745 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.168943 13744 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.169898 13745 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.170090 13744 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.172068 13743 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.172711 13744 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.172600 13743 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.173274 13744 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.173739 13744 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.174754 13743 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.175294 13743 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.175724 13744 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.177155 13622 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.175733 13743 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.180074 13622 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.181905 13622 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.177556 13748 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.182808  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.182688 13748 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.184482 13743 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.184670 13748 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.185374 13745 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.167209 13751 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.205783  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.208181  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.210018  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.212114 13751 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.212239  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.213207  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.213685  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.214792  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.216200  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.217425  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.217757  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.218431 13755 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.218995 13755 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.219399  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.220362  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.221318 13755 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.213631 13751 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.222635  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.224284 13751 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.224846  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.227918  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.230458  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.239302  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.240885  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.242342  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.246523  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.249396  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.250787  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.254536  7718 leader_election.cc:336] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.255064  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.255110  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.257977  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.260425  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.260478  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.261801  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.263043  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.266098  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.268296 13741 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.268388  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.271351  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.273401  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.278334  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.279093  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.280006 13741 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.280751  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.281138  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.281697  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.282589 13741 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.283237  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.282586  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.284937  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.285542  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.286378 13741 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.287524  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.290175  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.290735  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.291054 13740 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:19.293156  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.293203  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.293855  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.294656 13740 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.295143  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.295631  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.296329  7718 leader_election.cc:336] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.296805  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.297542 13740 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:19.299587  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.300938  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.303771  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.304358  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.305166  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.309636  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.310791  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.310462  7718 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.311573  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.312178  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.312480 13740 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:19.313577  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.313727  7718 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.314373  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.315204 13740 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.316270  7718 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.316795  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.317593 13740 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.318740  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.319353  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.322180 13740 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.323948  7718 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.324572  7718 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.325042  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.325788 13740 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.327409  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.327972  7718 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.328423  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.337447 13741 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.339238  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.344573  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.345167  7718 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.345669  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.352655  7718 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.352655 13733 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.355100  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.356936  7718 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.363801  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.364691  8380 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:19.359210 13731 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:19.366309  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.368346  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.368980  8375 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:01:19.369168  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:19.369688  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.370589  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.371014  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.371167  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
I20260501 14:01:19.373543  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.373979  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.374653  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:01:19.376061 13728 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.380331  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.381093  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.384532  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.386930  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.387737 13728 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.394243  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.394901  8373 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:01:19.396173  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.396730  8373 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:01:19.397950  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.404280  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.404948  8373 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:19.406471  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.409291  8373 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:01:19.410772  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:19.411592  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260501 14:01:19.429159  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.438258 13751 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:19.439560  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.445761 13751 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.447314  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.454509  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.460393 13751 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.460824  8344 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.462041  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.462735 13755 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:19.463256  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.463505 13755 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.464289 13755 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.464404  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.465305 13747 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.465337  8344 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.466684 13755 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.467736  8344 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.468559 13755 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.471882  7792 leader_election.cc:336] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.472523  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.472886  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.473767 13753 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:19.483311  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.487138  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:19.488765  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.496294  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.503429 13753 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.503687  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.504248  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.505666 13753 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.508713  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.515376  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.516065  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.516659  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.529850  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
W20260501 14:01:19.532073  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.533177  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.534130  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.537159 13753 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:19.539333  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.556704  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.558684  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.560493  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.564436  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.569304  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.569334  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.573809  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.574642  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.578626  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.578715  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.589730  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.592193  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.593119  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.604169  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.609335  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.634214  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:19.623514  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.654057  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.656306  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.685928  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.686842 13731 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.691171  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.692590  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.694203  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.693723 13733 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:19.697897 13733 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.700420  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.708424 13731 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.708473  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.710636 13742 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.712205  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.713825 13742 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.719239  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.720444  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.714870  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.723345 13742 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.724774 13755 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.726225  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.726801  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.727624 13755 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.728747  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.732820  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.733695 13755 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.734865  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.735414  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:19.736490  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.737926  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.738265  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.739694 13755 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.741034  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.741430  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.741993 13755 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.743152 13755 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.743605  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.744102  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.746055 13755 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.746153  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:01:19.747097  8344 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.747834 13753 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:01:19.748313 13753 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.748672 13753 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:19.747515  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.750761  7718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 349 similar messages]
I20260501 14:01:19.751799 13755 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.752887  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.753410  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.764055 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.765573  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.766672  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.767678  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.768293  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.768800  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.769747 13755 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:19.770915  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.771412  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.772282 13755 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.773409  8344 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.774019  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.774708  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.775220  8344 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.782351  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:19.785283 13759 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.785391  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.786430 13755 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.787299  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.788120 13755 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.789686  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.790436 13755 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:19.795789  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.787297 13753 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.798420 13753 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.799137 13759 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260501 14:01:19.799582 13759 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.801944 13759 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Advancing to term 21
I20260501 14:01:19.803449  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.808789 13755 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:19.810655  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.811511 13755 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:19.812824  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.813601 13755 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.814824  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.824280 13755 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.826301  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.827075 13755 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260501 14:01:19.836920  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.837482  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.838254 13755 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:01:19.839484  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.842453 13759 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.850971 13759 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.848078  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:19.853683  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.855181 13723 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.855332 13753 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260501 14:01:19.855916 13753 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.856321 13753 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:19.862938  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.866062 13723 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:01:19.867071 13723 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.867581 13723 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:19.874351  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.874068 13753 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:19.879967  8402 debug-util.cc:398] Leaking SignalData structure 0x7b080034bb80 after lost signal to thread 6457
W20260501 14:01:19.906962  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9140 after lost signal to thread 7611
I20260501 14:01:19.907332 13753 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:19.910454  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9a20 after lost signal to thread 7778
W20260501 14:01:19.911830  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9060 after lost signal to thread 7852
W20260501 14:01:19.912460  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9040 after lost signal to thread 7853
W20260501 14:01:19.921214  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002a48a0 after lost signal to thread 8405
I20260501 14:01:19.923760  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
W20260501 14:01:19.903167  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.892743 13759 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:19.905130 13723 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.892127  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.925904 13759 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.927100 13759 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:19.927395  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.927706 13723 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.928385 13723 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:19.929425  7827 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:01:19.929811  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.930621 13753 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:01:19.930970 13753 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.931433 13732 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:19.931447 13753 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:19.932526 13731 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:01:19.932865 13731 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:19.933729 13731 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.935333 13731 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:19.931463 13760 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260501 14:01:19.936339 13760 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.936750 13760 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:19.931027  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:19.947172  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:19.941727 13723 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.958907  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:01:19.963311  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.964046  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.965022  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.968111  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:19.977128  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:19.988730 13753 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.007282 13753 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:20.015844 13759 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.031481 13759 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:20.026208 13760 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.039346 13760 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:20.043984  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 49052.1us
W20260501 14:01:20.049196  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.058784  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:20.060369  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:20.072494  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:01:20.074407  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:20.074891  7625 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:20.075192  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.077941  7827 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 20. Current term is 21. Ops: []
I20260501 14:01:20.080698  7827 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 18. Current term is 19. Ops: []
W20260501 14:01:20.082284  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.083298  7824 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
W20260501 14:01:20.083285  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.084347  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.086179  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.097365  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.104312  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.115865  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.117821  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.126611 13739 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260501 14:01:20.122733 13742 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
W20260501 14:01:20.126320  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.128463  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.144440  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.131767 13739 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Stepping down as leader of term 18
I20260501 14:01:20.146032  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.132452 13742 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Stepping down as leader of term 20
I20260501 14:01:20.127445 13732 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260501 14:01:20.150797 13766 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260501 14:01:20.149449  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.152719  7792 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.153098  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:20.154173  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.154743  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.147364 13739 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:01:20.156721  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.157047 13741 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:01:20.157464 13741 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:01:20.157768  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.158203  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.158202 13741 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.159051 13766 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260501 14:01:20.159806 13765 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260501 14:01:20.160769 13741 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:20.161775  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.162180  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.162856 13765 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260501 14:01:20.164769  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.165426  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.165876  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.165879 13739 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.166543  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.167408 13764 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:01:20.167554 13739 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Advancing to term 19
W20260501 14:01:20.168568  7792 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.169032  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.169806 13764 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260501 14:01:20.170921  7792 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.171466  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.172592 13764 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260501 14:01:20.175590  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:20.176353  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.149739 13742 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:01:20.193614  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.201191  7792 consensus_peers.cc:597] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.202560 13742 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:20.209797  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.242481  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.242981  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.243932  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.256038  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.254364 13742 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Advancing to term 21
W20260501 14:01:20.256857  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.261880  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.263338  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.262938  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.263847  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.266398  7824 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 18. Current term is 19. Ops: []
I20260501 14:01:20.270247 13741 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260501 14:01:20.271659  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.272784 13731 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Stepping down as leader of term 18
I20260501 14:01:20.273195 13731 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:20.274027 13731 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.275305 13731 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Advancing to term 19
W20260501 14:01:20.280100  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.286126  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.311425  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.360670  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.368960  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.381014  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.382486  7827 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17. Ops: []
I20260501 14:01:20.384153 13742 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:20.385306 13742 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:01:20.385982 13742 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:20.386890 13742 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.388418  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:20.388512 13742 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:20.389891  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.396862  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.398269  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.401966  6454 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.403195  6454 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.403870  6454 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.414458  6454 tablet_replica.cc:333] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.415539  6454 raft_consensus.cc:2243] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.416608  6454 raft_consensus.cc:2272] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.423053  6454 tablet_replica.cc:333] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.424474  6454 raft_consensus.cc:2243] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.426153  6454 raft_consensus.cc:2272] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.429749  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.430568  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.432546  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.462165  7826 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:01:20.463572 13731 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:01:20.464620 13731 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:01:20.464956 13731 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:20.465773 13731 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.467101 13731 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:20.469687  6454 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.478230  6454 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.482910  6454 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.486094  6454 tablet_replica.cc:333] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.495067  6454 raft_consensus.cc:2243] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.502140  6454 raft_consensus.cc:2272] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.526266  6454 tablet_replica.cc:333] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.527263  6454 raft_consensus.cc:2243] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.538589  6454 raft_consensus.cc:2272] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:20.541043  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.541990  6454 tablet_replica.cc:333] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.565837  6454 raft_consensus.cc:2243] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.572319  6454 raft_consensus.cc:2272] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.577742  6454 tablet_replica.cc:333] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.578717  6454 raft_consensus.cc:2243] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.584496  6454 raft_consensus.cc:2272] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.589679  6454 tablet_replica.cc:333] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.595784  6454 raft_consensus.cc:2243] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.606813  6454 raft_consensus.cc:2272] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.624939  6454 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.628221  6454 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.628872  6454 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.633076  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.633966  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.643587  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.646720  6454 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.656598  6454 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.657918  6454 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.661561  6454 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.662461  6454 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.663148  6454 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.687944  6454 tablet_replica.cc:333] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.689128  6454 raft_consensus.cc:2243] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.689941  6454 raft_consensus.cc:2272] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.692907  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.712451  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:20.724097  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:20.726938  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.734740  6454 tablet_replica.cc:333] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.739635  6454 raft_consensus.cc:2243] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.741940  6454 raft_consensus.cc:2272] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.770365  6454 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.780718  6454 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.782186  6454 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.785872  6454 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.788805  6454 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.789448  6454 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.807593  6454 tablet_replica.cc:333] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.808646  6454 raft_consensus.cc:2243] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.809489  6454 raft_consensus.cc:2272] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.812621  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.813575  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.814814  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.818017  6454 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.818902  6454 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.829563  6454 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.862600  6454 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.863478  6454 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:20.867874  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.878576  6454 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.883790  6454 tablet_replica.cc:333] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.884709  6454 raft_consensus.cc:2243] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.891517  6454 raft_consensus.cc:2272] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.895378  6454 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.896409  6454 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.897089  6454 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.900306  6454 tablet_replica.cc:333] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.901149  6454 raft_consensus.cc:2243] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.901993  6454 raft_consensus.cc:2272] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.909310  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.910673  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.911319  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.918583  6454 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.919516  6454 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.920840  6454 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.924324  6454 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.931053  6454 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.932003  6454 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.935233  6454 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.936173  6454 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.937568  6454 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.941027  6454 tablet_replica.cc:333] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.941972  6454 raft_consensus.cc:2243] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.942755  6454 raft_consensus.cc:2272] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.946106  6454 tablet_replica.cc:333] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.947039  6454 raft_consensus.cc:2243] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.947844  6454 raft_consensus.cc:2272] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.951210  6454 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.952155  6454 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.953365  6454 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:20.956513  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.957906  6454 tablet_replica.cc:333] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.957803 13731 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:20.959081  6454 raft_consensus.cc:2243] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.958820 13731 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:20.960937 13731 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:20.961416  6454 raft_consensus.cc:2272] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.963557  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:20.964778  6454 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.965803  6454 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
W20260501 14:01:20.966221  7718 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:20.966678  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:20.967329  6454 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.970350  6454 tablet_replica.cc:333] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.969725 13731 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:20.971752  6454 raft_consensus.cc:2243] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.974726  6454 raft_consensus.cc:2272] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.977847  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.978716  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.979415  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.982504  6454 tablet_replica.cc:333] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.983332  6454 raft_consensus.cc:2243] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.984185  6454 raft_consensus.cc:2272] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.987390  6454 tablet_replica.cc:333] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.988308  6454 raft_consensus.cc:2243] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.989017  6454 raft_consensus.cc:2272] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.992026  6454 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.992928  6454 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.994454  6454 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.998464  6454 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.999485  6454 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.000109  6454 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.003151  6454 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.004124  6454 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.004812  6454 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.008193  6454 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.009048  6454 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:21.010442  6454 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.013311  6454 tablet_replica.cc:333] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.014454  6454 raft_consensus.cc:2243] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.015251  6454 raft_consensus.cc:2272] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.018312  6454 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.019137  6454 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.019856  6454 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.022945  6454 tablet_replica.cc:333] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.023722  6454 raft_consensus.cc:2243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.024477  6454 raft_consensus.cc:2272] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.027613  6454 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.028463  6454 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:21.031550  6454 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:21.049823  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:21.219772  7792 connection.cc:744] client connection to 127.6.77.130:41997 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260501 14:01:21.263849  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.270574  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.274364  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.293902  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.344309 13755 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.344937 13755 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.347105 13755 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.348569  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.349558  7824 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.353820  8344 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.354279  8344 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.355049 13755 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:21.376077 13755 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:21.435009 13755 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.435640 13755 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.437867 13755 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.440303  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.441152  7826 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.443540  8344 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.444065  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.444945 13755 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:21.463101 13768 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.463757 13768 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.466915 13755 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:21.474694 13768 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.476176  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.477025  7826 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 19: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.479122  8344 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.479617  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.481026 13768 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:21.489801 13768 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:21.514717 13768 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.517365 13768 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:21.523747  8344 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.525837  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.526722  7824 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 21: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:21.527985  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.528942 13755 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Advancing to term 21
I20260501 14:01:21.546108 13755 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:21.557548 13768 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:21.576881  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.582867 13762 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.583475 13762 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:21.585904 13762 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:21.594280  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.598650  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.599224  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.601025 13771 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:21.626412 13770 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.627076 13770 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.629334 13770 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.629832 13770 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.630322 13770 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.634203  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.635057  7820 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 19: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:21.641495 13770 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:21.671397  8344 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.672047  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.672935 13770 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:21.682685  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.683585  7820 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 17: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:21.686889 13770 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260501 14:01:21.705647  8344 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.707584  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.710948 13766 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.711596 13766 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.714226 13766 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:21.715201 13768 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:21.718591 13755 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.719435 13755 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.722085 13755 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.723969 13768 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:21.730041  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.730933  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.731367  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.735028  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:21.735846  8377 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:21.736159  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.736759  7827 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:01:21.741680 13762 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.752025  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:21.753034  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:21.753458  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.754232 13768 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.784502  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.791507 13768 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.792151 13768 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.794216 13768 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.799952  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.804283  7820 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.804297  8344 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.802296 13771 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.805788  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.805740 13771 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:21.808518 13771 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:21.809211 13768 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:21.818004 13768 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.823534  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:21.824975  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:21.825475  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.826272 13771 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:21.846153  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.881592 13768 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.882256 13768 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.885222 13768 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:21.890245  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.891089  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.891553  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.892930 13768 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:21.908104 13768 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.909214 13771 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.908675 13768 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.909812 13771 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.911433 13768 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.912403 13771 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:21.915556  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:21.917388  8344 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.918220  8344 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.918905 13768 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:21.936203  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:21.940414 13771 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.940991 13771 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:21.942883 13771 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:21.949501 13766 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.950124 13766 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:21.952373  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:21.952872 13766 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:21.952888  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.963521 13766 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:21.964811  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:21.974921  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.980705  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.981264  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.986371 13766 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.990165  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.990634  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.990971  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.993868  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.994869 13766 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:21.997429 13766 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:21.997898 13766 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.000901 13771 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.001498 13771 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.003531 13771 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.004529 13766 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.009473 13755 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.010026 13755 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.018846 13755 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:22.019392  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.020329  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.020771  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.022199 13755 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:22.023706  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.024400  8376 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:01:22.024896  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:22.025316  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.025528  7827 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
I20260501 14:01:22.025899  8377 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:01:22.044108 13766 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.044847 13766 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:22.047390 13766 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.050801  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.051767 13766 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:22.051959  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.052307 13766 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.052822 13766 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:22.057907 13771 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:22.059381 13771 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.059769 13771 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:22.068706 13771 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.077670 13766 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.078104  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.084313 13762 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.084781 13771 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.084934 13762 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:22.086959 13762 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.087942  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.090211 13766 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.105017 13755 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.105764 13755 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.108098  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.108814  8376 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:22.110999  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.111642  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:22.111864  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.112483  8377 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:22.108193 13755 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.119916  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.120648  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.121062  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.121834 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:22.122882  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.127712  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.129891 13766 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:22.133770  8377 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:01:22.138420  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.143276 13766 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:01:22.144058 13766 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.144903  8376 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:01:22.145097 13766 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.147734 13762 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.150099 13762 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.152143 13762 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:22.159149  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.165692  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:22.171670  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.174281  8376 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
W20260501 14:01:22.181123  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.184437  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.184800  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:22.185858  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.186357 13766 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:22.188385  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:22.189184 13766 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:01:22.189924 13766 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.190889 13766 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.193832  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.195799 13771 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:22.196187 13771 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.196501 13771 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:22.193630  7576 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 16 to 18, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 18 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:22.204844 13771 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.208568 13771 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:22.206529  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.213829 13755 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.214339 13755 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.216848 13755 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.226212  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.227893  6454 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7775)
W20260501 14:01:22.231719  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.232414  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.233472 13768 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:22.241007  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:01:22.241616  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.242185  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.241657  8376 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:22.242632  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.256117 13771 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.256711 13771 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.258912 13771 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.263393  8376 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
W20260501 14:01:22.267275  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.275038  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.275731  8377 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
I20260501 14:01:22.276655 13768 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.277230 13768 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.278810  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:22.279330 13768 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.289435  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.290865  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.291280  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:22.292562  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.293040  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.293380  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.294785 13768 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:22.301468 13771 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.302073 13771 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.304231 13771 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:22.309551  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.316491  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:22.319759 13766 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:01:22.320349 13766 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.321323 13766 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.326722 13768 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.327337 13768 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.329576 13768 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.331686 13771 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.332296 13771 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:22.335206 13771 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.336007 13771 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.336562 13771 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.338696 13771 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.342315  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.344430 13762 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260501 14:01:22.344884 13762 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.345319 13762 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Advancing to term 21
W20260501 14:01:22.345376  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.346905  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.347321  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.348105 13768 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:22.374058 13768 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.374679 13768 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.376979 13768 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.382916  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.383880  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.384426  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.385951 13768 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:22.390523  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46863.4us
I20260501 14:01:22.391583 13784 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:22.392843  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.392607 13784 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.415741 13784 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.412439 13786 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.416702 13786 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.419118 13786 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.373950 13762 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.426491  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.427193  8376 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:01:22.423650 13762 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.438385  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.439091  8376 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 21.
I20260501 14:01:22.437695  7576 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:22.449884  7576 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:22.468137 13768 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.468868 13768 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.471109 13768 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.487205  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.488006  8373 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 19.
W20260501 14:01:22.488168  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.488440  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.489120  8379 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 19.
I20260501 14:01:22.490916  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.491516  8376 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Advancing to term 21
I20260501 14:01:22.501667  8376 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 21.
W20260501 14:01:22.493422  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:22.507936  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.508785  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.509164  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.509825 13768 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:22.510281  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.563151  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48413.1us
I20260501 14:01:22.559477  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.593320 13762 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:01:22.593894  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.594309 13762 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.599107 13762 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:01:22.600453 13786 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260501 14:01:22.600919 13786 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.601236 13786 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Advancing to term 22
W20260501 14:01:22.603448  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.620939  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.621878  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.629305 13784 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:01:22.629746 13784 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.630097 13784 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.633543 13762 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.638491 13762 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.640404  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.641741  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.643007 13766 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:01:22.643409 13766 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.643718 13766 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.644618 13762 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader election won for term 21
I20260501 14:01:22.646633 13762 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.648200 13762 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.661662  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.662330  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.665143 13784 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.667687 13784 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.673615 13786 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.672832 13766 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.675694  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.686666  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.690009  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.692517  7792 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.685842 13766 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.685858 13786 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.700985  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 20 to 21, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 21 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:22.696259  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.706808  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:22.708498  7792 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.712153  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.712838  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.717206  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.717976  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.728111  7792 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.729290  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.709043 13786 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:22.764823  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.766148  8379 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:01:22.774111  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.774971  8376 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.780925  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.781813  8373 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.788486  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.789402  8377 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Advancing to term 22
W20260501 14:01:22.793329  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.815974  8379 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
W20260501 14:01:22.822716  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.823668  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.830276  8377 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 22.
I20260501 14:01:22.824110  8373 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
W20260501 14:01:22.851347  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.852980  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.857450  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
I20260501 14:01:22.857741  8373 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260501 14:01:22.928752  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:01:22.922932  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.935783 13762 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:01:22.936517 13762 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.937789 13762 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.956045  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.962574 13766 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 FOLLOWER]: Leader election won for term 22
I20260501 14:01:22.963611 13766 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.965293 13766 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.972359  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.996714  7576 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 16, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 16 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:23.016049 13762 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:01:23.017073 13762 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:23.018378 13762 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:23.026095  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.030959  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 58720.4us
I20260501 14:01:23.033020  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:23.034040 13784 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:01:23.035207 13784 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:23.036618 13784 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:23.044132 13789 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260501 14:01:23.067127  7576 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 20 to 22, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 22 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:23.069307 13786 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260501 14:01:23.078253  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.099290  8376 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260501 14:01:23.111720  8373 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260501 14:01:23.120097  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.120980  7792 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.132807  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 18 to 20, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 20 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:23.135075  7576 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 18 to 20, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 20 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:23.138861  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.143329 13762 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:01:23.153707  7792 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.153561 13762 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:23.154536  7792 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:23.156477  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.157039  7792 consensus_peers.cc:597] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.157553  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:23.155690 13762 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.158394  7792 consensus_peers.cc:597] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.166759  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.167995  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.168552  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.172710  8376 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260501 14:01:23.178691  7792 consensus_peers.cc:597] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.179498  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.180316  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.181814  7792 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.185032  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.185765  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.204530 13793 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260501 14:01:23.207743 13794 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:01:23.217681 13766 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260501 14:01:23.228688  6454 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7775)
W20260501 14:01:23.256104  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.260340  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.261353  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:23.265769  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.270129  7792 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.270772  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.272589  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.281781 13766 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:23.380102 13768 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.380844 13768 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:23.393412  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.399956 13768 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:23.410856  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:23.413386  7824 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
W20260501 14:01:23.432768  7792 consensus_peers.cc:597] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.460018  7792 consensus_peers.cc:597] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.477264  7792 consensus_peers.cc:597] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:23.481528  8379 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:01:23.491321  8376 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260501 14:01:23.498338  8376 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260501 14:01:23.515911  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.525666 13766 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:01:23.534185 13762 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260501 14:01:23.541360 13762 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260501 14:01:23.558307  7792 consensus_peers.cc:597] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.589115  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.592522  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.606076 13768 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:23.617504 13755 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.618327 13755 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:23.620837 13755 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:23.662750  8377 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260501 14:01:23.676333  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.680796 13762 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260501 14:01:23.685900  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:23.712584 13762 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.713503 13762 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.715900 13762 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.719973  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.725597 13766 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.726294 13766 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.728595 13766 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.729730  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.730451  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.734982 13755 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:23.747107  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:23.770812  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:23.779888  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.780529  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.782176 13794 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:23.815153 13793 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.815946 13793 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:23.818825  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:23.819654 13793 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.820886  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.834014 13768 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.835109 13768 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:23.840971 13768 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.851853  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.853629 13786 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.855890 13786 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.858451 13786 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.859496  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.872105  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:23.860350  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.873451  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.874500 13786 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:23.876412 13768 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:23.893337 13755 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.894302 13786 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.894099 13755 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:23.894902 13786 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.897068 13786 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:23.900290 13755 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:23.911444  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:23.911892  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:23.926545  7826 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
W20260501 14:01:23.933591  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:23.937065  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:23.942040  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.945302  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.946300 13755 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:23.968294  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.975996  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.980679 13794 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:23.989272  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:23.998072  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.998674  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.999536 13794 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:24.001555  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.007992 13755 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.008623 13755 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.010484 13755 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.026171  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:24.030066  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:24.030642  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.033267 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:24.032415  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:24.036001  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.037155 13794 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:24.070281  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:24.081576 13755 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.082285 13755 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.084273 13755 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.108788  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:24.111588 13755 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.112391 13755 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.114382 13755 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.115298  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.116310  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.119365 13755 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:24.144140  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.148175  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.149976  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.153190 13755 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:24.229339  6454 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7775)
I20260501 14:01:24.234146 13755 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.234972 13755 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.236951 13755 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.244814  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.245839  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.246323  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.247198 13755 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:24.288249  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:24.321014 13755 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.321700 13755 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.323789 13755 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.333642  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.334484  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.334885  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.335737 13755 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:24.364509  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.409075  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.420578  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.482617  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:24.484324  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
W20260501 14:01:24.611621  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.631642  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.661157  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:24.710976  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.726651  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.758527  7792 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111) [suppressed 686 similar messages]
W20260501 14:01:24.777344  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.779834  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.800357  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.822427  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.829844  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.833143  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.863847  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.870656  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.881593  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.899595  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.900919  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.942668  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:24.943084 13762 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.951838 13762 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:24.954795 13762 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.966593  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.978243  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.990689  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:24.996258  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:25.004026  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:25.006253 13793 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:25.008517 13793 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:25.007030 13762 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:25.013703 13793 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:25.028796  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:25.029793  8372 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
W20260501 14:01:25.034590  7792 consensus_peers.cc:597] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:25.044147  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
W20260501 14:01:25.044090  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:25.047515  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:25.048061  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:25.049064 13815 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:25.060338  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:25.060985  7625 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:25.064282  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:25.064138  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:25.080775  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.085597  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.164435  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.169914  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.193449  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.195895  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:25.201472  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:25.202996  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.205737  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.208031  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.212805  6454 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.214147  6454 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.215615  6454 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.218932  6454 tablet_replica.cc:333] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
W20260501 14:01:25.224656  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.226679  6454 raft_consensus.cc:2243] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.228096  6454 raft_consensus.cc:2272] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.233178  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.236189  6454 tablet_replica.cc:333] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.237293  6454 raft_consensus.cc:2243] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.238207  6454 raft_consensus.cc:2272] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.241616  6454 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.242532  6454 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.243252  6454 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.290606  6454 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.293587  6454 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.295076  6454 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.298322  6454 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.299285  6454 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.300674  6454 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.307273  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.315685  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.316571  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.327157  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.366117  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.369130  7792 consensus_peers.cc:597] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:25.369705  6454 tablet_replica.cc:333] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.374402  6454 raft_consensus.cc:2243] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.381165  6454 raft_consensus.cc:2272] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.380121  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:25.393528  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.395545  6454 tablet_replica.cc:333] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.398901  6454 raft_consensus.cc:2243] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.400445  6454 raft_consensus.cc:2272] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.402742  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:25.404737  6454 tablet_replica.cc:333] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.406838  6454 raft_consensus.cc:2243] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.407727  6454 raft_consensus.cc:2272] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.409561  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:25.410401  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.414222  7792 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:25.414968  6454 tablet_replica.cc:333] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.416034  6454 raft_consensus.cc:2243] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.417114  6454 raft_consensus.cc:2272] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.420554  6454 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.421556  6454 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.422825  6454 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.425964  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.426824  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.427994  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.431217  6454 tablet_replica.cc:333] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.432225  6454 raft_consensus.cc:2243] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.432791  6454 raft_consensus.cc:2272] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.436111  6454 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.436753  6454 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.437989  6454 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.440762  6454 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.441656  6454 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.443001  6454 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.444691  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:25.445930  6454 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.446592  6454 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.447715  6454 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.450361  6454 tablet_replica.cc:333] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.451310  6454 raft_consensus.cc:2243] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.452912  6454 raft_consensus.cc:2272] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.455475  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.456068  6454 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.456780  6454 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.457799  6454 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.463394  6454 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.464144  6454 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.465291  6454 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.468196  6454 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.469135  6454 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.470501  6454 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.478001  6454 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.478858  6454 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.480271  6454 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.495584  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.496615  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.498526  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.501880  6454 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.502784  6454 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.505118  6454 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.505898  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.508925  6454 tablet_replica.cc:333] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.510022  6454 raft_consensus.cc:2243] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.510768  6454 raft_consensus.cc:2272] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.513578  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.514232  6454 tablet_replica.cc:333] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.515213  6454 raft_consensus.cc:2243] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.516697  6454 raft_consensus.cc:2272] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.519917  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.520717  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.522920  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.525956  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:25.526713  6454 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
W20260501 14:01:25.527288  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:25.527913  6454 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.529078  6454 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.532114  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.532889  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.534693  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.537426  6454 tablet_replica.cc:333] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.538393  6454 raft_consensus.cc:2243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.539745  6454 raft_consensus.cc:2272] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.543025  6454 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.543960  6454 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.545991  6454 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.548707  6454 tablet_replica.cc:333] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.549480  6454 raft_consensus.cc:2243] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.550310  6454 raft_consensus.cc:2272] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.553377  6454 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.554250  6454 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.555085  6454 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.556058  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:25.557942  6454 tablet_replica.cc:333] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.558609  6454 raft_consensus.cc:2243] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.559541  6454 raft_consensus.cc:2272] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.562045  6454 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.562638  6454 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.563244  6454 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.565742  6454 tablet_replica.cc:333] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.566385  6454 raft_consensus.cc:2243] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.567515  6454 raft_consensus.cc:2272] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.569764  6454 tablet_replica.cc:333] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.570438  6454 raft_consensus.cc:2243] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
W20260501 14:01:25.570966  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:25.571481  6454 raft_consensus.cc:2272] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.573810  6454 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.574440  6454 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.575982  6454 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.578102  6454 tablet_replica.cc:333] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.578642  6454 raft_consensus.cc:2243] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.579615  6454 raft_consensus.cc:2272] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.583966  6454 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.584721  6454 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.586089  6454 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.589823  6454 tablet_replica.cc:333] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.590719  6454 raft_consensus.cc:2243] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.591899  6454 raft_consensus.cc:2272] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.594270  6454 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.594851  6454 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.595444  6454 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.597702  6454 tablet_replica.cc:333] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.598244  6454 raft_consensus.cc:2243] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.599454  6454 raft_consensus.cc:2272] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.601809  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.602427  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.603792  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.606256  6454 tablet_replica.cc:333] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.606756  6454 raft_consensus.cc:2243] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.607746  6454 raft_consensus.cc:2272] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.609987  6454 tablet_replica.cc:333] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.610488  6454 raft_consensus.cc:2243] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.611405  6454 raft_consensus.cc:2272] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.613633  6454 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.614094  6454 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.615015  6454 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.786702 13817 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:25.787549 13817 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:25.795504  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:25.801568  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:25.802222  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:25.803310 13818 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:25.804234 13817 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.030369  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260501 14:01:26.101425 13755 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.102018 13755 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.104151 13755 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.110929  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.111577  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.112046  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.112893 13755 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:26.117931  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:26.153702  7625 auto_rebalancer.cc:285] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.162957  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:26.163378  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.163630  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.170764  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:26.171151  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.171396  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.181124  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:26.181538  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.181833  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.190228  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:26.190604  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.190861  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.236251  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260501 14:01:26.312945 13755 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.313675 13755 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.316066 13755 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.321791  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.322335  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.322659  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.323254 13755 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:26.344576 13818 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.345134 13818 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.347069 13818 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.352931  8344 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.353451  8344 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.353742  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.354370 13818 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:26.371050 13818 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.371780 13818 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.373803 13818 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.379281  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.379803  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.380221  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.380846 13818 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:26.390918 13818 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.391464 13818 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.393420 13818 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.397867  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.398579  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.398911  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.399526 13818 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:26.482400  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 14:01:26.484311 13818 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.485025 13818 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.486964 13818 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.492296  8344 leader_election.cc:336] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.493005  8344 leader_election.cc:336] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.493417  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.494362 13818 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:26.503044  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260501 14:01:26.507910 13755 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.508540 13755 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.510304 13818 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.510365 13755 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.511374 13818 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:26.517153  8344 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.517788 13818 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.517918  8344 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.518508  8344 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.519227 13818 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260501 14:01:26.524750  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.525662  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.526015  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.526953 13818 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:26.528702 13818 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.529165 13818 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.531080 13818 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.536712  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.537268  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.537599  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.538290 13818 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:26.552284 13818 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.552894 13818 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.555466 13818 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.562788  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.563648  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.564118  8344 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.564970 13755 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:26.565961  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.614500 13818 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.615144 13818 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.617702 13818 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.621284 13818 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.621861 13818 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.625010 13818 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.628890  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.629830  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.630332  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.631048 13818 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:26.631491  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.634334  8344 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.635170  8344 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.635533  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.636219 13818 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:26.646762  6454 tablet_server.cc:179] TabletServer@127.6.77.132:0 shutting down...
I20260501 14:01:26.656548 13818 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.657359 13818 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.659919 13818 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.669595 13755 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:01:26.669656  8344 leader_election.cc:336] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.670418 13755 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:26.670893  8344 leader_election.cc:336] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.671494  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.673103 13755 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:26.673739 13755 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:26.680249  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.681486  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.681939  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.682813 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:26.707015  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:26.708074  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.708868  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.709519  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.712421 13755 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.712543  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.712977 13755 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.713693  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.714545  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.715225 13755 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.717999  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.719153  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.720331  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.721030  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.721818  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:26.722211  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.722966 13755 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:26.723670 13818 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.724231 13818 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.725961 13818 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.726799  6454 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.727944  6454 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.729555  6454 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.733485  6454 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.734565  6454 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.735441  6454 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.738942  6454 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.739611  6454 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:26.739889  8344 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.740345  6454 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.740885  8344 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.741288  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.742039 13818 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:26.745894  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.747200  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.748217  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.752120  6454 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.752972 13755 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.753125  6454 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.753544 13755 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.753907  6454 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.755643 13755 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.757828  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.759052  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.760264  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.760898  8344 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.761720  8344 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.762087  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.762765 13755 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:26.764163  6454 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.765337  6454 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.766098  6454 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.769623  6454 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.770546  6454 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.771693  6454 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.774995 13755 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.775194  6454 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.775489 13755 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.776261  6454 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.776345 13818 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.777232  6454 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.776997 13818 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.777608 13755 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.779050 13818 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.780537  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.781654  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.782577  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.784519 13818 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.785113 13818 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.786906  6454 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.787307 13818 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:26.787990  6454 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.788815  6454 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.789206  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.791546  8344 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.792351  6454 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
W20260501 14:01:26.792356  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.793094  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.793551  6454 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.793781 13818 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:26.793972  8344 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.794322  6454 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.794505  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.795256 13818 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260501 14:01:26.797928  6454 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.798969  6454 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
W20260501 14:01:26.799911  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.800527  6454 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.800662  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:26.801141  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.801802 13818 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:26.804219  6454 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.805233  6454 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.805886  6454 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.809083  6454 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.809957  6454 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.810712  6454 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.813370 13818 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.813906 13818 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.814293  6454 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.815384  6454 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.815975 13818 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.816819  6454 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.820035  6454 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
W20260501 14:01:26.820873  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:26.820962  6454 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.822161  6454 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.823262  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.823702  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:26.824308  8344 raft_consensus.cc:2686] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260501 14:01:26.825707  6454 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.826802  6454 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.828109  6454 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.831274  6454 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.832267  6454 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.833052  6454 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.836248  6454 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.837198  6454 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.838428  6454 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.841743  6454 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.842700  6454 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.843747  6454 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.847407  6454 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.848337  6454 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.849305  6454 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.852600  6454 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.853448  6454 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.854059  6454 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.857132  6454 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.857967  6454 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.858680  6454 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.861969  6454 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.862843  6454 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.863588  6454 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.866909  6454 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.867766  6454 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.868588  6454 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.871798  6454 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.872740  6454 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.874151  6454 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.877615  6454 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.878486  6454 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.879248  6454 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.882284  6454 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.883147  6454 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.883845  6454 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.886947  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.887861  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.888744  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.892150  6454 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.892995  6454 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.894378  6454 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.897733  6454 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.898572  6454 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.899322  6454 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.902549  6454 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.903355  6454 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.904593  6454 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.907900  6454 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.908672  6454 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.909350  6454 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.912521  6454 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.913262  6454 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.914394  6454 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.917744  6454 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.918465  6454 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.919113  6454 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:27.285727  7625 auto_rebalancer.cc:285] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:27.295080  6454 tablet_server.cc:196] TabletServer@127.6.77.132:0 shutdown complete.
W20260501 14:01:27.299340  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:27.299762  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.300107  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.307047  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:27.307420  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:27.307677  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:27.315625  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:27.315984  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.316234  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.323927  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:27.324326  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:27.324570  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:27.404191  6454 master.cc:562] Master@127.6.77.190:38503 shutting down...
W20260501 14:01:29.672726  7608 debug-util.cc:398] Leaking SignalData structure 0x7b080000b460 after lost signal to thread 6457
W20260501 14:01:29.673316  7608 debug-util.cc:398] Leaking SignalData structure 0x7b08001575a0 after lost signal to thread 7611
W20260501 14:01:38.693519  7562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 215 similar messages]
W20260501 14:01:38.697372  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:41.320930  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:44.468705  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:01:44.471975  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:44.472487  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: stopping tablet replica
I20260501 14:01:44.690171  6454 master.cc:584] Master@127.6.77.190:38503 shutdown complete.
I20260501 14:01:44.746039  6454 test_util.cc:182] -----------------------------------------------
I20260501 14:01:44.746333  6454 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0

[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260501 13:57:15.247262  6454 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.77.190:33267
I20260501 13:57:15.249282  6454 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260501 13:57:15.250555  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:15.272475  6461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:15.272478  6460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:15.276358  6454 server_base.cc:1061] running on GCE node
W20260501 13:57:15.274423  6463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:16.487192  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:16.487488  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:16.487785  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643836487753 us; error 0 us; skew 500 ppm
I20260501 13:57:16.488894  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:16.495237  6454 webserver.cc:492] Webserver started at http://127.6.77.190:43641/ using document root <none> and password file <none>
I20260501 13:57:16.496328  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:16.496574  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:16.497123  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:16.504742  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/master-0-root/instance:
uuid: "f101699255454153b2a4d08c030e6074"
format_stamp: "Formatted at 2026-05-01 13:57:16 on dist-test-slave-1sft"
I20260501 13:57:16.513947  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:57:16.520116  6469 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:16.521644  6454 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260501 13:57:16.522097  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/master-0-root
uuid: "f101699255454153b2a4d08c030e6074"
format_stamp: "Formatted at 2026-05-01 13:57:16 on dist-test-slave-1sft"
I20260501 13:57:16.522478  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:16.585186  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:16.587013  6454 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260501 13:57:16.587539  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:16.689317  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.190:33267
I20260501 13:57:16.689379  6520 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.190:33267 every 8 connection(s)
I20260501 13:57:16.699033  6521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:16.722945  6521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074: Bootstrap starting.
I20260501 13:57:16.729506  6521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:16.731432  6521 log.cc:826] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074: Log is configured to *not* fsync() on all Append() calls
I20260501 13:57:16.736981  6521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074: No bootstrap required, opened a new log
I20260501 13:57:16.759161  6521 raft_consensus.cc:359] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f101699255454153b2a4d08c030e6074" member_type: VOTER }
I20260501 13:57:16.759727  6521 raft_consensus.cc:385] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:16.760130  6521 raft_consensus.cc:740] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f101699255454153b2a4d08c030e6074, State: Initialized, Role: FOLLOWER
I20260501 13:57:16.761003  6521 consensus_queue.cc:260] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f101699255454153b2a4d08c030e6074" member_type: VOTER }
I20260501 13:57:16.761623  6521 raft_consensus.cc:399] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260501 13:57:16.761947  6521 raft_consensus.cc:493] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260501 13:57:16.762316  6521 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:16.766851  6521 raft_consensus.cc:515] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f101699255454153b2a4d08c030e6074" member_type: VOTER }
I20260501 13:57:16.767607  6521 leader_election.cc:304] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f101699255454153b2a4d08c030e6074; no voters: 
I20260501 13:57:16.769457  6521 leader_election.cc:290] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260501 13:57:16.770802  6524 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:16.774555  6524 raft_consensus.cc:697] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 1 LEADER]: Becoming Leader. State: Replica: f101699255454153b2a4d08c030e6074, State: Running, Role: LEADER
I20260501 13:57:16.775588  6524 consensus_queue.cc:237] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f101699255454153b2a4d08c030e6074" member_type: VOTER }
I20260501 13:57:16.776744  6521 sys_catalog.cc:565] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [sys.catalog]: configured and running, proceeding with master startup.
I20260501 13:57:16.793020  6526 sys_catalog.cc:455] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f101699255454153b2a4d08c030e6074. Latest consensus state: current_term: 1 leader_uuid: "f101699255454153b2a4d08c030e6074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f101699255454153b2a4d08c030e6074" member_type: VOTER } }
I20260501 13:57:16.792907  6525 sys_catalog.cc:455] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f101699255454153b2a4d08c030e6074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f101699255454153b2a4d08c030e6074" member_type: VOTER } }
I20260501 13:57:16.793690  6526 sys_catalog.cc:458] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [sys.catalog]: This master's current role is: LEADER
I20260501 13:57:16.793860  6525 sys_catalog.cc:458] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [sys.catalog]: This master's current role is: LEADER
I20260501 13:57:16.797713  6533 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260501 13:57:16.814116  6533 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260501 13:57:16.816987  6454 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260501 13:57:16.835397  6533 catalog_manager.cc:1357] Generated new cluster ID: 12cdd74a071a48a0a199f8540beb8631
I20260501 13:57:16.835743  6533 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260501 13:57:16.864173  6533 catalog_manager.cc:1380] Generated new certificate authority record
I20260501 13:57:16.866382  6533 catalog_manager.cc:1514] Loading token signing keys...
I20260501 13:57:16.885514  6533 catalog_manager.cc:6044] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074: Generated new TSK 0
I20260501 13:57:16.886756  6533 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260501 13:57:16.949000  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:16.961105  6543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:16.962940  6544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:16.967350  6454 server_base.cc:1061] running on GCE node
W20260501 13:57:16.967919  6546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:16.968968  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:16.969233  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:16.969424  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643836969396 us; error 0 us; skew 500 ppm
I20260501 13:57:16.970048  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:16.975606  6454 webserver.cc:492] Webserver started at http://127.6.77.129:37681/ using document root <none> and password file <none>
I20260501 13:57:16.976253  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:16.976495  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:16.976805  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:16.978161  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-0-root/instance:
uuid: "8ca6b65cd176431bac9e086a1c5b254e"
format_stamp: "Formatted at 2026-05-01 13:57:16 on dist-test-slave-1sft"
I20260501 13:57:16.984704  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260501 13:57:16.990375  6551 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:16.991355  6454 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
I20260501 13:57:16.991736  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "8ca6b65cd176431bac9e086a1c5b254e"
format_stamp: "Formatted at 2026-05-01 13:57:16 on dist-test-slave-1sft"
I20260501 13:57:16.992194  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:17.027134  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:17.028801  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:17.031078  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:57:17.036686  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:57:17.036979  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.037261  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:57:17.037456  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.168799  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:37899
I20260501 13:57:17.168928  6613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:37899 every 8 connection(s)
I20260501 13:57:17.178439  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:17.190981  6618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:17.192840  6619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:17.201076  6621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:17.203016  6454 server_base.cc:1061] running on GCE node
I20260501 13:57:17.204237  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:17.204530  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:17.204751  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643837204728 us; error 0 us; skew 500 ppm
I20260501 13:57:17.205614  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:17.210418  6614 heartbeater.cc:344] Connected to a master server at 127.6.77.190:33267
I20260501 13:57:17.210958  6614 heartbeater.cc:461] Registering TS with master...
I20260501 13:57:17.213088  6614 heartbeater.cc:507] Master 127.6.77.190:33267 requested a full tablet report, sending...
I20260501 13:57:17.215684  6454 webserver.cc:492] Webserver started at http://127.6.77.130:41251/ using document root <none> and password file <none>
I20260501 13:57:17.216508  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:17.216790  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:17.217200  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:17.217211  6486 ts_manager.cc:194] Registered new tserver with Master: 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899)
I20260501 13:57:17.218931  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-1-root/instance:
uuid: "06b335c44fe04b09af02ed7f13773ac6"
format_stamp: "Formatted at 2026-05-01 13:57:17 on dist-test-slave-1sft"
I20260501 13:57:17.220587  6486 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40608
I20260501 13:57:17.227360  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
I20260501 13:57:17.232411  6626 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.233345  6454 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260501 13:57:17.233687  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-1-root
uuid: "06b335c44fe04b09af02ed7f13773ac6"
format_stamp: "Formatted at 2026-05-01 13:57:17 on dist-test-slave-1sft"
I20260501 13:57:17.234051  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:17.274864  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:17.276748  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:17.280236  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:57:17.284227  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:57:17.284518  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.284780  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:57:17.284981  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.394181  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.130:32827
I20260501 13:57:17.394333  6688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.130:32827 every 8 connection(s)
I20260501 13:57:17.403905  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:17.416179  6692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:17.417761  6689 heartbeater.cc:344] Connected to a master server at 127.6.77.190:33267
I20260501 13:57:17.418478  6689 heartbeater.cc:461] Registering TS with master...
I20260501 13:57:17.419636  6689 heartbeater.cc:507] Master 127.6.77.190:33267 requested a full tablet report, sending...
I20260501 13:57:17.423547  6486 ts_manager.cc:194] Registered new tserver with Master: 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:17.425879  6486 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40624
W20260501 13:57:17.431543  6695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:17.431845  6693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:17.434468  6454 server_base.cc:1061] running on GCE node
I20260501 13:57:17.435629  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:17.435947  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:17.436180  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643837436161 us; error 0 us; skew 500 ppm
I20260501 13:57:17.436973  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:17.440475  6454 webserver.cc:492] Webserver started at http://127.6.77.131:46797/ using document root <none> and password file <none>
I20260501 13:57:17.441169  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:17.441428  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:17.441757  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:17.443375  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-2-root/instance:
uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
format_stamp: "Formatted at 2026-05-01 13:57:17 on dist-test-slave-1sft"
I20260501 13:57:17.450126  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260501 13:57:17.454978  6700 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.455968  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260501 13:57:17.456339  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-2-root
uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
format_stamp: "Formatted at 2026-05-01 13:57:17 on dist-test-slave-1sft"
I20260501 13:57:17.456725  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777643835062054-6454-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:17.479691  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:17.481603  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:17.485333  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:57:17.488705  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:57:17.488991  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.489323  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:57:17.489547  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:17.612859  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.131:43153
I20260501 13:57:17.612910  6762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.131:43153 every 8 connection(s)
I20260501 13:57:17.635744  6763 heartbeater.cc:344] Connected to a master server at 127.6.77.190:33267
I20260501 13:57:17.636276  6763 heartbeater.cc:461] Registering TS with master...
I20260501 13:57:17.637253  6763 heartbeater.cc:507] Master 127.6.77.190:33267 requested a full tablet report, sending...
I20260501 13:57:17.639207  6486 ts_manager.cc:194] Registered new tserver with Master: 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:17.640240  6454 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020669138s
I20260501 13:57:17.640740  6486 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40636
I20260501 13:57:17.703480  6486 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40646:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 13:57:17.707602  6486 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260501 13:57:17.800647  6534 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:57:17.834654  6579 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbde4b2586f48d28c5c7c77c0438b7f (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 13:57:17.836692  6579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbde4b2586f48d28c5c7c77c0438b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.841835  6578 tablet_service.cc:1511] Processing CreateTablet for tablet 30f8628df7d347fb8081def3dd250cb5 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 13:57:17.845130  6578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f8628df7d347fb8081def3dd250cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.848984  6577 tablet_service.cc:1511] Processing CreateTablet for tablet d94c0d6fd0fe4a179c22128bb6725dab (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 13:57:17.849824  6576 tablet_service.cc:1511] Processing CreateTablet for tablet 31e20f83fd5644349ce6bfd9a4f41444 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 13:57:17.856691  6577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94c0d6fd0fe4a179c22128bb6725dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.857612  6574 tablet_service.cc:1511] Processing CreateTablet for tablet 45a80771d3ff471fb685264b5b11ba6d (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 13:57:17.861389  6572 tablet_service.cc:1511] Processing CreateTablet for tablet 97b935708d7e4a35b39767fa13cf0c75 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 13:57:17.863520  6576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e20f83fd5644349ce6bfd9a4f41444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.861461  6575 tablet_service.cc:1511] Processing CreateTablet for tablet f948de6567404c3ea3624362fb5c3ab2 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 13:57:17.860232  6573 tablet_service.cc:1511] Processing CreateTablet for tablet 443f08c684b940b49efea7861f24de8e (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 13:57:17.871376  6653 tablet_service.cc:1511] Processing CreateTablet for tablet 30f8628df7d347fb8081def3dd250cb5 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 13:57:17.874023  6575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f948de6567404c3ea3624362fb5c3ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.876314  6653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f8628df7d347fb8081def3dd250cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.877697  6651 tablet_service.cc:1511] Processing CreateTablet for tablet 31e20f83fd5644349ce6bfd9a4f41444 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 13:57:17.874420  6654 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbde4b2586f48d28c5c7c77c0438b7f (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 13:57:17.882874  6652 tablet_service.cc:1511] Processing CreateTablet for tablet d94c0d6fd0fe4a179c22128bb6725dab (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 13:57:17.886063  6654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbde4b2586f48d28c5c7c77c0438b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.889766  6650 tablet_service.cc:1511] Processing CreateTablet for tablet f948de6567404c3ea3624362fb5c3ab2 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 13:57:17.887859  6574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a80771d3ff471fb685264b5b11ba6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.894359  6651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e20f83fd5644349ce6bfd9a4f41444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.891657  6649 tablet_service.cc:1511] Processing CreateTablet for tablet 45a80771d3ff471fb685264b5b11ba6d (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 13:57:17.903931  6650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f948de6567404c3ea3624362fb5c3ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.902590  6571 tablet_service.cc:1511] Processing CreateTablet for tablet 11c1373722744925bbec561c62c3593e (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 13:57:17.904969  6572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b935708d7e4a35b39767fa13cf0c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.902801  6648 tablet_service.cc:1511] Processing CreateTablet for tablet 443f08c684b940b49efea7861f24de8e (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 13:57:17.913262  6571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1373722744925bbec561c62c3593e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.914392  6652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94c0d6fd0fe4a179c22128bb6725dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.914769  6647 tablet_service.cc:1511] Processing CreateTablet for tablet 97b935708d7e4a35b39767fa13cf0c75 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 13:57:17.919624  6646 tablet_service.cc:1511] Processing CreateTablet for tablet 11c1373722744925bbec561c62c3593e (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 13:57:17.921558  6647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b935708d7e4a35b39767fa13cf0c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.922207  6646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1373722744925bbec561c62c3593e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.922953  6573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443f08c684b940b49efea7861f24de8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.925917  6648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443f08c684b940b49efea7861f24de8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.933979  6649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a80771d3ff471fb685264b5b11ba6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:17.995327  6728 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbde4b2586f48d28c5c7c77c0438b7f (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 13:57:18.005545  6728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbde4b2586f48d28c5c7c77c0438b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.018225  6726 tablet_service.cc:1511] Processing CreateTablet for tablet d94c0d6fd0fe4a179c22128bb6725dab (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 13:57:18.022079  6725 tablet_service.cc:1511] Processing CreateTablet for tablet 31e20f83fd5644349ce6bfd9a4f41444 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 13:57:18.026959  6724 tablet_service.cc:1511] Processing CreateTablet for tablet f948de6567404c3ea3624362fb5c3ab2 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 13:57:18.029006  6727 tablet_service.cc:1511] Processing CreateTablet for tablet 30f8628df7d347fb8081def3dd250cb5 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 13:57:18.034530  6725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e20f83fd5644349ce6bfd9a4f41444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.037320  6727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f8628df7d347fb8081def3dd250cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.053151  6722 tablet_service.cc:1511] Processing CreateTablet for tablet 443f08c684b940b49efea7861f24de8e (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 13:57:18.061678  6723 tablet_service.cc:1511] Processing CreateTablet for tablet 45a80771d3ff471fb685264b5b11ba6d (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 13:57:18.064850  6726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94c0d6fd0fe4a179c22128bb6725dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.067111  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443f08c684b940b49efea7861f24de8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.069890  6723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a80771d3ff471fb685264b5b11ba6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.089054  6724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f948de6567404c3ea3624362fb5c3ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.128573  6721 tablet_service.cc:1511] Processing CreateTablet for tablet 97b935708d7e4a35b39767fa13cf0c75 (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 13:57:18.130897  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b935708d7e4a35b39767fa13cf0c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.169996  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 11c1373722744925bbec561c62c3593e (DEFAULT_TABLE table=test-workload [id=3204ec56f27540b98446c7062e696c42]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 13:57:18.175143  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1373722744925bbec561c62c3593e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:18.224725  6614 heartbeater.cc:499] Master 127.6.77.190:33267 was elected leader, sending a full tablet report...
I20260501 13:57:18.294251  6781 tablet_bootstrap.cc:492] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:18.372546  6782 tablet_bootstrap.cc:492] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:18.369489  6783 tablet_bootstrap.cc:492] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:18.389122  6781 tablet_bootstrap.cc:654] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.400099  6782 tablet_bootstrap.cc:654] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.401291  6783 tablet_bootstrap.cc:654] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.411619  6783 tablet_bootstrap.cc:492] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.412297  6783 ts_tablet_manager.cc:1403] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.006s
I20260501 13:57:18.415246  6781 tablet_bootstrap.cc:492] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:18.415674  6781 ts_tablet_manager.cc:1403] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.196s	user 0.000s	sys 0.027s
I20260501 13:57:18.416553  6783 raft_consensus.cc:359] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.418200  6783 raft_consensus.cc:385] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.418502  6783 raft_consensus.cc:740] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.419234  6783 consensus_queue.cc:260] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.419422  6781 raft_consensus.cc:359] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.420109  6781 raft_consensus.cc:385] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.420409  6781 raft_consensus.cc:740] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.421141  6781 consensus_queue.cc:260] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.421669  6763 heartbeater.cc:499] Master 127.6.77.190:33267 was elected leader, sending a full tablet report...
I20260501 13:57:18.426879  6783 ts_tablet_manager.cc:1434] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.007s
I20260501 13:57:18.428145  6783 tablet_bootstrap.cc:492] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:18.431591  6689 heartbeater.cc:499] Master 127.6.77.190:33267 was elected leader, sending a full tablet report...
I20260501 13:57:18.437050  6783 tablet_bootstrap.cc:654] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.447325  6782 tablet_bootstrap.cc:492] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:18.447973  6782 ts_tablet_manager.cc:1403] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.084s	user 0.003s	sys 0.016s
I20260501 13:57:18.449947  6781 ts_tablet_manager.cc:1434] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260501 13:57:18.452859  6781 tablet_bootstrap.cc:492] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:18.449992  6783 tablet_bootstrap.cc:492] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.460739  6783 ts_tablet_manager.cc:1403] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.013s
I20260501 13:57:18.461447  6781 tablet_bootstrap.cc:654] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.451402  6782 raft_consensus.cc:359] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.462913  6782 raft_consensus.cc:385] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.463274  6782 raft_consensus.cc:740] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.464897  6783 raft_consensus.cc:359] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.464900  6782 consensus_queue.cc:260] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.465850  6783 raft_consensus.cc:385] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.466338  6783 raft_consensus.cc:740] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.467224  6783 consensus_queue.cc:260] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.469743  6783 ts_tablet_manager.cc:1434] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260501 13:57:18.470706  6783 tablet_bootstrap.cc:492] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:18.478756  6783 tablet_bootstrap.cc:654] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.492177  6783 tablet_bootstrap.cc:492] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.492858  6783 ts_tablet_manager.cc:1403] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260501 13:57:18.498893  6783 raft_consensus.cc:359] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.499749  6783 raft_consensus.cc:385] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.500114  6783 raft_consensus.cc:740] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.501144  6782 ts_tablet_manager.cc:1434] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.002s
I20260501 13:57:18.500998  6783 consensus_queue.cc:260] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.503657  6783 ts_tablet_manager.cc:1434] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260501 13:57:18.504719  6783 tablet_bootstrap.cc:492] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:18.511731  6783 tablet_bootstrap.cc:654] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.520836  6782 tablet_bootstrap.cc:492] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:18.530843  6781 tablet_bootstrap.cc:492] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:18.531374  6781 ts_tablet_manager.cc:1403] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.079s	user 0.041s	sys 0.033s
I20260501 13:57:18.534958  6782 tablet_bootstrap.cc:654] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.535753  6783 tablet_bootstrap.cc:492] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.536329  6783 ts_tablet_manager.cc:1403] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.003s
I20260501 13:57:18.535847  6781 raft_consensus.cc:359] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:18.536823  6781 raft_consensus.cc:385] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.537202  6781 raft_consensus.cc:740] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.538869  6781 consensus_queue.cc:260] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:18.539235  6783 raft_consensus.cc:359] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.539975  6783 raft_consensus.cc:385] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.540282  6783 raft_consensus.cc:740] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.541054  6783 consensus_queue.cc:260] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.541488  6781 ts_tablet_manager.cc:1434] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260501 13:57:18.542640  6781 tablet_bootstrap.cc:492] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:18.550894  6781 tablet_bootstrap.cc:654] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.551344  6782 tablet_bootstrap.cc:492] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:18.551905  6782 ts_tablet_manager.cc:1403] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.011s
I20260501 13:57:18.553438  6783 ts_tablet_manager.cc:1434] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260501 13:57:18.554386  6783 tablet_bootstrap.cc:492] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:18.556022  6782 raft_consensus.cc:359] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.556886  6782 raft_consensus.cc:385] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.557215  6782 raft_consensus.cc:740] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.558888  6782 consensus_queue.cc:260] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.561213  6782 ts_tablet_manager.cc:1434] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260501 13:57:18.562083  6783 tablet_bootstrap.cc:654] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.562234  6782 tablet_bootstrap.cc:492] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:18.571493  6782 tablet_bootstrap.cc:654] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.579191  6781 tablet_bootstrap.cc:492] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:18.579988  6783 tablet_bootstrap.cc:492] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.580027  6781 ts_tablet_manager.cc:1403] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.008s
I20260501 13:57:18.580597  6783 ts_tablet_manager.cc:1403] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260501 13:57:18.583745  6782 tablet_bootstrap.cc:492] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:18.584249  6782 ts_tablet_manager.cc:1403] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.009s
I20260501 13:57:18.584689  6781 raft_consensus.cc:359] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.584776  6783 raft_consensus.cc:359] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.585639  6781 raft_consensus.cc:385] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.586033  6781 raft_consensus.cc:740] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.587088  6787 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.586845  6781 consensus_queue.cc:260] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.587594  6787 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.588529  6782 raft_consensus.cc:359] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.589272  6782 raft_consensus.cc:385] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.589581  6782 raft_consensus.cc:740] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.590955  6782 consensus_queue.cc:260] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.593567  6782 ts_tablet_manager.cc:1434] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260501 13:57:18.594663  6782 tablet_bootstrap.cc:492] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:18.597404  6781 ts_tablet_manager.cc:1434] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260501 13:57:18.600219  6781 tablet_bootstrap.cc:492] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:18.585698  6783 raft_consensus.cc:385] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.602612  6787 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.603890  6783 raft_consensus.cc:740] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.610406  6783 consensus_queue.cc:260] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.619804  6782 tablet_bootstrap.cc:654] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.621086  6783 ts_tablet_manager.cc:1434] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260501 13:57:18.625826  6788 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.628731  6791 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.629549  6791 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.630059  6783 tablet_bootstrap.cc:492] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
W20260501 13:57:18.632195  6764 tablet.cc:2404] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260501 13:57:18.631503  6788 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.643082  6788 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.640981  6791 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.660403  6781 tablet_bootstrap.cc:654] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.693713  6782 tablet_bootstrap.cc:492] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:18.694233  6782 ts_tablet_manager.cc:1403] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.035s
I20260501 13:57:18.706406  6783 tablet_bootstrap.cc:654] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.728000  6782 raft_consensus.cc:359] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.731040  6782 raft_consensus.cc:385] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.733385  6791 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.737040  6787 raft_consensus.cc:493] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.735203  6791 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.733546  6782 raft_consensus.cc:740] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.737767  6787 raft_consensus.cc:515] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.747032  6787 leader_election.cc:290] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.747316  6781 tablet_bootstrap.cc:492] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:18.747893  6781 ts_tablet_manager.cc:1403] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.024s
I20260501 13:57:18.747936  6791 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.748618  6782 consensus_queue.cc:260] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.755791  6788 raft_consensus.cc:493] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.757155  6788 raft_consensus.cc:515] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.768790  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:18.772701  6788 leader_election.cc:290] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.759266  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
W20260501 13:57:18.784246  6703 leader_election.cc:343] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:57:18.797082  6703 leader_election.cc:343] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.805124  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
W20260501 13:57:18.805910  6534 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:57:18.806290  6737 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 0.
I20260501 13:57:18.806712  6782 ts_tablet_manager.cc:1434] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.006s
I20260501 13:57:18.807670  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:18.809113  6554 leader_election.cc:304] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:18.806604  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:18.803244  6738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:18.812043  6788 raft_consensus.cc:2804] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:18.812894  6788 raft_consensus.cc:493] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:18.813220  6788 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:57:18.813367  6629 leader_election.cc:343] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:57:18.814914  6629 leader_election.cc:343] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.815235  6783 tablet_bootstrap.cc:492] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.815723  6783 ts_tablet_manager.cc:1403] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.188s	user 0.025s	sys 0.003s
I20260501 13:57:18.816015  6791 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.816450  6791 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.818341  6791 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.820470  6782 tablet_bootstrap.cc:492] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
W20260501 13:57:18.821697  6554 leader_election.cc:343] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.825259  6787 raft_consensus.cc:493] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.825156  6783 raft_consensus.cc:359] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.819278  6781 raft_consensus.cc:359] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.826211  6787 raft_consensus.cc:515] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.826824  6781 raft_consensus.cc:385] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.826633  6783 raft_consensus.cc:385] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.828572  6781 raft_consensus.cc:740] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.829447  6783 raft_consensus.cc:740] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.832078  6664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.828387  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:18.833943  6664 raft_consensus.cc:2468] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 0.
I20260501 13:57:18.836018  6787 leader_election.cc:290] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.835296  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.838176  6783 consensus_queue.cc:260] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.839551  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.834417  6781 consensus_queue.cc:260] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.849067  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:18.850265  6662 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 0.
I20260501 13:57:18.840214  6704 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:18.850919  6588 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 0.
I20260501 13:57:18.835314  6589 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 0.
I20260501 13:57:18.852397  6629 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:18.855213  6791 raft_consensus.cc:2804] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:18.856432  6791 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:18.856761  6791 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:18.857864  6783 ts_tablet_manager.cc:1434] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.004s
I20260501 13:57:18.858506  6703 leader_election.cc:304] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:18.859678  6787 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.865959  6783 tablet_bootstrap.cc:492] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:18.866982  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.867018  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.865531  6787 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
W20260501 13:57:18.869035  6555 leader_election.cc:343] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.873620  6814 raft_consensus.cc:2804] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:18.875123  6814 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:18.875589  6814 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:57:18.876650  6704 leader_election.cc:343] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.877174  6704 leader_election.cc:304] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:18.883173  6782 tablet_bootstrap.cc:654] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.884483  6787 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.886564  6787 raft_consensus.cc:2804] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:18.886931  6787 raft_consensus.cc:493] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:18.887248  6787 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:18.887413  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
W20260501 13:57:18.892431  6703 leader_election.cc:343] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.893852  6783 tablet_bootstrap.cc:654] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:18.898000  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.898730  6663 raft_consensus.cc:2468] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 0.
I20260501 13:57:18.894740  6791 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.905961  6662 raft_consensus.cc:2393] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6b65cd176431bac9e086a1c5b254e in current term 1: Already voted for candidate 06b335c44fe04b09af02ed7f13773ac6 in this term.
I20260501 13:57:18.905164  6738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:18.906633  6738 raft_consensus.cc:2468] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 0.
I20260501 13:57:18.906569  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:18.905861  6791 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.908304  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:18.910267  6629 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:18.911545  6815 raft_consensus.cc:2749] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:18.910250  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:18.913038  6589 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:57:18.918996  6629 leader_election.cc:343] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.913421  6738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:18.917443  6555 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e; no voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:18.918104  6791 raft_consensus.cc:2804] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 13:57:18.927155  6629 leader_election.cc:343] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.905766  6704 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:18.940979  6815 raft_consensus.cc:2804] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:18.941371  6815 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:18.941669  6815 raft_consensus.cc:3060] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:18.926537  6791 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:18.943542  6791 raft_consensus.cc:3060] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:57:18.946695  6704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:32827, user_credentials={real_user=slave}} blocked reactor thread for 44395.9us
I20260501 13:57:18.950495  6787 raft_consensus.cc:515] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.943301  6788 raft_consensus.cc:515] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.959913  6818 raft_consensus.cc:493] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:18.959950  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:18.960619  6818 raft_consensus.cc:515] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:18.962437  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:18.963953  6588 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:18.964323  6782 tablet_bootstrap.cc:492] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:18.964861  6818 leader_election.cc:290] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.965919  6782 ts_tablet_manager.cc:1403] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.151s	user 0.019s	sys 0.014s
I20260501 13:57:18.966306  6788 leader_election.cc:290] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 election: Requested vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:18.967701  6589 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 1.
I20260501 13:57:18.968318  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
W20260501 13:57:18.968598  6555 leader_election.cc:343] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.969511  6736 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:18.969631  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:18.961611  6787 leader_election.cc:290] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.963936  6781 ts_tablet_manager.cc:1434] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.216s	user 0.019s	sys 0.007s
I20260501 13:57:18.971062  6738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
W20260501 13:57:18.976613  6554 leader_election.cc:343] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.971932  6662 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:18.977020  6781 tablet_bootstrap.cc:492] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:18.972628  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:18.973744  6629 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:18.974504  6816 raft_consensus.cc:2749] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:18.983698  6783 tablet_bootstrap.cc:492] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:18.984283  6783 ts_tablet_manager.cc:1403] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.009s
I20260501 13:57:18.988767  6782 raft_consensus.cc:359] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:18.983700  6815 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
W20260501 13:57:18.985044  6555 leader_election.cc:343] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:18.989610  6782 raft_consensus.cc:385] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:18.994657  6783 raft_consensus.cc:359] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:18.994803  6814 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.001729  6737 raft_consensus.cc:2393] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06b335c44fe04b09af02ed7f13773ac6 in current term 1: Already voted for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in this term.
I20260501 13:57:18.995709  6782 raft_consensus.cc:740] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:18.996433  6555 leader_election.cc:304] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e; no voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:18.998368  6815 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:18.999346  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:18.999522  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
W20260501 13:57:19.006285  6703 leader_election.cc:343] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:19.005947  6782 consensus_queue.cc:260] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.007014  6814 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:19.008805  6664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:19.009161  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:19.009413  6664 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.010493  6736 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 1.
I20260501 13:57:19.003854  6588 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:19.004127  6788 raft_consensus.cc:2749] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.002502  6783 raft_consensus.cc:385] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.012768  6662 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:19.014768  6783 raft_consensus.cc:740] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.016103  6554 leader_election.cc:304] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:19.015981  6783 consensus_queue.cc:260] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:19.017494  6788 raft_consensus.cc:2804] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.013316  6791 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.018008  6788 raft_consensus.cc:697] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:19.019554  6788 consensus_queue.cc:237] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.020141  6704 leader_election.cc:304] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:19.021343  6791 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.019569  6663 raft_consensus.cc:2393] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in current term 1: Already voted for candidate 06b335c44fe04b09af02ed7f13773ac6 in this term.
W20260501 13:57:19.019163  6703 leader_election.cc:343] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:19.024444  6704 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:19.020421  6629 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6; no voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:19.027503  6664 raft_consensus.cc:2468] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:19.032294  6704 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:19.033083  6815 raft_consensus.cc:2749] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.033502  6820 raft_consensus.cc:2804] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.033681  6815 raft_consensus.cc:2804] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.034173  6815 raft_consensus.cc:697] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:19.034480  6814 raft_consensus.cc:2804] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.034946  6814 raft_consensus.cc:697] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:19.034929  6815 consensus_queue.cc:237] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.036753  6814 consensus_queue.cc:237] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.046164  6791 raft_consensus.cc:2749] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.054517  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
W20260501 13:57:19.064566  6629 leader_election.cc:343] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:19.060817  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:19.065272  6781 tablet_bootstrap.cc:654] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.070389  6736 raft_consensus.cc:2393] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06b335c44fe04b09af02ed7f13773ac6 in current term 1: Already voted for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in this term.
I20260501 13:57:19.077596  6629 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6; no voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:19.068943  6820 raft_consensus.cc:697] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:19.083946  6821 raft_consensus.cc:2749] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.085539  6485 catalog_manager.cc:5671] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 1 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:19.092047  6782 ts_tablet_manager.cc:1434] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.126s	user 0.016s	sys 0.021s
I20260501 13:57:19.094358  6820 consensus_queue.cc:237] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.100025  6782 tablet_bootstrap.cc:492] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:19.101830  6783 ts_tablet_manager.cc:1434] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.117s	user 0.016s	sys 0.013s
I20260501 13:57:19.106706  6781 tablet_bootstrap.cc:492] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:19.108633  6783 tablet_bootstrap.cc:492] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:19.108108  6781 ts_tablet_manager.cc:1403] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.131s	user 0.019s	sys 0.015s
I20260501 13:57:19.118716  6781 raft_consensus.cc:359] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.119575  6781 raft_consensus.cc:385] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.119889  6781 raft_consensus.cc:740] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.121503  6782 tablet_bootstrap.cc:654] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.121098  6781 consensus_queue.cc:260] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.122721  6783 tablet_bootstrap.cc:654] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.126936  6781 ts_tablet_manager.cc:1434] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.001s
I20260501 13:57:19.128360  6781 tablet_bootstrap.cc:492] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:19.144891  6781 tablet_bootstrap.cc:654] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.146881  6782 tablet_bootstrap.cc:492] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:19.147514  6782 ts_tablet_manager.cc:1403] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.015s
I20260501 13:57:19.154199  6783 tablet_bootstrap.cc:492] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:19.154876  6783 ts_tablet_manager.cc:1403] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.011s
I20260501 13:57:19.155781  6484 catalog_manager.cc:5671] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:19.157612  6783 raft_consensus.cc:359] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.161437  6783 raft_consensus.cc:385] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.161752  6783 raft_consensus.cc:740] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.161964  6484 catalog_manager.cc:5671] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:19.162420  6783 consensus_queue.cc:260] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.158624  6486 catalog_manager.cc:5671] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:19.166206  6783 ts_tablet_manager.cc:1434] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260501 13:57:19.167937  6783 tablet_bootstrap.cc:492] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1: Bootstrap starting.
I20260501 13:57:19.169026  6782 raft_consensus.cc:359] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:19.169756  6782 raft_consensus.cc:385] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.169934  6781 tablet_bootstrap.cc:492] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:19.170091  6782 raft_consensus.cc:740] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.170499  6781 ts_tablet_manager.cc:1403] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.019s
I20260501 13:57:19.170991  6782 consensus_queue.cc:260] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:19.174715  6783 tablet_bootstrap.cc:654] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.175315  6781 raft_consensus.cc:359] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.176074  6781 raft_consensus.cc:385] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.176333  6781 raft_consensus.cc:740] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.181471  6781 consensus_queue.cc:260] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.187374  6820 raft_consensus.cc:493] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.188050  6820 raft_consensus.cc:515] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.189630  6782 ts_tablet_manager.cc:1434] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260501 13:57:19.190378  6820 leader_election.cc:290] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.190805  6782 tablet_bootstrap.cc:492] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:19.195804  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:19.195919  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.196784  6736 raft_consensus.cc:2393] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06b335c44fe04b09af02ed7f13773ac6 in current term 1: Already voted for candidate 8ca6b65cd176431bac9e086a1c5b254e in this term.
I20260501 13:57:19.197963  6629 leader_election.cc:304] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6; no voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:19.199194  6820 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.199790  6788 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.200062  6783 tablet_bootstrap.cc:492] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1: No bootstrap required, opened a new log
I20260501 13:57:19.200678  6783 ts_tablet_manager.cc:1403] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.007s
I20260501 13:57:19.200312  6788 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.204363  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:19.204689  6781 ts_tablet_manager.cc:1434] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.006s
I20260501 13:57:19.204747  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:19.205195  6662 raft_consensus.cc:2393] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6b65cd176431bac9e086a1c5b254e in current term 1: Already voted for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in this term.
I20260501 13:57:19.205897  6781 tablet_bootstrap.cc:492] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:19.206561  6554 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e; no voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:19.208331  6788 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.208840  6816 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.215162  6820 raft_consensus.cc:2749] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.219622  6814 raft_consensus.cc:493] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.221174  6814 raft_consensus.cc:515] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.222348  6783 raft_consensus.cc:359] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.223009  6783 raft_consensus.cc:385] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.223202  6814 leader_election.cc:290] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:19.225353  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a80771d3ff471fb685264b5b11ba6d" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.226612  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a80771d3ff471fb685264b5b11ba6d" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:19.227257  6782 tablet_bootstrap.cc:654] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
W20260501 13:57:19.228114  6703 leader_election.cc:343] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:57:19.229048  6704 leader_election.cc:343] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:19.229509  6704 leader_election.cc:304] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:19.223285  6783 raft_consensus.cc:740] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.230372  6814 raft_consensus.cc:2749] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.230647  6783 consensus_queue.cc:260] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.233206  6783 ts_tablet_manager.cc:1434] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260501 13:57:19.239696  6816 raft_consensus.cc:2749] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.248867  6814 raft_consensus.cc:493] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.249356  6781 tablet_bootstrap.cc:654] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.249464  6814 raft_consensus.cc:515] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.251792  6814 leader_election.cc:290] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:19.252825  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.254169  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
W20260501 13:57:19.255672  6704 leader_election.cc:343] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:57:19.256189  6703 leader_election.cc:343] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:19.256600  6703 leader_election.cc:304] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:19.257030  6782 tablet_bootstrap.cc:492] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:19.257045  6781 tablet_bootstrap.cc:492] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:19.257314  6814 raft_consensus.cc:2749] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.257763  6782 ts_tablet_manager.cc:1403] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.023s
I20260501 13:57:19.259073  6781 ts_tablet_manager.cc:1403] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.000s
I20260501 13:57:19.262275  6781 raft_consensus.cc:359] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.262144  6782 raft_consensus.cc:359] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.262984  6781 raft_consensus.cc:385] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.263098  6782 raft_consensus.cc:385] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.263334  6781 raft_consensus.cc:740] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.263463  6782 raft_consensus.cc:740] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.264252  6781 consensus_queue.cc:260] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.264384  6782 consensus_queue.cc:260] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.267108  6781 ts_tablet_manager.cc:1434] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260501 13:57:19.267664  6782 ts_tablet_manager.cc:1434] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260501 13:57:19.268144  6781 tablet_bootstrap.cc:492] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:19.268903  6782 tablet_bootstrap.cc:492] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:19.276209  6781 tablet_bootstrap.cc:654] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.279132  6782 tablet_bootstrap.cc:654] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.284714  6814 raft_consensus.cc:493] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.285303  6814 raft_consensus.cc:515] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:19.287398  6814 leader_election.cc:290] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:19.288898  6781 tablet_bootstrap.cc:492] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:19.289489  6781 ts_tablet_manager.cc:1403] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260501 13:57:19.289736  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.290680  6588 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 0.
I20260501 13:57:19.292351  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:19.292989  6662 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 0.
I20260501 13:57:19.292892  6703 leader_election.cc:304] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:19.293761  6781 raft_consensus.cc:359] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.295218  6814 raft_consensus.cc:2804] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:19.295790  6814 raft_consensus.cc:493] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:19.296236  6814 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.295760  6781 raft_consensus.cc:385] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.296732  6781 raft_consensus.cc:740] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.297505  6781 consensus_queue.cc:260] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.301177  6782 tablet_bootstrap.cc:492] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:19.301730  6782 ts_tablet_manager.cc:1403] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.014s
I20260501 13:57:19.301172  6781 ts_tablet_manager.cc:1434] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260501 13:57:19.306036  6782 raft_consensus.cc:359] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.306852  6782 raft_consensus.cc:385] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.307204  6782 raft_consensus.cc:740] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.307386  6781 tablet_bootstrap.cc:492] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e: Bootstrap starting.
I20260501 13:57:19.308059  6782 consensus_queue.cc:260] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.310427  6782 ts_tablet_manager.cc:1434] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260501 13:57:19.311473  6782 tablet_bootstrap.cc:492] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: Bootstrap starting.
I20260501 13:57:19.305583  6814 raft_consensus.cc:515] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:19.315680  6814 leader_election.cc:290] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:19.316074  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:19.316699  6588 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.317458  6782 tablet_bootstrap.cc:654] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.317301  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:19.320753  6662 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.324363  6588 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:19.325574  6703 leader_election.cc:304] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:19.329027  6662 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:19.335361  6781 tablet_bootstrap.cc:654] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:19.336890  6814 raft_consensus.cc:2804] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.337498  6814 raft_consensus.cc:697] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:19.338392  6814 consensus_queue.cc:237] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:19.339064  6782 tablet_bootstrap.cc:492] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: No bootstrap required, opened a new log
I20260501 13:57:19.339705  6782 ts_tablet_manager.cc:1403] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.006s
I20260501 13:57:19.344408  6782 raft_consensus.cc:359] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.345317  6782 raft_consensus.cc:385] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.345636  6782 raft_consensus.cc:740] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.346323  6782 consensus_queue.cc:260] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.347864  6781 tablet_bootstrap.cc:492] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e: No bootstrap required, opened a new log
I20260501 13:57:19.348342  6781 ts_tablet_manager.cc:1403] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.002s
I20260501 13:57:19.348502  6782 ts_tablet_manager.cc:1434] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:57:19.351287  6781 raft_consensus.cc:359] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.351810  6781 raft_consensus.cc:385] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:19.352136  6781 raft_consensus.cc:740] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Initialized, Role: FOLLOWER
I20260501 13:57:19.352737  6781 consensus_queue.cc:260] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.354375  6781 ts_tablet_manager.cc:1434] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260501 13:57:19.366709  6820 raft_consensus.cc:493] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.367287  6820 raft_consensus.cc:515] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.370947  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.370805  6484 catalog_manager.cc:5671] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:19.371572  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:19.371620  6588 raft_consensus.cc:2468] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 0.
I20260501 13:57:19.372311  6736 raft_consensus.cc:2468] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 0.
I20260501 13:57:19.373500  6629 leader_election.cc:304] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:19.373901  6820 leader_election.cc:290] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.374440  6820 raft_consensus.cc:2804] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:19.374751  6820 raft_consensus.cc:493] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:19.375059  6820 raft_consensus.cc:3060] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.378501  6816 raft_consensus.cc:493] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.378980  6816 raft_consensus.cc:515] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.382705  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:19.383435  6736 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 0.
I20260501 13:57:19.383741  6820 raft_consensus.cc:515] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.385684  6554 leader_election.cc:304] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:19.385931  6820 leader_election.cc:290] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.386607  6788 raft_consensus.cc:2804] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:19.386981  6788 raft_consensus.cc:493] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:19.387331  6788 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.387436  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:19.388228  6662 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 0.
I20260501 13:57:19.388904  6816 leader_election.cc:290] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.390849  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:19.391088  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:19.391517  6588 raft_consensus.cc:3060] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.391702  6736 raft_consensus.cc:3060] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.397505  6788 raft_consensus.cc:515] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.399838  6820 raft_consensus.cc:493] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.400348  6820 raft_consensus.cc:515] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.400748  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:19.401374  6662 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.401983  6736 raft_consensus.cc:2468] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 1.
I20260501 13:57:19.404582  6629 leader_election.cc:304] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:19.405342  6588 raft_consensus.cc:2468] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 1.
I20260501 13:57:19.405705  6821 raft_consensus.cc:2804] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.406222  6821 raft_consensus.cc:697] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:19.407833  6820 leader_election.cc:290] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.407771  6821 consensus_queue.cc:237] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.410406  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a80771d3ff471fb685264b5b11ba6d" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.411087  6588 raft_consensus.cc:2468] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 0.
I20260501 13:57:19.411975  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a80771d3ff471fb685264b5b11ba6d" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:19.412191  6629 leader_election.cc:304] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:19.412592  6736 raft_consensus.cc:2468] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 0.
I20260501 13:57:19.414561  6820 raft_consensus.cc:2804] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:19.415699  6662 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 1.
I20260501 13:57:19.417472  6555 leader_election.cc:304] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:19.418360  6816 raft_consensus.cc:2804] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.418825  6816 raft_consensus.cc:697] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:19.414978  6820 raft_consensus.cc:493] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:19.419598  6816 consensus_queue.cc:237] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.424100  6820 raft_consensus.cc:3060] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.423517  6484 catalog_manager.cc:5671] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:19.421484  6788 leader_election.cc:290] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 election: Requested vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.421752  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:19.429096  6736 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.433058  6820 raft_consensus.cc:515] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.437515  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a80771d3ff471fb685264b5b11ba6d" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:19.438167  6588 raft_consensus.cc:3060] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.439082  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a80771d3ff471fb685264b5b11ba6d" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:19.439723  6737 raft_consensus.cc:3060] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.445843  6484 catalog_manager.cc:5671] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 1 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:19.447865  6588 raft_consensus.cc:2468] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 1.
I20260501 13:57:19.449229  6737 raft_consensus.cc:2468] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 1.
I20260501 13:57:19.451228  6629 leader_election.cc:304] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:19.452450  6821 raft_consensus.cc:2804] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:19.453141  6821 raft_consensus.cc:697] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:19.454054  6821 consensus_queue.cc:237] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.456568  6736 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 1.
I20260501 13:57:19.449659  6820 leader_election.cc:290] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 1 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.468319  6814 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:19.468999  6484 catalog_manager.cc:5671] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:19.478148  6816 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.489457  6788 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:19.509967  6814 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:19.519554  6825 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.520500  6825 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.525260  6815 consensus_queue.cc:1048] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260501 13:57:19.530606  6737 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.528091  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:19.538180  6589 raft_consensus.cc:2393] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in current term 1: Already voted for candidate 06b335c44fe04b09af02ed7f13773ac6 in this term.
I20260501 13:57:19.537937  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:19.539811  6704 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:19.531883  6825 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:19.557245  6815 raft_consensus.cc:2749] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.560985  6821 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.575548  6816 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:19.576424  6816 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:19.594022  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:19.595136  6662 raft_consensus.cc:2393] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6b65cd176431bac9e086a1c5b254e in current term 1: Already voted for candidate 06b335c44fe04b09af02ed7f13773ac6 in this term.
I20260501 13:57:19.597074  6816 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:19.598363  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" is_pre_election: true
I20260501 13:57:19.599220  6737 raft_consensus.cc:2393] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ca6b65cd176431bac9e086a1c5b254e in current term 1: Already voted for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in this term.
I20260501 13:57:19.600613  6554 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e; no voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:19.609470  6816 raft_consensus.cc:3060] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:19.610939  6814 consensus_queue.cc:1048] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.617631  6816 raft_consensus.cc:2749] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:19.644470  6822 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260501 13:57:19.815955  6534 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:57:19.818109  6816 consensus_queue.cc:1048] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.829365  6816 consensus_queue.cc:1048] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.887184  6814 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:19.899987  6815 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:19.931092  6822 consensus_queue.cc:1048] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.946244  6820 consensus_queue.cc:1048] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:19.991937  6820 consensus_queue.cc:1048] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:20.006978  6822 consensus_queue.cc:1048] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260501 13:57:20.822778  6534 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:57:20.891638  6815 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:20.892266  6815 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:20.893997  6815 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:20.895066  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:20.895429  6664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:20.895727  6588 raft_consensus.cc:2468] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:20.896154  6664 raft_consensus.cc:2468] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 1.
I20260501 13:57:20.897017  6703 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:20.897949  6815 raft_consensus.cc:2804] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:57:20.898281  6815 raft_consensus.cc:493] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:20.899308  6815 raft_consensus.cc:3060] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:20.906096  6815 raft_consensus.cc:515] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:20.907851  6815 leader_election.cc:290] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:20.908751  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:20.909127  6664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1373722744925bbec561c62c3593e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:20.909528  6588 raft_consensus.cc:3060] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:20.909832  6664 raft_consensus.cc:3060] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.007681  6588 raft_consensus.cc:2468] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 2.
I20260501 13:57:21.007915  6664 raft_consensus.cc:2468] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 2.
I20260501 13:57:21.009001  6703 leader_election.cc:304] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:21.010010  6815 raft_consensus.cc:2804] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:21.010591  6815 raft_consensus.cc:697] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:21.011600  6815 consensus_queue.cc:237] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.020447  6483 catalog_manager.cc:5671] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:21.264707  6736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
mode: GRACEFUL
new_leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:60664
I20260501 13:57:21.265334  6736 raft_consensus.cc:606] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:21.279623  6664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:38660
I20260501 13:57:21.280277  6664 raft_consensus.cc:606] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:21.288228  6736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
mode: GRACEFUL
new_leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:60664
I20260501 13:57:21.288731  6736 raft_consensus.cc:606] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:21.293792  6736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:60664
I20260501 13:57:21.294411  6736 raft_consensus.cc:606] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:21.311118  6588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443f08c684b940b49efea7861f24de8e"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:45736
I20260501 13:57:21.311648  6588 raft_consensus.cc:606] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:21.324498  6788 raft_consensus.cc:993] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:21.325112  6788 raft_consensus.cc:1081] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:21.326655  6664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "443f08c684b940b49efea7861f24de8e"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38810
I20260501 13:57:21.327219  6664 raft_consensus.cc:493] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:21.327558  6664 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.398844  6868 raft_consensus.cc:993] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: : Instructing follower 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:21.399387  6815 raft_consensus.cc:1081] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Signalling peer 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:21.401069  6588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:54444
I20260501 13:57:21.401566  6588 raft_consensus.cc:493] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:21.401937  6588 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.403594  6662 raft_consensus.cc:1275] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 13:57:21.405347  6589 raft_consensus.cc:1275] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 13:57:21.405612  6815 consensus_queue.cc:1048] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:21.407413  6815 consensus_queue.cc:1048] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:21.418268  6664 raft_consensus.cc:515] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.420742  6664 leader_election.cc:290] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:21.421967  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:21.422590  6587 raft_consensus.cc:3055] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:21.422863  6587 raft_consensus.cc:740] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:21.423805  6587 consensus_queue.cc:260] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.426011  6587 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.428105  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:21.428717  6736 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.428381  6588 raft_consensus.cc:515] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:21.445752  6588 leader_election.cc:290] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Requested vote from peers 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:21.445792  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:21.446857  6737 raft_consensus.cc:3055] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:21.447268  6737 raft_consensus.cc:740] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:21.448171  6737 consensus_queue.cc:260] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:21.449096  6737 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.449674  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:21.450387  6662 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.451771  6815 raft_consensus.cc:993] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:21.452438  6868 raft_consensus.cc:1081] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:21.457250  6663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38806
I20260501 13:57:21.458122  6663 raft_consensus.cc:493] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:21.458545  6663 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.519429  6587 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 2.
I20260501 13:57:21.519660  6736 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 2.
I20260501 13:57:21.521308  6662 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:21.523080  6555 leader_election.cc:304] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:21.524026  6788 raft_consensus.cc:2804] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:21.524643  6788 raft_consensus.cc:697] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:21.525120  6629 leader_election.cc:304] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:21.525504  6788 consensus_queue.cc:237] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:21.526466  6822 raft_consensus.cc:2804] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:21.528400  6822 raft_consensus.cc:697] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:21.529472  6822 consensus_queue.cc:237] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.536010  6483 catalog_manager.cc:5671] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 1 to 2, leader changed from 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131) to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 2 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:21.538414  6485 catalog_manager.cc:5671] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 1 to 2, leader changed from 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:21.622746  6737 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:21.622793  6663 raft_consensus.cc:515] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.625130  6663 leader_election.cc:290] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:21.626185  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:21.626823  6587 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.626983  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:21.627581  6737 raft_consensus.cc:3055] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:21.627959  6737 raft_consensus.cc:740] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:21.628764  6737 consensus_queue.cc:260] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.630024  6737 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.636364  6885 raft_consensus.cc:993] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:21.636866  6822 raft_consensus.cc:1081] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Signalling peer 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:21.638253  6589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:54460
I20260501 13:57:21.638676  6589 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:21.638931  6589 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.726296  6587 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 2.
I20260501 13:57:21.726230  6737 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 2.
I20260501 13:57:21.729351  6629 leader_election.cc:304] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:21.729667  6815 raft_consensus.cc:993] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: : Instructing follower 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:21.730269  6815 raft_consensus.cc:1081] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Signalling peer 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:21.730536  6822 raft_consensus.cc:2804] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:21.731009  6822 raft_consensus.cc:697] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:21.731998  6822 consensus_queue.cc:237] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.732758  6587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:54444
I20260501 13:57:21.733439  6587 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:21.733803  6587 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.740623  6485 catalog_manager.cc:5671] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 1 to 2, leader changed from 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:21.824730  6589 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.824963  6587 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.828023  6587 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Requested vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:21.828711  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:21.830200  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:21.830472  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:21.830614  6737 raft_consensus.cc:3055] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:21.829541  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:21.830785  6662 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.831013  6736 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.831295  6663 raft_consensus.cc:3055] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:21.831674  6663 raft_consensus.cc:740] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:21.832510  6663 consensus_queue.cc:260] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.833704  6663 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.829878  6589 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Requested vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:21.831032  6737 raft_consensus.cc:740] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:21.839108  6737 consensus_queue.cc:260] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.840144  6737 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:21.923185  6736 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:21.924134  6663 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:21.924857  6554 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:21.923336  6662 raft_consensus.cc:2468] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:21.926477  6788 raft_consensus.cc:2804] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:21.927048  6788 raft_consensus.cc:697] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:21.928035  6788 consensus_queue.cc:237] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.929996  6555 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:21.930932  6878 raft_consensus.cc:2804] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:21.931483  6878 raft_consensus.cc:697] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:21.932564  6878 consensus_queue.cc:237] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:21.938269  6485 catalog_manager.cc:5671] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 1 to 2, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 2 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:21.952915  6485 catalog_manager.cc:5671] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 1 to 2, leader changed from 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131) to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 2 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:22.024955  6737 raft_consensus.cc:2468] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:22.056732  6662 raft_consensus.cc:1275] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.057514  6737 raft_consensus.cc:1275] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.058321  6878 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:22.059122  6822 consensus_queue.cc:1048] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:22.062124  6589 raft_consensus.cc:1275] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.062677  6737 raft_consensus.cc:1275] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.064112  6822 consensus_queue.cc:1048] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:22.064360  6878 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:22.136674  6736 raft_consensus.cc:1275] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.138212  6905 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:22.158412  6589 raft_consensus.cc:1275] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.159795  6822 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:22.369997  6662 raft_consensus.cc:1275] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.371387  6903 consensus_queue.cc:1048] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:22.380576  6736 raft_consensus.cc:1275] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.382164  6878 consensus_queue.cc:1048] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:22.408820  6662 raft_consensus.cc:1275] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.410176  6878 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:22.424021  6736 raft_consensus.cc:1275] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:22.425909  6912 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:24.348634  6454 auto_leader_rebalancer-test.cc:272] The leader distribution is 
I20260501 13:57:24.349454  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:24.371343  6589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
mode: GRACEFUL
new_leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:45744
I20260501 13:57:24.372040  6589 raft_consensus.cc:606] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Received request to transfer leadership to TS 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:24.383448  6662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:38676
I20260501 13:57:24.384521  6662 raft_consensus.cc:606] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Received request to transfer leadership to TS 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:24.385620  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260501 13:57:24.386057  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:24.466660  6903 raft_consensus.cc:993] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: : Instructing follower 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:24.467528  6918 raft_consensus.cc:1081] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Signalling peer 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:24.469066  6736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:53978
I20260501 13:57:24.469718  6736 raft_consensus.cc:493] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:24.470098  6736 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:24.474721  6736 raft_consensus.cc:515] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:24.476265  6736 leader_election.cc:290] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:24.477407  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:24.477883  6662 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:24.477933  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:24.478642  6589 raft_consensus.cc:3055] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:24.478931  6589 raft_consensus.cc:740] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:24.479579  6589 consensus_queue.cc:260] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:24.480576  6589 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:24.482614  6662 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 2.
I20260501 13:57:24.483723  6704 leader_election.cc:304] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:24.484454  6868 raft_consensus.cc:2804] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:24.486550  6868 raft_consensus.cc:697] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:24.487392  6589 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 2.
I20260501 13:57:24.487416  6868 consensus_queue.cc:237] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:24.494623  6483 catalog_manager.cc:5671] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 1 to 2, leader changed from 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129) to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:24.577111  6914 raft_consensus.cc:993] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:24.577546  6925 raft_consensus.cc:1081] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Signalling peer 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:24.579041  6736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:53984
I20260501 13:57:24.579494  6736 raft_consensus.cc:493] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:24.579752  6736 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:24.583581  6736 raft_consensus.cc:515] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:24.585004  6736 leader_election.cc:290] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:24.586086  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:24.585985  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:24.586881  6662 raft_consensus.cc:3055] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:57:24.586943  6589 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:24.587268  6662 raft_consensus.cc:740] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:24.588040  6662 consensus_queue.cc:260] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:24.589560  6662 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:24.592415  6589 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 3.
I20260501 13:57:24.593560  6703 leader_election.cc:304] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:24.594489  6868 raft_consensus.cc:2804] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:57:24.594967  6868 raft_consensus.cc:697] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:24.594987  6662 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 3.
I20260501 13:57:24.595964  6868 consensus_queue.cc:237] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:24.604167  6483 catalog_manager.cc:5671] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 2 to 3, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 3 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:25.025731  6662 raft_consensus.cc:1275] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:25.027012  6589 raft_consensus.cc:1275] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:25.027045  6868 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:25.029079  6868 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:57:25.042285  6662 raft_consensus.cc:1275] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:25.044772  6868 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:57:25.049618  6589 raft_consensus.cc:1275] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:25.058506  6930 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:25.387506  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:25.393535  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:25.394019  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:26.395246  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:26.400395  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:26.400835  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:27.402060  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:27.407228  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:27.407658  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:28.408686  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:28.414126  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:28.414625  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:29.415580  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:29.421109  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:29.421509  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:30.422461  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:30.427240  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:30.427644  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:31.428602  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:31.433502  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:31.433977  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:32.434952  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:32.442067  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:32.442647  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:33.444027  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:33.450316  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:33.450836  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:34.479637  6454 auto_leader_rebalancer-test.cc:291] The leader distribution is 
I20260501 13:57:34.484304  6587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:45736
I20260501 13:57:34.485046  6587 raft_consensus.cc:606] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:34.489789  6587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:45736
I20260501 13:57:34.490303  6587 raft_consensus.cc:606] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:34.495234  6736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:60664
I20260501 13:57:34.495787  6736 raft_consensus.cc:606] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:34.500905  6587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:45736
I20260501 13:57:34.501453  6587 raft_consensus.cc:606] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:34.506413  6736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
mode: GRACEFUL
new_leader_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:60664
I20260501 13:57:34.506944  6736 raft_consensus.cc:606] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Received request to transfer leadership to TS 06b335c44fe04b09af02ed7f13773ac6
I20260501 13:57:34.572347  6950 raft_consensus.cc:993] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.572964  6944 raft_consensus.cc:1081] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.573015  6943 raft_consensus.cc:993] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.574323  6943 raft_consensus.cc:1081] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.575443  6662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38810
I20260501 13:57:34.576259  6662 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:34.576201  6663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38806
I20260501 13:57:34.576805  6662 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.576980  6663 raft_consensus.cc:493] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:34.577427  6663 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:34.582577  6662 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.583734  6663 raft_consensus.cc:515] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.585071  6662 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:34.585551  6663 leader_election.cc:290] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:34.586072  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:34.586866  6589 raft_consensus.cc:3055] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:57:34.587217  6589 raft_consensus.cc:740] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:34.587257  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:34.587522  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:34.587848  6736 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.587642  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:34.588478  6587 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:34.588665  6737 raft_consensus.cc:3055] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:57:34.588255  6589 consensus_queue.cc:260] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.589022  6737 raft_consensus.cc:740] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:34.589967  6589 raft_consensus.cc:3060] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.589970  6737 consensus_queue.cc:260] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.591693  6737 raft_consensus.cc:3060] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:34.594975  6736 raft_consensus.cc:2468] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.596619  6629 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:34.597174  6589 raft_consensus.cc:2468] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.597688  6948 raft_consensus.cc:2804] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:57:34.599150  6948 raft_consensus.cc:697] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:34.600343  6737 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 4.
I20260501 13:57:34.600216  6948 consensus_queue.cc:237] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.600982  6587 raft_consensus.cc:2468] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 4.
I20260501 13:57:34.601523  6629 leader_election.cc:304] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:34.602409  6951 raft_consensus.cc:2804] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:57:34.603546  6951 raft_consensus.cc:697] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:34.604562  6951 consensus_queue.cc:237] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.609798  6484 catalog_manager.cc:5671] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 2 to 3, leader changed from 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 3 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:34.626858  6484 catalog_manager.cc:5671] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 3 to 4, leader changed from 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 4 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:34.749075  6944 raft_consensus.cc:993] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.749552  6950 raft_consensus.cc:1081] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.751111  6663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38810
I20260501 13:57:34.751679  6663 raft_consensus.cc:493] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:34.752055  6663 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.757162  6663 raft_consensus.cc:515] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:34.758838  6663 leader_election.cc:290] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:34.759914  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:34.760141  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:34.760537  6587 raft_consensus.cc:3055] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:57:34.760753  6737 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.760910  6587 raft_consensus.cc:740] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:34.761741  6587 consensus_queue.cc:260] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:34.762811  6587 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.767086  6737 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.768107  6629 leader_election.cc:304] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:34.768106  6587 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.769174  6951 raft_consensus.cc:2804] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:57:34.769654  6951 raft_consensus.cc:697] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:34.770496  6951 consensus_queue.cc:237] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:34.778558  6943 raft_consensus.cc:993] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.777910  6484 catalog_manager.cc:5671] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 2 to 3, leader changed from 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 3 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:34.779273  6949 raft_consensus.cc:1081] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.781080  6663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38806
I20260501 13:57:34.781602  6663 raft_consensus.cc:493] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:34.781957  6663 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.788065  6663 raft_consensus.cc:515] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.789570  6663 leader_election.cc:290] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:34.790328  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:34.790725  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:34.790922  6587 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.791276  6737 raft_consensus.cc:3055] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:57:34.791590  6737 raft_consensus.cc:740] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:34.792244  6737 consensus_queue.cc:260] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.793190  6737 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.795464  6587 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.796350  6629 leader_election.cc:304] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e; no voters: 
I20260501 13:57:34.797017  6951 raft_consensus.cc:2804] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:57:34.797533  6951 raft_consensus.cc:697] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:34.798429  6951 consensus_queue.cc:237] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.799579  6737 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.806488  6484 catalog_manager.cc:5671] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 2 to 3, leader changed from 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 3 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:34.942786  6944 raft_consensus.cc:993] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: : Instructing follower 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.943276  6950 raft_consensus.cc:1081] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Signalling peer 06b335c44fe04b09af02ed7f13773ac6 to start an election
I20260501 13:57:34.944754  6663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
 from {username='slave'} at 127.0.0.1:38810
I20260501 13:57:34.945313  6663 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:34.945628  6663 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.951011  6663 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.952597  6663 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:34.953701  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:34.953824  6737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "06b335c44fe04b09af02ed7f13773ac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:34.954172  6587 raft_consensus.cc:3055] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:57:34.954418  6737 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.954557  6587 raft_consensus.cc:740] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:34.955260  6587 consensus_queue.cc:260] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.956212  6587 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:34.959501  6737 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.960500  6629 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b335c44fe04b09af02ed7f13773ac6, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:34.960994  6587 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06b335c44fe04b09af02ed7f13773ac6 in term 3.
I20260501 13:57:34.961181  6951 raft_consensus.cc:2804] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:57:34.961701  6951 raft_consensus.cc:697] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Leader. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:34.962469  6951 consensus_queue.cc:237] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:34.970014  6484 catalog_manager.cc:5671] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 reported cstate change: term changed from 2 to 3, leader changed from 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129) to 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130). New cstate: current_term: 3 leader_uuid: "06b335c44fe04b09af02ed7f13773ac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:34.997359  6737 raft_consensus.cc:1275] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:34.998692  6951 consensus_queue.cc:1048] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:57:35.009196  6587 raft_consensus.cc:1275] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.010818  6952 consensus_queue.cc:1048] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:57:35.031792  6587 raft_consensus.cc:1275] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:35.033175  6952 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:35.042455  6737 raft_consensus.cc:1275] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:35.043792  6952 consensus_queue.cc:1048] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:35.224620  6587 raft_consensus.cc:1275] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.225939  6952 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:57:35.234879  6737 raft_consensus.cc:1275] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.237394  6952 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:57:35.307256  6587 raft_consensus.cc:1275] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.308966  6952 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:57:35.363515  6737 raft_consensus.cc:1275] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.367301  6589 raft_consensus.cc:1275] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.366853  6952 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:57:35.368830  6951 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:57:35.383392  6737 raft_consensus.cc:1275] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Refusing update from remote peer 06b335c44fe04b09af02ed7f13773ac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:35.385586  6975 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:57:37.548465  6454 auto_leader_rebalancer-test.cc:306] The leader distribution is 
I20260501 13:57:37.549250  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:37.556157  6663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:38676
I20260501 13:57:37.556804  6663 raft_consensus.cc:606] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Received request to transfer leadership to TS 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:37.559226  6663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:38676
I20260501 13:57:37.559727  6663 raft_consensus.cc:606] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Received request to transfer leadership to TS 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:37.561882  6663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443f08c684b940b49efea7861f24de8e"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:38676
I20260501 13:57:37.562342  6663 raft_consensus.cc:606] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Received request to transfer leadership to TS 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:37.564450  6663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:38676
I20260501 13:57:37.564903  6663 raft_consensus.cc:606] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Received request to transfer leadership to TS 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:37.567126  6663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab"
dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
mode: GRACEFUL
new_leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:38676
I20260501 13:57:37.567605  6663 raft_consensus.cc:606] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Received request to transfer leadership to TS 9dfa9a3ce91449e2ba3750b38ac703b1
I20260501 13:57:37.568547  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:57:37.569051  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:37.738934  6978 raft_consensus.cc:993] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:37.739449  6975 raft_consensus.cc:1081] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Signalling peer 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:37.741034  6736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "443f08c684b940b49efea7861f24de8e"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:53984
I20260501 13:57:37.741717  6736 raft_consensus.cc:493] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:37.742013  6736 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:37.746428  6736 raft_consensus.cc:515] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.748263  6736 leader_election.cc:290] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:37.749478  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:37.749469  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443f08c684b940b49efea7861f24de8e" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:37.750330  6663 raft_consensus.cc:3055] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:57:37.750447  6587 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:37.750742  6663 raft_consensus.cc:740] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:37.751591  6663 consensus_queue.cc:260] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.752986  6663 raft_consensus.cc:3060] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:57:37.758286  6587 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 3.
I20260501 13:57:37.759857  6703 leader_election.cc:304] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:37.760540  6663 raft_consensus.cc:2468] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 3.
I20260501 13:57:37.760727  6979 raft_consensus.cc:2804] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:57:37.762040  6979 raft_consensus.cc:697] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:37.763025  6979 consensus_queue.cc:237] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.769505  6484 catalog_manager.cc:5671] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 2 to 3, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 3 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:37.902410  6978 raft_consensus.cc:993] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:37.903026  6975 raft_consensus.cc:1081] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Signalling peer 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:37.904821  6587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:54460
I20260501 13:57:37.905332  6587 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:37.905639  6587 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.910164  6587 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.912175  6587 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 4 election: Requested vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:37.913028  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:37.913401  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:37.913740  6663 raft_consensus.cc:3055] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:57:37.913868  6736 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.914047  6663 raft_consensus.cc:740] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:37.914825  6663 consensus_queue.cc:260] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.916013  6663 raft_consensus.cc:3060] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.920253  6736 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 4.
I20260501 13:57:37.921653  6554 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:37.922279  6663 raft_consensus.cc:2468] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 4.
I20260501 13:57:37.923580  6986 raft_consensus.cc:2804] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:57:37.924870  6986 raft_consensus.cc:697] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:37.925791  6986 consensus_queue.cc:237] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.933068  6484 catalog_manager.cc:5671] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 3 to 4, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 4 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:37.942665  6978 raft_consensus.cc:993] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:37.943085  6975 raft_consensus.cc:1081] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Signalling peer 9dfa9a3ce91449e2ba3750b38ac703b1 to start an election
I20260501 13:57:37.944608  6736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab"
dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
 from {username='slave'} at 127.0.0.1:53984
I20260501 13:57:37.945050  6736 raft_consensus.cc:493] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:37.945324  6736 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.947588  6978 raft_consensus.cc:993] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:37.948060  6978 raft_consensus.cc:1081] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Signalling peer 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:37.949498  6587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:54460
I20260501 13:57:37.949998  6587 raft_consensus.cc:493] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:37.950255  6587 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.950469  6736 raft_consensus.cc:515] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.951993  6736 leader_election.cc:290] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:37.952956  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
I20260501 13:57:37.953034  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94c0d6fd0fe4a179c22128bb6725dab" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:37.953604  6589 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.953670  6663 raft_consensus.cc:3055] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:57:37.954257  6663 raft_consensus.cc:740] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:37.955005  6663 consensus_queue.cc:260] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.956247  6663 raft_consensus.cc:3060] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.958137  6587 raft_consensus.cc:515] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:37.960724  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:37.961289  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbde4b2586f48d28c5c7c77c0438b7f" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:37.961419  6587 leader_election.cc:290] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 4 election: Requested vote from peers 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:37.961426  6736 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.961969  6662 raft_consensus.cc:3055] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:57:37.962337  6662 raft_consensus.cc:740] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:37.962869  6663 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 4.
I20260501 13:57:37.961279  6589 raft_consensus.cc:2468] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dfa9a3ce91449e2ba3750b38ac703b1 in term 4.
I20260501 13:57:37.963078  6662 consensus_queue.cc:260] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:37.964423  6662 raft_consensus.cc:3060] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:57:37.964471  6703 leader_election.cc:304] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:37.965605  6979 raft_consensus.cc:2804] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:57:37.966029  6979 raft_consensus.cc:697] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 LEADER]: Becoming Leader. State: Replica: 9dfa9a3ce91449e2ba3750b38ac703b1, State: Running, Role: LEADER
I20260501 13:57:37.966821  6979 consensus_queue.cc:237] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.968945  6736 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 4.
I20260501 13:57:37.969992  6554 leader_election.cc:304] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:37.970964  6986 raft_consensus.cc:2804] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:57:37.971251  6662 raft_consensus.cc:2468] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 4.
I20260501 13:57:37.971499  6986 raft_consensus.cc:697] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 4 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:37.972469  6986 consensus_queue.cc:237] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } }
I20260501 13:57:37.975241  6484 catalog_manager.cc:5671] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 reported cstate change: term changed from 3 to 4, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131). New cstate: current_term: 4 leader_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:37.979491  6483 catalog_manager.cc:5671] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 3 to 4, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 4 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:37.987957  6975 raft_consensus.cc:993] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: : Instructing follower 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:37.988551  6978 raft_consensus.cc:1081] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Signalling peer 8ca6b65cd176431bac9e086a1c5b254e to start an election
I20260501 13:57:37.989905  6589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75"
dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e"
 from {username='slave'} at 127.0.0.1:54460
I20260501 13:57:37.990379  6589 raft_consensus.cc:493] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:37.990679  6589 raft_consensus.cc:3060] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:37.995366  6589 raft_consensus.cc:515] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:37.996963  6589 leader_election.cc:290] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Requested vote from peers 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827), 9dfa9a3ce91449e2ba3750b38ac703b1 (127.6.77.131:43153)
I20260501 13:57:37.997943  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06b335c44fe04b09af02ed7f13773ac6"
I20260501 13:57:37.998131  6736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b935708d7e4a35b39767fa13cf0c75" candidate_uuid: "8ca6b65cd176431bac9e086a1c5b254e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1"
I20260501 13:57:37.998610  6736 raft_consensus.cc:3060] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:37.998610  6662 raft_consensus.cc:3055] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:37.999212  6662 raft_consensus.cc:740] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06b335c44fe04b09af02ed7f13773ac6, State: Running, Role: LEADER
I20260501 13:57:38.000039  6662 consensus_queue.cc:260] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:38.001250  6662 raft_consensus.cc:3060] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:38.006094  6736 raft_consensus.cc:2468] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:38.007314  6554 leader_election.cc:304] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca6b65cd176431bac9e086a1c5b254e, 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 
I20260501 13:57:38.007880  6662 raft_consensus.cc:2468] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca6b65cd176431bac9e086a1c5b254e in term 2.
I20260501 13:57:38.008323  6986 raft_consensus.cc:2804] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:38.008905  6986 raft_consensus.cc:697] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Becoming Leader. State: Replica: 8ca6b65cd176431bac9e086a1c5b254e, State: Running, Role: LEADER
I20260501 13:57:38.009800  6986 consensus_queue.cc:237] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:38.017670  6483 catalog_manager.cc:5671] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e reported cstate change: term changed from 1 to 2, leader changed from 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130) to 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129). New cstate: current_term: 2 leader_uuid: "8ca6b65cd176431bac9e086a1c5b254e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:38.265770  6589 raft_consensus.cc:1275] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:38.267244  6979 consensus_queue.cc:1048] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:57:38.280283  6662 raft_consensus.cc:1275] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:57:38.282212  6995 consensus_queue.cc:1048] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:57:38.339557  6662 raft_consensus.cc:1275] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:38.340787  6986 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:38.350100  6736 raft_consensus.cc:1275] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:38.351483  6986 consensus_queue.cc:1048] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:57:38.360297  6662 raft_consensus.cc:1275] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:38.361495  6995 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:38.376083  6589 raft_consensus.cc:1275] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Refusing update from remote peer 9dfa9a3ce91449e2ba3750b38ac703b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:38.377501  6995 consensus_queue.cc:1048] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:38.427703  6736 raft_consensus.cc:1275] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:38.428998  6986 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:38.438191  6662 raft_consensus.cc:1275] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:57:38.439630  6986 consensus_queue.cc:1048] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:57:38.471915  6736 raft_consensus.cc:1275] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:38.473347  6986 consensus_queue.cc:1048] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:38.482887  6662 raft_consensus.cc:1275] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Refusing update from remote peer 8ca6b65cd176431bac9e086a1c5b254e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:38.484138  6986 consensus_queue.cc:1048] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:38.570220  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:38.575011  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:38.575330  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:39.845168  7007 raft_consensus.cc:493] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 06b335c44fe04b09af02ed7f13773ac6)
I20260501 13:57:39.845992  7007 raft_consensus.cc:515] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:39.849026  7007 leader_election.cc:290] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:39.850657  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:39.854997  7007 raft_consensus.cc:493] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8ca6b65cd176431bac9e086a1c5b254e)
I20260501 13:57:39.855844  7007 raft_consensus.cc:515] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:39.858443  7007 leader_election.cc:290] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:39.859675  6662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:39.908855  7007 raft_consensus.cc:493] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06b335c44fe04b09af02ed7f13773ac6)
I20260501 13:57:39.909516  7007 raft_consensus.cc:515] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca6b65cd176431bac9e086a1c5b254e" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37899 } } peers { permanent_uuid: "06b335c44fe04b09af02ed7f13773ac6" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 32827 } } peers { permanent_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 43153 } }
I20260501 13:57:39.910882  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f948de6567404c3ea3624362fb5c3ab2" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:39.911486  6588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f8628df7d347fb8081def3dd250cb5" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:39.911563  7007 leader_election.cc:290] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899), 06b335c44fe04b09af02ed7f13773ac6 (127.6.77.130:32827)
I20260501 13:57:39.913692  6663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "06b335c44fe04b09af02ed7f13773ac6" is_pre_election: true
I20260501 13:57:39.919350  6589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e20f83fd5644349ce6bfd9a4f41444" candidate_uuid: "9dfa9a3ce91449e2ba3750b38ac703b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ca6b65cd176431bac9e086a1c5b254e" is_pre_election: true
I20260501 13:57:39.922406  6703 leader_election.cc:304] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:39.923498  6703 leader_election.cc:304] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:39.923547  7017 raft_consensus.cc:2749] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:57:39.924263  7007 raft_consensus.cc:2749] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:57:39.925149  6703 leader_election.cc:304] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dfa9a3ce91449e2ba3750b38ac703b1; no voters: 06b335c44fe04b09af02ed7f13773ac6, 8ca6b65cd176431bac9e086a1c5b254e
I20260501 13:57:39.925812  7017 raft_consensus.cc:2749] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:57:40.355906  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:40.361204  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:40.361624  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260501 13:57:40.685168  6759 debug-util.cc:398] Leaking SignalData structure 0x7b080016b060 after lost signal to thread 6457
W20260501 13:57:40.686002  6759 debug-util.cc:398] Leaking SignalData structure 0x7b080016b740 after lost signal to thread 6520
W20260501 13:57:40.686857  6759 debug-util.cc:398] Leaking SignalData structure 0x7b0800081400 after lost signal to thread 6613
W20260501 13:57:40.687605  6759 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2300 after lost signal to thread 6688
W20260501 13:57:40.688357  6759 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3fa0 after lost signal to thread 6762
I20260501 13:57:41.362562  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:41.367666  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:41.368127  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:42.369139  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:42.374857  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:42.375447  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:43.376837  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:43.382232  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:43.382654  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:44.383755  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:44.388722  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:44.389183  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:45.402321  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:45.414821  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:45.415282  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:46.416553  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:46.421314  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:46.421653  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:47.422768  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:47.427793  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:47.428304  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:48.457175  6454 auto_leader_rebalancer-test.cc:318] The leader distribution is 
I20260501 13:57:48.457685  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
W20260501 13:57:48.491685  6703 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 13:57:48.496800  6703 consensus_peers.cc:597] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 -> Peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Couldn't send request to peer 8ca6b65cd176431bac9e086a1c5b254e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:57:48.498152  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 13:57:48.499040  6454 tablet_replica.cc:333] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.500136  6454 raft_consensus.cc:2243] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.501247  6454 raft_consensus.cc:2272] T 97b935708d7e4a35b39767fa13cf0c75 P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.504295  6454 tablet_replica.cc:333] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.504910  6454 raft_consensus.cc:2243] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.505414  6454 raft_consensus.cc:2272] T 11c1373722744925bbec561c62c3593e P 8ca6b65cd176431bac9e086a1c5b254e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.508267  6454 tablet_replica.cc:333] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.509186  6454 raft_consensus.cc:2243] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.509944  6454 raft_consensus.cc:2272] T f948de6567404c3ea3624362fb5c3ab2 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.512925  6454 tablet_replica.cc:333] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.513624  6454 raft_consensus.cc:2243] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.514290  6454 raft_consensus.cc:2272] T 31e20f83fd5644349ce6bfd9a4f41444 P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.516294  6454 tablet_replica.cc:333] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.516850  6454 raft_consensus.cc:2243] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.517395  6454 raft_consensus.cc:2272] T d94c0d6fd0fe4a179c22128bb6725dab P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.519374  6454 tablet_replica.cc:333] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.519949  6454 raft_consensus.cc:2243] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.520376  6454 raft_consensus.cc:2272] T 45a80771d3ff471fb685264b5b11ba6d P 8ca6b65cd176431bac9e086a1c5b254e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.522177  6454 tablet_replica.cc:333] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.522694  6454 raft_consensus.cc:2243] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.523352  6454 raft_consensus.cc:2272] T 443f08c684b940b49efea7861f24de8e P 8ca6b65cd176431bac9e086a1c5b254e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.525126  6454 tablet_replica.cc:333] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.525597  6454 raft_consensus.cc:2243] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.526410  6454 raft_consensus.cc:2272] T 0fbde4b2586f48d28c5c7c77c0438b7f P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.528394  6454 tablet_replica.cc:333] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e: stopping tablet replica
I20260501 13:57:48.528890  6454 raft_consensus.cc:2243] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.529731  6454 raft_consensus.cc:2272] T 30f8628df7d347fb8081def3dd250cb5 P 8ca6b65cd176431bac9e086a1c5b254e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.645259  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
W20260501 13:57:48.646550  6629 consensus_peers.cc:597] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 -> Peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Couldn't send request to peer 8ca6b65cd176431bac9e086a1c5b254e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 13:57:48.667659  6629 consensus_peers.cc:597] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 -> Peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Couldn't send request to peer 8ca6b65cd176431bac9e086a1c5b254e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 13:57:48.669489  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
I20260501 13:57:48.702309  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 13:57:48.703219  6454 tablet_replica.cc:333] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
W20260501 13:57:48.704087  6703 consensus_peers.cc:597] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 -> Peer 8ca6b65cd176431bac9e086a1c5b254e (127.6.77.129:37899): Couldn't send request to peer 8ca6b65cd176431bac9e086a1c5b254e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 13:57:48.704221  6454 raft_consensus.cc:2243] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.704963  6454 raft_consensus.cc:2272] T 97b935708d7e4a35b39767fa13cf0c75 P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.707407  6454 tablet_replica.cc:333] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.708072  6454 raft_consensus.cc:2243] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.708611  6454 raft_consensus.cc:2272] T 443f08c684b940b49efea7861f24de8e P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.710757  6454 tablet_replica.cc:333] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.711340  6454 raft_consensus.cc:2243] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.712270  6454 raft_consensus.cc:2272] T 45a80771d3ff471fb685264b5b11ba6d P 06b335c44fe04b09af02ed7f13773ac6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.714046  6454 tablet_replica.cc:333] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.714664  6454 raft_consensus.cc:2243] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.715111  6454 raft_consensus.cc:2272] T 0fbde4b2586f48d28c5c7c77c0438b7f P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.716905  6454 tablet_replica.cc:333] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.717407  6454 raft_consensus.cc:2243] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.717867  6454 raft_consensus.cc:2272] T 30f8628df7d347fb8081def3dd250cb5 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.719696  6454 tablet_replica.cc:333] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.720227  6454 raft_consensus.cc:2243] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.720654  6454 raft_consensus.cc:2272] T d94c0d6fd0fe4a179c22128bb6725dab P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.722299  6454 tablet_replica.cc:333] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.722806  6454 raft_consensus.cc:2243] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.723656  6454 raft_consensus.cc:2272] T 31e20f83fd5644349ce6bfd9a4f41444 P 06b335c44fe04b09af02ed7f13773ac6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.726565  6454 tablet_replica.cc:333] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.727141  6454 raft_consensus.cc:2243] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.728001  6454 raft_consensus.cc:2272] T f948de6567404c3ea3624362fb5c3ab2 P 06b335c44fe04b09af02ed7f13773ac6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.729691  6454 tablet_replica.cc:333] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6: stopping tablet replica
I20260501 13:57:48.730144  6454 raft_consensus.cc:2243] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.730525  6454 raft_consensus.cc:2272] T 11c1373722744925bbec561c62c3593e P 06b335c44fe04b09af02ed7f13773ac6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.760320  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
I20260501 13:57:48.778316  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
I20260501 13:57:48.807611  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 13:57:48.808436  6454 tablet_replica.cc:333] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.809530  6454 raft_consensus.cc:2243] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.810359  6454 raft_consensus.cc:2272] T 30f8628df7d347fb8081def3dd250cb5 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.812402  6454 tablet_replica.cc:333] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.812916  6454 raft_consensus.cc:2243] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.813302  6454 raft_consensus.cc:2272] T 97b935708d7e4a35b39767fa13cf0c75 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.814927  6454 tablet_replica.cc:333] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.815382  6454 raft_consensus.cc:2243] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.815766  6454 raft_consensus.cc:2272] T 0fbde4b2586f48d28c5c7c77c0438b7f P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.817428  6454 tablet_replica.cc:333] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.818027  6454 raft_consensus.cc:2243] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.818365  6454 raft_consensus.cc:2272] T 45a80771d3ff471fb685264b5b11ba6d P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.820096  6454 tablet_replica.cc:333] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.820624  6454 raft_consensus.cc:2243] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.821401  6454 raft_consensus.cc:2272] T 443f08c684b940b49efea7861f24de8e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.823048  6454 tablet_replica.cc:333] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.823477  6454 raft_consensus.cc:2243] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.824302  6454 raft_consensus.cc:2272] T 11c1373722744925bbec561c62c3593e P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.826007  6454 tablet_replica.cc:333] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.826448  6454 raft_consensus.cc:2243] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.826807  6454 raft_consensus.cc:2272] T f948de6567404c3ea3624362fb5c3ab2 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.828486  6454 tablet_replica.cc:333] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.828899  6454 raft_consensus.cc:2243] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:57:48.829604  6454 raft_consensus.cc:2272] T d94c0d6fd0fe4a179c22128bb6725dab P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.831161  6454 tablet_replica.cc:333] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1: stopping tablet replica
I20260501 13:57:48.831543  6454 raft_consensus.cc:2243] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:57:48.831920  6454 raft_consensus.cc:2272] T 31e20f83fd5644349ce6bfd9a4f41444 P 9dfa9a3ce91449e2ba3750b38ac703b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:48.877779  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 13:57:48.897697  6454 master.cc:562] Master@127.6.77.190:33267 shutting down...
I20260501 13:57:49.058229  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 1 LEADER]: Raft consensus shutting down.
I20260501 13:57:49.058920  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:57:49.059224  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P f101699255454153b2a4d08c030e6074: stopping tablet replica
I20260501 13:57:49.080646  6454 master.cc:584] Master@127.6.77.190:33267 shutdown complete.
06b335c44fe04b09af02ed7f13773ac6  4
8ca6b65cd176431bac9e086a1c5b254e  4
9dfa9a3ce91449e2ba3750b38ac703b1  1
06b335c44fe04b09af02ed7f13773ac6  3
8ca6b65cd176431bac9e086a1c5b254e  3
9dfa9a3ce91449e2ba3750b38ac703b1  3
06b335c44fe04b09af02ed7f13773ac6  8
8ca6b65cd176431bac9e086a1c5b254e  0
9dfa9a3ce91449e2ba3750b38ac703b1  1
06b335c44fe04b09af02ed7f13773ac6  3
8ca6b65cd176431bac9e086a1c5b254e  3
9dfa9a3ce91449e2ba3750b38ac703b1  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (33881 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260501 13:57:49.124250  6454 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.77.190:37365
I20260501 13:57:49.125515  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:49.131724  7034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.131989  7035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.133285  7037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:49.134199  6454 server_base.cc:1061] running on GCE node
I20260501 13:57:49.135159  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:49.135354  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:49.135529  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643869135514 us; error 0 us; skew 500 ppm
I20260501 13:57:49.136164  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:49.139012  6454 webserver.cc:492] Webserver started at http://127.6.77.190:44023/ using document root <none> and password file <none>
I20260501 13:57:49.139544  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:49.139734  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:49.140106  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:49.141454  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/master-0-root/instance:
uuid: "efd3ed5a7d134ac89ba98486aeb98353"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.146443  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260501 13:57:49.150177  7042 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.150947  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260501 13:57:49.151307  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/master-0-root
uuid: "efd3ed5a7d134ac89ba98486aeb98353"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.151590  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:49.161046  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:49.162335  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:49.206295  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.190:37365
I20260501 13:57:49.206435  7093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.190:37365 every 8 connection(s)
I20260501 13:57:49.210467  7094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.220047  7094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353: Bootstrap starting.
I20260501 13:57:49.224681  7094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:49.229313  7094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353: No bootstrap required, opened a new log
I20260501 13:57:49.231427  7094 raft_consensus.cc:359] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efd3ed5a7d134ac89ba98486aeb98353" member_type: VOTER }
I20260501 13:57:49.232009  7094 raft_consensus.cc:385] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:49.232223  7094 raft_consensus.cc:740] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd3ed5a7d134ac89ba98486aeb98353, State: Initialized, Role: FOLLOWER
I20260501 13:57:49.232656  7094 consensus_queue.cc:260] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efd3ed5a7d134ac89ba98486aeb98353" member_type: VOTER }
I20260501 13:57:49.233114  7094 raft_consensus.cc:399] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260501 13:57:49.233314  7094 raft_consensus.cc:493] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260501 13:57:49.233515  7094 raft_consensus.cc:3060] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:49.237340  7094 raft_consensus.cc:515] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efd3ed5a7d134ac89ba98486aeb98353" member_type: VOTER }
I20260501 13:57:49.237779  7094 leader_election.cc:304] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efd3ed5a7d134ac89ba98486aeb98353; no voters: 
I20260501 13:57:49.238849  7094 leader_election.cc:290] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260501 13:57:49.239387  7097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:49.240937  7097 raft_consensus.cc:697] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 1 LEADER]: Becoming Leader. State: Replica: efd3ed5a7d134ac89ba98486aeb98353, State: Running, Role: LEADER
I20260501 13:57:49.241729  7097 consensus_queue.cc:237] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efd3ed5a7d134ac89ba98486aeb98353" member_type: VOTER }
I20260501 13:57:49.241864  7094 sys_catalog.cc:565] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [sys.catalog]: configured and running, proceeding with master startup.
I20260501 13:57:49.249121  7098 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efd3ed5a7d134ac89ba98486aeb98353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efd3ed5a7d134ac89ba98486aeb98353" member_type: VOTER } }
I20260501 13:57:49.249071  7099 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efd3ed5a7d134ac89ba98486aeb98353. Latest consensus state: current_term: 1 leader_uuid: "efd3ed5a7d134ac89ba98486aeb98353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efd3ed5a7d134ac89ba98486aeb98353" member_type: VOTER } }
I20260501 13:57:49.249795  7098 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [sys.catalog]: This master's current role is: LEADER
I20260501 13:57:49.250029  7099 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [sys.catalog]: This master's current role is: LEADER
I20260501 13:57:49.252079  7106 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260501 13:57:49.257602  7106 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260501 13:57:49.259400  6454 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260501 13:57:49.267745  7106 catalog_manager.cc:1357] Generated new cluster ID: 1cd096c7659a433ca633dfbaa4b9e098
I20260501 13:57:49.268126  7106 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260501 13:57:49.288033  7106 catalog_manager.cc:1380] Generated new certificate authority record
I20260501 13:57:49.289350  7106 catalog_manager.cc:1514] Loading token signing keys...
I20260501 13:57:49.303592  7106 catalog_manager.cc:6044] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353: Generated new TSK 0
I20260501 13:57:49.304394  7106 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260501 13:57:49.326710  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:49.333612  7115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.335309  7116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.336881  7118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:49.338086  6454 server_base.cc:1061] running on GCE node
I20260501 13:57:49.339111  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:49.339313  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:49.339459  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643869339447 us; error 0 us; skew 500 ppm
I20260501 13:57:49.340046  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:49.342686  6454 webserver.cc:492] Webserver started at http://127.6.77.129:38131/ using document root <none> and password file <none>
I20260501 13:57:49.343155  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:49.343322  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:49.343566  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:49.344851  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-0-root/instance:
uuid: "6d8ae211b9584459ab383e642801be69"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.349665  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260501 13:57:49.353497  7123 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.354401  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260501 13:57:49.354709  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "6d8ae211b9584459ab383e642801be69"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.355026  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:49.373566  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:49.374944  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:49.376598  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:57:49.379006  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:57:49.379246  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.379508  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:57:49.379698  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.425490  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:45931
I20260501 13:57:49.425594  7185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:45931 every 8 connection(s)
I20260501 13:57:49.430369  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:49.438053  7190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.439249  7191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.441524  7193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:49.444897  6454 server_base.cc:1061] running on GCE node
I20260501 13:57:49.446302  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:49.446620  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:49.446844  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643869446819 us; error 0 us; skew 500 ppm
I20260501 13:57:49.447464  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:49.448223  7186 heartbeater.cc:344] Connected to a master server at 127.6.77.190:37365
I20260501 13:57:49.448662  7186 heartbeater.cc:461] Registering TS with master...
I20260501 13:57:49.449473  7186 heartbeater.cc:507] Master 127.6.77.190:37365 requested a full tablet report, sending...
I20260501 13:57:49.450436  6454 webserver.cc:492] Webserver started at http://127.6.77.130:45073/ using document root <none> and password file <none>
I20260501 13:57:49.451094  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:49.451303  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:49.451597  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:49.451886  7059 ts_manager.cc:194] Registered new tserver with Master: 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931)
I20260501 13:57:49.452970  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-1-root/instance:
uuid: "3f59eee95bae45828184f266524f0e6a"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.453979  7059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40826
I20260501 13:57:49.458252  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260501 13:57:49.461962  7198 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.462807  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260501 13:57:49.463230  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-1-root
uuid: "3f59eee95bae45828184f266524f0e6a"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.463553  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:49.478195  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:49.479576  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:49.481314  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:57:49.483655  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:57:49.483919  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260501 13:57:49.484171  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:57:49.484354  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.532239  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.130:34079
I20260501 13:57:49.532370  7260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.130:34079 every 8 connection(s)
I20260501 13:57:49.537338  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:57:49.545519  7264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:57:49.547562  7265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:49.551371  7261 heartbeater.cc:344] Connected to a master server at 127.6.77.190:37365
I20260501 13:57:49.551811  7261 heartbeater.cc:461] Registering TS with master...
I20260501 13:57:49.552155  6454 server_base.cc:1061] running on GCE node
W20260501 13:57:49.552238  7267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:57:49.552942  7261 heartbeater.cc:507] Master 127.6.77.190:37365 requested a full tablet report, sending...
I20260501 13:57:49.553560  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:57:49.553795  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:57:49.553993  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643869553961 us; error 0 us; skew 500 ppm
I20260501 13:57:49.554628  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:57:49.555213  7059 ts_manager.cc:194] Registered new tserver with Master: 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:49.556836  7059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40828
I20260501 13:57:49.557928  6454 webserver.cc:492] Webserver started at http://127.6.77.131:45767/ using document root <none> and password file <none>
I20260501 13:57:49.558506  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:57:49.558727  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:57:49.559019  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:57:49.560397  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-2-root/instance:
uuid: "178975541daa460c857a2d2995ccb56a"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.565327  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260501 13:57:49.568899  7272 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.569742  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260501 13:57:49.570075  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-2-root
uuid: "178975541daa460c857a2d2995ccb56a"
format_stamp: "Formatted at 2026-05-01 13:57:49 on dist-test-slave-1sft"
I20260501 13:57:49.570401  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777643835062054-6454-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:57:49.621021  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:57:49.622465  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:57:49.624253  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:57:49.626827  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:57:49.627081  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.627362  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:57:49.627542  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:57:49.676159  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.131:45035
I20260501 13:57:49.676280  7334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.131:45035 every 8 connection(s)
I20260501 13:57:49.690881  7335 heartbeater.cc:344] Connected to a master server at 127.6.77.190:37365
I20260501 13:57:49.691260  7335 heartbeater.cc:461] Registering TS with master...
I20260501 13:57:49.692061  7335 heartbeater.cc:507] Master 127.6.77.190:37365 requested a full tablet report, sending...
I20260501 13:57:49.693953  7059 ts_manager.cc:194] Registered new tserver with Master: 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:49.694341  6454 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014731324s
I20260501 13:57:49.695709  7059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40830
I20260501 13:57:49.722240  7059 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40846:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 13:57:49.725255  7059 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260501 13:57:49.805039  7147 tablet_service.cc:1511] Processing CreateTablet for tablet 6420220b679249c8b244b387453cde91 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260501 13:57:49.806726  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6420220b679249c8b244b387453cde91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.807071  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0f33eb23b84e1ca3ee6f32ace765da (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260501 13:57:49.808458  7300 tablet_service.cc:1511] Processing CreateTablet for tablet 87f49c7f51ef4ea3a4a58014a2e8be2c (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260501 13:57:49.808831  7297 tablet_service.cc:1511] Processing CreateTablet for tablet 87a9dfc4b1674a7785d62d3db380c9cf (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260501 13:57:49.809924  7300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f49c7f51ef4ea3a4a58014a2e8be2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.810645  7297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9dfc4b1674a7785d62d3db380c9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.811211  7148 tablet_service.cc:1511] Processing CreateTablet for tablet 87a9dfc4b1674a7785d62d3db380c9cf (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260501 13:57:49.812400  7299 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0f33eb23b84e1ca3ee6f32ace765da (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260501 13:57:49.813879  7299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0f33eb23b84e1ca3ee6f32ace765da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.815034  7298 tablet_service.cc:1511] Processing CreateTablet for tablet 16ef2a47f96046d1831bbaf8c3279469 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260501 13:57:49.816426  7298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ef2a47f96046d1831bbaf8c3279469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.809942  7149 tablet_service.cc:1511] Processing CreateTablet for tablet 16ef2a47f96046d1831bbaf8c3279469 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260501 13:57:49.805117  7151 tablet_service.cc:1511] Processing CreateTablet for tablet 87f49c7f51ef4ea3a4a58014a2e8be2c (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260501 13:57:49.824241  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9dfc4b1674a7785d62d3db380c9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.824548  7226 tablet_service.cc:1511] Processing CreateTablet for tablet 87f49c7f51ef4ea3a4a58014a2e8be2c (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260501 13:57:49.825899  7226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f49c7f51ef4ea3a4a58014a2e8be2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.829039  7225 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0f33eb23b84e1ca3ee6f32ace765da (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260501 13:57:49.830307  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0f33eb23b84e1ca3ee6f32ace765da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.831257  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0f33eb23b84e1ca3ee6f32ace765da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.832051  7224 tablet_service.cc:1511] Processing CreateTablet for tablet 16ef2a47f96046d1831bbaf8c3279469 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260501 13:57:49.833410  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ef2a47f96046d1831bbaf8c3279469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.836313  7151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f49c7f51ef4ea3a4a58014a2e8be2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.837191  7223 tablet_service.cc:1511] Processing CreateTablet for tablet 87a9dfc4b1674a7785d62d3db380c9cf (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260501 13:57:49.839002  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9dfc4b1674a7785d62d3db380c9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.840458  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ef2a47f96046d1831bbaf8c3279469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.869016  7222 tablet_service.cc:1511] Processing CreateTablet for tablet 6420220b679249c8b244b387453cde91 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260501 13:57:49.870428  7222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6420220b679249c8b244b387453cde91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.873339  7350 tablet_bootstrap.cc:492] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:49.884953  7299 tablet_service.cc:1511] Processing CreateTablet for tablet 6420220b679249c8b244b387453cde91 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260501 13:57:49.886308  7299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6420220b679249c8b244b387453cde91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.894680  7350 tablet_bootstrap.cc:654] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:49.901532  7146 tablet_service.cc:1511] Processing CreateTablet for tablet 67f08af800f64472bb999f24e9f2b67b (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260501 13:57:49.902863  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f08af800f64472bb999f24e9f2b67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.906221  7225 tablet_service.cc:1511] Processing CreateTablet for tablet 67f08af800f64472bb999f24e9f2b67b (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260501 13:57:49.907647  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f08af800f64472bb999f24e9f2b67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.909633  7297 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed835eddfa64365a64f26e4d9565e4a (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260501 13:57:49.909893  7223 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed835eddfa64365a64f26e4d9565e4a (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260501 13:57:49.910955  7297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed835eddfa64365a64f26e4d9565e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.911115  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed835eddfa64365a64f26e4d9565e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.913590  7224 tablet_service.cc:1511] Processing CreateTablet for tablet 98f4d5fd22044ee39abaaed7782dce52 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260501 13:57:49.913865  7300 tablet_service.cc:1511] Processing CreateTablet for tablet 98f4d5fd22044ee39abaaed7782dce52 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260501 13:57:49.914829  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f4d5fd22044ee39abaaed7782dce52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.914965  7300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f4d5fd22044ee39abaaed7782dce52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.916386  7145 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed835eddfa64365a64f26e4d9565e4a (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260501 13:57:49.917691  7145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed835eddfa64365a64f26e4d9565e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.922809  7221 tablet_service.cc:1511] Processing CreateTablet for tablet 08e9b52c2e434f0194ec2c36708f59be (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260501 13:57:49.924130  7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e9b52c2e434f0194ec2c36708f59be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.929428  7220 tablet_service.cc:1511] Processing CreateTablet for tablet 6be1aca9ab3f400190daa1b72b757f73 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260501 13:57:49.930192  7296 tablet_service.cc:1511] Processing CreateTablet for tablet 08e9b52c2e434f0194ec2c36708f59be (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260501 13:57:49.930949  7220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be1aca9ab3f400190daa1b72b757f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.931582  7296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e9b52c2e434f0194ec2c36708f59be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.933063  7295 tablet_service.cc:1511] Processing CreateTablet for tablet 6be1aca9ab3f400190daa1b72b757f73 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260501 13:57:49.940582  7295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be1aca9ab3f400190daa1b72b757f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.942382  7353 tablet_bootstrap.cc:492] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:49.951938  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 6be1aca9ab3f400190daa1b72b757f73 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260501 13:57:49.953392  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be1aca9ab3f400190daa1b72b757f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.953732  7147 tablet_service.cc:1511] Processing CreateTablet for tablet 98f4d5fd22044ee39abaaed7782dce52 (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260501 13:57:49.955109  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f4d5fd22044ee39abaaed7782dce52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.956666  7298 tablet_service.cc:1511] Processing CreateTablet for tablet 67f08af800f64472bb999f24e9f2b67b (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260501 13:57:49.958029  7351 tablet_bootstrap.cc:492] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:49.959262  7149 tablet_service.cc:1511] Processing CreateTablet for tablet 08e9b52c2e434f0194ec2c36708f59be (DEFAULT_TABLE table=test-workload [id=c11409943abf45c997f3d3fb3bf1f9eb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260501 13:57:49.972791  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e9b52c2e434f0194ec2c36708f59be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.966403  7298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f08af800f64472bb999f24e9f2b67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:57:49.978978  7350 tablet_bootstrap.cc:492] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:49.979302  7353 tablet_bootstrap.cc:654] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:49.979540  7350 ts_tablet_manager.cc:1403] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.005s
I20260501 13:57:49.982817  7350 raft_consensus.cc:359] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:49.983570  7350 raft_consensus.cc:385] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:49.984153  7350 raft_consensus.cc:740] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:49.985121  7350 consensus_queue.cc:260] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:49.989511  7351 tablet_bootstrap.cc:654] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.008518  7355 raft_consensus.cc:493] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.008671  7335 heartbeater.cc:499] Master 127.6.77.190:37365 was elected leader, sending a full tablet report...
I20260501 13:57:50.016208  7355 raft_consensus.cc:515] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.039057  7350 ts_tablet_manager.cc:1434] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.009s
I20260501 13:57:50.040405  7350 tablet_bootstrap.cc:492] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.047941  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
W20260501 13:57:50.050268  7273 leader_election.cc:343] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.057396  7355 leader_election.cc:290] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.089627  7350 tablet_bootstrap.cc:654] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.092027  7353 tablet_bootstrap.cc:492] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.092553  7353 ts_tablet_manager.cc:1403] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.151s	user 0.019s	sys 0.018s
W20260501 13:57:50.186546  7336 tablet.cc:2404] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260501 13:57:50.271239  7353 raft_consensus.cc:359] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.272476  7353 raft_consensus.cc:385] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.272887  7353 raft_consensus.cc:740] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.273742  7353 consensus_queue.cc:260] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.274719  7350 tablet_bootstrap.cc:492] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.275241  7350 ts_tablet_manager.cc:1403] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.235s	user 0.020s	sys 0.008s
I20260501 13:57:50.276786  7353 ts_tablet_manager.cc:1434] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.184s	user 0.008s	sys 0.001s
I20260501 13:57:50.277772  7353 tablet_bootstrap.cc:492] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.278914  7350 raft_consensus.cc:359] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.279695  7350 raft_consensus.cc:385] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.280349  7350 raft_consensus.cc:740] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.281355  7350 consensus_queue.cc:260] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.283761  7350 ts_tablet_manager.cc:1434] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260501 13:57:50.284646  7353 tablet_bootstrap.cc:654] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.284868  7350 tablet_bootstrap.cc:492] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.294106  7350 tablet_bootstrap.cc:654] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.302124  7350 tablet_bootstrap.cc:492] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.302685  7350 ts_tablet_manager.cc:1403] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260501 13:57:50.304260  7353 tablet_bootstrap.cc:492] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.304752  7353 ts_tablet_manager.cc:1403] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.007s
I20260501 13:57:50.305822  7350 raft_consensus.cc:359] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.306602  7350 raft_consensus.cc:385] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.306917  7350 raft_consensus.cc:740] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.307250  7353 raft_consensus.cc:359] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.307971  7353 raft_consensus.cc:385] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.307646  7350 consensus_queue.cc:260] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.308372  7353 raft_consensus.cc:740] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.309347  7353 consensus_queue.cc:260] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.310026  7350 ts_tablet_manager.cc:1434] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 13:57:50.311225  7350 tablet_bootstrap.cc:492] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.311625  7353 ts_tablet_manager.cc:1434] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 13:57:50.312494  7353 tablet_bootstrap.cc:492] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.315141  7186 heartbeater.cc:499] Master 127.6.77.190:37365 was elected leader, sending a full tablet report...
I20260501 13:57:50.317699  7350 tablet_bootstrap.cc:654] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.318591  7353 tablet_bootstrap.cc:654] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.326819  7350 tablet_bootstrap.cc:492] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.327418  7350 ts_tablet_manager.cc:1403] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.003s
I20260501 13:57:50.330999  7350 raft_consensus.cc:359] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.331761  7350 raft_consensus.cc:385] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.332118  7350 raft_consensus.cc:740] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.332940  7350 consensus_queue.cc:260] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.334352  7353 tablet_bootstrap.cc:492] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.334926  7353 ts_tablet_manager.cc:1403] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260501 13:57:50.335359  7350 ts_tablet_manager.cc:1434] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260501 13:57:50.336501  7350 tablet_bootstrap.cc:492] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.338184  7353 raft_consensus.cc:359] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.339013  7353 raft_consensus.cc:385] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.339962  7353 raft_consensus.cc:740] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.341621  7353 consensus_queue.cc:260] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.343765  7350 tablet_bootstrap.cc:654] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.345163  7353 ts_tablet_manager.cc:1434] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260501 13:57:50.346465  7353 tablet_bootstrap.cc:492] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.350287  7350 tablet_bootstrap.cc:492] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.351218  7350 ts_tablet_manager.cc:1403] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260501 13:57:50.352645  7353 tablet_bootstrap.cc:654] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.354832  7350 raft_consensus.cc:359] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.355685  7350 raft_consensus.cc:385] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.356072  7350 raft_consensus.cc:740] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.356864  7350 consensus_queue.cc:260] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.357931  7353 tablet_bootstrap.cc:492] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.358492  7353 ts_tablet_manager.cc:1403] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260501 13:57:50.359118  7350 ts_tablet_manager.cc:1434] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260501 13:57:50.360006  7350 tablet_bootstrap.cc:492] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.361644  7353 raft_consensus.cc:359] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.362377  7353 raft_consensus.cc:385] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.362653  7353 raft_consensus.cc:740] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.363247  7353 consensus_queue.cc:260] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.365092  7350 tablet_bootstrap.cc:654] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.365285  7353 ts_tablet_manager.cc:1434] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260501 13:57:50.366061  7353 tablet_bootstrap.cc:492] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.372087  7353 tablet_bootstrap.cc:654] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.376885  7350 tablet_bootstrap.cc:492] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.377465  7350 ts_tablet_manager.cc:1403] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260501 13:57:50.380692  7350 raft_consensus.cc:359] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.381493  7350 raft_consensus.cc:385] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.381841  7350 raft_consensus.cc:740] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.382702  7350 consensus_queue.cc:260] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.384294  7353 tablet_bootstrap.cc:492] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
W20260501 13:57:50.384825  7107 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:57:50.385386  7350 ts_tablet_manager.cc:1434] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 13:57:50.384832  7353 ts_tablet_manager.cc:1403] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260501 13:57:50.386466  7350 tablet_bootstrap.cc:492] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.388928  7353 raft_consensus.cc:359] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.389760  7353 raft_consensus.cc:385] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.390113  7353 raft_consensus.cc:740] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.390894  7353 consensus_queue.cc:260] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.393215  7353 ts_tablet_manager.cc:1434] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260501 13:57:50.393673  7350 tablet_bootstrap.cc:654] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.394299  7353 tablet_bootstrap.cc:492] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.400609  7350 tablet_bootstrap.cc:492] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.401161  7350 ts_tablet_manager.cc:1403] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260501 13:57:50.402069  7353 tablet_bootstrap.cc:654] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.404541  7350 raft_consensus.cc:359] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.405421  7350 raft_consensus.cc:385] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.405810  7350 raft_consensus.cc:740] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.406766  7350 consensus_queue.cc:260] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.409749  7350 ts_tablet_manager.cc:1434] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:57:50.410831  7350 tablet_bootstrap.cc:492] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.411229  7353 tablet_bootstrap.cc:492] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.411774  7353 ts_tablet_manager.cc:1403] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260501 13:57:50.412257  7351 tablet_bootstrap.cc:492] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.412725  7351 ts_tablet_manager.cc:1403] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.455s	user 0.036s	sys 0.038s
I20260501 13:57:50.413192  7359 raft_consensus.cc:493] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.413697  7359 raft_consensus.cc:515] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.414783  7353 raft_consensus.cc:359] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.415550  7353 raft_consensus.cc:385] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.415892  7353 raft_consensus.cc:740] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.416601  7353 consensus_queue.cc:260] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.417749  7350 tablet_bootstrap.cc:654] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.418731  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.420545  7359 leader_election.cc:290] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.424719  7357 raft_consensus.cc:493] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.425359  7357 raft_consensus.cc:515] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.415444  7351 raft_consensus.cc:359] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.437952  7351 raft_consensus.cc:385] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.438416  7351 raft_consensus.cc:740] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.430347  7357 leader_election.cc:290] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.439049  7351 consensus_queue.cc:260] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
W20260501 13:57:50.459934  7275 leader_election.cc:343] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.460482  7275 leader_election.cc:304] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178975541daa460c857a2d2995ccb56a; no voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:50.460879  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
W20260501 13:57:50.467475  7275 leader_election.cc:343] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.503284  7353 ts_tablet_manager.cc:1434] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.037s
I20260501 13:57:50.504557  7353 tablet_bootstrap.cc:492] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.504663  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.506148  7357 raft_consensus.cc:2749] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 13:57:50.506321  7126 leader_election.cc:343] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.512153  7353 tablet_bootstrap.cc:654] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.512899  7261 heartbeater.cc:499] Master 127.6.77.190:37365 was elected leader, sending a full tablet report...
I20260501 13:57:50.513700  7371 raft_consensus.cc:493] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.514175  7371 raft_consensus.cc:515] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.518108  7351 ts_tablet_manager.cc:1434] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.007s
I20260501 13:57:50.519114  7351 tablet_bootstrap.cc:492] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.520045  7357 raft_consensus.cc:493] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.520542  7357 raft_consensus.cc:515] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.521968  7357 leader_election.cc:290] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.522818  7353 tablet_bootstrap.cc:492] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.523470  7353 ts_tablet_manager.cc:1403] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260501 13:57:50.524243  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
W20260501 13:57:50.525652  7275 leader_election.cc:343] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.526437  7371 leader_election.cc:290] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.528795  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:50.529557  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.529959  7309 raft_consensus.cc:2468] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 0.
I20260501 13:57:50.530149  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.527638  7353 raft_consensus.cc:359] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.529052  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.529161  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
W20260501 13:57:50.531577  7126 leader_election.cc:343] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.531714  7310 raft_consensus.cc:2468] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 0.
I20260501 13:57:50.532621  7353 raft_consensus.cc:385] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.533049  7353 raft_consensus.cc:740] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.533893  7351 tablet_bootstrap.cc:654] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.533948  7350 tablet_bootstrap.cc:492] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.533980  7353 consensus_queue.cc:260] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.534765  7350 ts_tablet_manager.cc:1403] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.011s
I20260501 13:57:50.535261  7161 raft_consensus.cc:2468] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 0.
I20260501 13:57:50.536501  7125 leader_election.cc:304] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.537871  7371 raft_consensus.cc:2804] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.538264  7371 raft_consensus.cc:493] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.538692  7371 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.538081  7350 raft_consensus.cc:359] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.539113  7350 raft_consensus.cc:385] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.539496  7350 raft_consensus.cc:740] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.540349  7350 consensus_queue.cc:260] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.541905  7355 raft_consensus.cc:493] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.542518  7355 raft_consensus.cc:515] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
W20260501 13:57:50.544631  7273 leader_election.cc:343] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.545172  7273 leader_election.cc:304] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178975541daa460c857a2d2995ccb56a; no voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:50.546403  7125 leader_election.cc:304] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.546693  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.547284  7359 raft_consensus.cc:2804] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.547717  7359 raft_consensus.cc:493] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.548085  7359 raft_consensus.cc:3060] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:57:50.548470  7275 leader_election.cc:343] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.549206  7355 leader_election.cc:290] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.550169  7355 raft_consensus.cc:2749] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:50.553226  7350 ts_tablet_manager.cc:1434] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260501 13:57:50.554672  7350 tablet_bootstrap.cc:492] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.563426  7350 tablet_bootstrap.cc:654] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.564359  7353 ts_tablet_manager.cc:1434] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260501 13:57:50.565616  7353 tablet_bootstrap.cc:492] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.565620  7359 raft_consensus.cc:515] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.573076  7353 tablet_bootstrap.cc:654] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.573333  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
W20260501 13:57:50.574802  7126 leader_election.cc:343] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.575362  7350 tablet_bootstrap.cc:492] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.575994  7350 ts_tablet_manager.cc:1403] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260501 13:57:50.580133  7350 raft_consensus.cc:359] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.581130  7350 raft_consensus.cc:385] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.581555  7350 raft_consensus.cc:740] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.582528  7350 consensus_queue.cc:260] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.584860  7353 tablet_bootstrap.cc:492] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.585454  7353 ts_tablet_manager.cc:1403] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260501 13:57:50.585939  7350 ts_tablet_manager.cc:1434] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260501 13:57:50.583089  7273 leader_election.cc:304] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.587148  7350 tablet_bootstrap.cc:492] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a: Bootstrap starting.
I20260501 13:57:50.587855  7357 raft_consensus.cc:2804] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.588234  7357 raft_consensus.cc:493] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.588555  7357 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.563292  7371 raft_consensus.cc:515] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.593307  7353 raft_consensus.cc:359] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.594033  7353 raft_consensus.cc:385] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.594334  7353 raft_consensus.cc:740] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.594993  7353 consensus_queue.cc:260] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.595466  7371 leader_election.cc:290] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.597123  7353 ts_tablet_manager.cc:1434] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260501 13:57:50.597390  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.599088  7355 raft_consensus.cc:493] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.599491  7161 raft_consensus.cc:2393] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178975541daa460c857a2d2995ccb56a in current term 1: Already voted for candidate 6d8ae211b9584459ab383e642801be69 in this term.
I20260501 13:57:50.599833  7353 tablet_bootstrap.cc:492] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.599561  7355 raft_consensus.cc:515] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.601400  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:50.601763  7273 leader_election.cc:304] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178975541daa460c857a2d2995ccb56a; no voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:50.601987  7310 raft_consensus.cc:3060] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.603778  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.603789  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.604478  7161 raft_consensus.cc:2468] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 0.
I20260501 13:57:50.605759  7273 leader_election.cc:304] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:50.606158  7355 leader_election.cc:290] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.598284  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
W20260501 13:57:50.606961  7275 leader_election.cc:343] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.608289  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a"
W20260501 13:57:50.608413  7126 leader_election.cc:343] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.608929  7309 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.610050  7357 raft_consensus.cc:515] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.597779  7350 tablet_bootstrap.cc:654] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.583668  7359 leader_election.cc:290] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.614995  7378 raft_consensus.cc:2804] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.615494  7378 raft_consensus.cc:493] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.615964  7378 raft_consensus.cc:3060] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.623582  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:50.624308  7161 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.624343  7359 raft_consensus.cc:493] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.624938  7359 raft_consensus.cc:515] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.626900  7309 raft_consensus.cc:2468] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.627993  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
W20260501 13:57:50.629305  7126 leader_election.cc:343] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.629910  7310 raft_consensus.cc:2468] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.630482  7355 raft_consensus.cc:2749] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:50.630231  7359 leader_election.cc:290] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.633708  7161 raft_consensus.cc:2468] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 1.
I20260501 13:57:50.635262  7125 leader_election.cc:304] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.636270  7359 raft_consensus.cc:2804] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.636932  7357 leader_election.cc:290] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.637938  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.638535  7353 tablet_bootstrap.cc:654] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.639868  7359 raft_consensus.cc:697] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:50.640841  7359 consensus_queue.cc:237] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.645025  7378 raft_consensus.cc:515] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.638041  7273 leader_election.cc:304] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
W20260501 13:57:50.646548  7275 leader_election.cc:343] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.647423  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:50.648044  7357 raft_consensus.cc:2804] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.648406  7310 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 0.
I20260501 13:57:50.647889  7353 tablet_bootstrap.cc:492] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.645651  7351 tablet_bootstrap.cc:492] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.647497  7125 leader_election.cc:304] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.649317  7353 ts_tablet_manager.cc:1403] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.002s
I20260501 13:57:50.649600  7351 ts_tablet_manager.cc:1403] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.131s	user 0.038s	sys 0.046s
I20260501 13:57:50.650005  7371 raft_consensus.cc:2804] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.650477  7371 raft_consensus.cc:697] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:50.651221  7371 consensus_queue.cc:237] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.652218  7353 raft_consensus.cc:359] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.652495  7351 raft_consensus.cc:359] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.652927  7353 raft_consensus.cc:385] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.645596  7350 tablet_bootstrap.cc:492] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a: No bootstrap required, opened a new log
I20260501 13:57:50.653290  7351 raft_consensus.cc:385] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.653434  7378 leader_election.cc:290] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.654109  7351 raft_consensus.cc:740] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.653748  7350 ts_tablet_manager.cc:1403] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.005s
I20260501 13:57:50.654433  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.654870  7351 consensus_queue.cc:260] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.657019  7379 raft_consensus.cc:493] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.656492  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:50.657802  7161 raft_consensus.cc:3060] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.657671  7379 raft_consensus.cc:515] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.648516  7357 raft_consensus.cc:697] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:50.659088  7351 ts_tablet_manager.cc:1434] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260501 13:57:50.657466  7350 raft_consensus.cc:359] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.661837  7350 raft_consensus.cc:385] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.662158  7350 raft_consensus.cc:740] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.653450  7353 raft_consensus.cc:740] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.662393  7351 tablet_bootstrap.cc:492] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.659258  7357 consensus_queue.cc:237] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.662253  7125 leader_election.cc:304] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.663079  7353 consensus_queue.cc:260] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
W20260501 13:57:50.656030  7275 leader_election.cc:343] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.661123  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.665256  7350 consensus_queue.cc:260] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
W20260501 13:57:50.665958  7126 leader_election.cc:343] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.663082  7379 leader_election.cc:290] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.666877  7379 raft_consensus.cc:2804] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.667230  7379 raft_consensus.cc:493] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.667537  7379 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.676290  7350 ts_tablet_manager.cc:1434] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.003s
I20260501 13:57:50.681468  7378 raft_consensus.cc:493] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.682004  7378 raft_consensus.cc:515] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.684419  7378 leader_election.cc:290] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.686091  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.686748  7236 raft_consensus.cc:2468] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 0.
I20260501 13:57:50.687208  7351 tablet_bootstrap.cc:654] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.687866  7275 leader_election.cc:304] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:57:50.695215  7357 raft_consensus.cc:2804] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.695645  7357 raft_consensus.cc:493] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.696002  7357 raft_consensus.cc:3060] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.699086  7057 catalog_manager.cc:5671] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.689498  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.690431  7353 ts_tablet_manager.cc:1434] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.041s	user 0.019s	sys 0.004s
I20260501 13:57:50.691398  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:50.701160  7160 raft_consensus.cc:2468] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 0.
I20260501 13:57:50.701997  7353 tablet_bootstrap.cc:492] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: Bootstrap starting.
I20260501 13:57:50.701196  7310 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 0.
I20260501 13:57:50.704038  7125 leader_election.cc:304] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.705394  7359 raft_consensus.cc:2804] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.705852  7359 raft_consensus.cc:493] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.706265  7359 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.709849  7353 tablet_bootstrap.cc:654] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.693408  7379 raft_consensus.cc:515] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.698798  7058 catalog_manager.cc:5671] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 0 to 1, leader changed from <none> to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 1 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:50.688364  7161 raft_consensus.cc:2468] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 1.
I20260501 13:57:50.715759  7357 raft_consensus.cc:515] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.718852  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.717833  7379 leader_election.cc:290] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.720562  7236 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.721654  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:50.722386  7310 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.724463  7351 tablet_bootstrap.cc:492] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.724934  7351 ts_tablet_manager.cc:1403] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.027s
I20260501 13:57:50.727845  7351 raft_consensus.cc:359] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.728713  7351 raft_consensus.cc:385] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.729049  7351 raft_consensus.cc:740] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.729939  7310 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.728205  7273 leader_election.cc:304] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.730278  7236 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.729909  7351 consensus_queue.cc:260] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.731185  7378 raft_consensus.cc:2804] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.733178  7359 raft_consensus.cc:515] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.733695  7378 raft_consensus.cc:697] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:50.734512  7378 consensus_queue.cc:237] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.735026  7351 ts_tablet_manager.cc:1434] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260501 13:57:50.735172  7359 leader_election.cc:290] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.736630  7351 tablet_bootstrap.cc:492] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.736863  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:50.737488  7161 raft_consensus.cc:3060] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.731775  7125 leader_election.cc:304] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:50.732468  7357 leader_election.cc:290] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.744184  7353 tablet_bootstrap.cc:492] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: No bootstrap required, opened a new log
I20260501 13:57:50.744509  7161 raft_consensus.cc:2468] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 1.
I20260501 13:57:50.744715  7353 ts_tablet_manager.cc:1403] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260501 13:57:50.744982  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.745662  7273 leader_election.cc:304] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:50.746073  7351 tablet_bootstrap.cc:654] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
W20260501 13:57:50.746379  7126 leader_election.cc:343] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.746615  7357 raft_consensus.cc:2804] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.747071  7357 raft_consensus.cc:697] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:50.747705  7379 raft_consensus.cc:2804] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.748473  7379 raft_consensus.cc:697] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:50.748728  7388 raft_consensus.cc:493] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.749162  7388 raft_consensus.cc:515] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.749316  7379 consensus_queue.cc:237] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.752635  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
W20260501 13:57:50.754190  7126 leader_election.cc:343] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.747736  7353 raft_consensus.cc:359] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.755359  7353 raft_consensus.cc:385] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.755297  7388 leader_election.cc:290] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.755703  7353 raft_consensus.cc:740] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.752359  7357 consensus_queue.cc:237] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.757325  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:50.757869  7310 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.761350  7353 consensus_queue.cc:260] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.764597  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.769639  7236 raft_consensus.cc:3060] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.765578  7353 ts_tablet_manager.cc:1434] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260501 13:57:50.768810  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:50.776460  7309 raft_consensus.cc:2468] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 0.
I20260501 13:57:50.778270  7125 leader_election.cc:304] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.779111  7310 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.779645  7359 raft_consensus.cc:2804] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.780131  7359 raft_consensus.cc:493] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.780422  7359 raft_consensus.cc:3060] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.782692  7058 catalog_manager.cc:5671] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.784886  7125 leader_election.cc:304] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.790671  7058 catalog_manager.cc:5671] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.791868  7379 raft_consensus.cc:2804] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.792348  7379 raft_consensus.cc:697] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:50.792919  7351 tablet_bootstrap.cc:492] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.793470  7351 ts_tablet_manager.cc:1403] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.013s
I20260501 13:57:50.793345  7379 consensus_queue.cc:237] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.796739  7351 raft_consensus.cc:359] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.797441  7351 raft_consensus.cc:385] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.797739  7351 raft_consensus.cc:740] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.798076  7236 raft_consensus.cc:2468] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 1.
I20260501 13:57:50.798558  7351 consensus_queue.cc:260] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:50.801030  7351 ts_tablet_manager.cc:1434] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260501 13:57:50.802093  7351 tablet_bootstrap.cc:492] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.788172  7359 raft_consensus.cc:515] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.807013  7359 leader_election.cc:290] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.807871  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.808339  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:50.808964  7310 raft_consensus.cc:3060] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:57:50.809247  7126 leader_election.cc:343] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.810201  7351 tablet_bootstrap.cc:654] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.812497  7059 catalog_manager.cc:5671] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 0 to 1, leader changed from <none> to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 1 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:50.814695  7059 catalog_manager.cc:5671] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 0 to 1, leader changed from <none> to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 1 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.823993  7310 raft_consensus.cc:2468] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.825156  7351 tablet_bootstrap.cc:492] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.825268  7125 leader_election.cc:304] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.825827  7351 ts_tablet_manager.cc:1403] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260501 13:57:50.826582  7359 raft_consensus.cc:2804] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.827095  7359 raft_consensus.cc:697] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:50.827987  7359 consensus_queue.cc:237] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.827747  7058 catalog_manager.cc:5671] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.829134  7351 raft_consensus.cc:359] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.829841  7351 raft_consensus.cc:385] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.830106  7351 raft_consensus.cc:740] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.830891  7351 consensus_queue.cc:260] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.833616  7351 ts_tablet_manager.cc:1434] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260501 13:57:50.834820  7351 tablet_bootstrap.cc:492] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.842696  7351 tablet_bootstrap.cc:654] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.848284  7351 tablet_bootstrap.cc:492] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.849505  7351 ts_tablet_manager.cc:1403] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260501 13:57:50.852113  7351 raft_consensus.cc:359] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.852730  7351 raft_consensus.cc:385] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.852289  7058 catalog_manager.cc:5671] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.853024  7351 raft_consensus.cc:740] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.853847  7351 consensus_queue.cc:260] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.855916  7351 ts_tablet_manager.cc:1434] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260501 13:57:50.857069  7351 tablet_bootstrap.cc:492] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.863794  7359 raft_consensus.cc:493] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.864185  7351 tablet_bootstrap.cc:654] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.864426  7359 raft_consensus.cc:515] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.866727  7359 leader_election.cc:290] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.868023  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.869194  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
W20260501 13:57:50.869445  7126 leader_election.cc:343] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.869863  7310 raft_consensus.cc:2468] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 0.
I20260501 13:57:50.870640  7351 tablet_bootstrap.cc:492] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.870951  7125 leader_election.cc:304] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.871165  7351 ts_tablet_manager.cc:1403] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260501 13:57:50.871891  7359 raft_consensus.cc:2804] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.872349  7359 raft_consensus.cc:493] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.872694  7359 raft_consensus.cc:3060] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.874013  7351 raft_consensus.cc:359] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.874605  7351 raft_consensus.cc:385] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.874864  7351 raft_consensus.cc:740] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.875520  7351 consensus_queue.cc:260] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.878088  7351 ts_tablet_manager.cc:1434] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260501 13:57:50.878908  7351 tablet_bootstrap.cc:492] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.880523  7359 raft_consensus.cc:515] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.882814  7359 leader_election.cc:290] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.884829  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
W20260501 13:57:50.886279  7126 leader_election.cc:343] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:57:50.887646  7351 tablet_bootstrap.cc:654] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.888134  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:50.888756  7310 raft_consensus.cc:3060] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.896090  7310 raft_consensus.cc:2468] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 1.
I20260501 13:57:50.897152  7125 leader_election.cc:304] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:50.897986  7359 raft_consensus.cc:2804] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.898447  7359 raft_consensus.cc:697] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:50.898465  7351 tablet_bootstrap.cc:492] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.899127  7351 ts_tablet_manager.cc:1403] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260501 13:57:50.899353  7359 consensus_queue.cc:237] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.902130  7351 raft_consensus.cc:359] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.902906  7351 raft_consensus.cc:385] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.903179  7351 raft_consensus.cc:740] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.903905  7351 consensus_queue.cc:260] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.904556  7378 raft_consensus.cc:493] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.905048  7378 raft_consensus.cc:515] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.905977  7351 ts_tablet_manager.cc:1434] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260501 13:57:50.906997  7378 leader_election.cc:290] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.907793  7351 tablet_bootstrap.cc:492] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.908501  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.909116  7161 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 0.
I20260501 13:57:50.908994  7057 catalog_manager.cc:5671] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:50.910336  7273 leader_election.cc:304] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:50.910542  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a" is_pre_election: true
I20260501 13:57:50.911149  7236 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 0.
I20260501 13:57:50.914673  7378 raft_consensus.cc:2804] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:57:50.915023  7378 raft_consensus.cc:493] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:57:50.915470  7351 tablet_bootstrap.cc:654] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.915375  7378 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.920588  7351 tablet_bootstrap.cc:492] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.921061  7351 ts_tablet_manager.cc:1403] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260501 13:57:50.923784  7351 raft_consensus.cc:359] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.924471  7351 raft_consensus.cc:385] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.924780  7351 raft_consensus.cc:740] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.924943  7378 raft_consensus.cc:515] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.925452  7351 consensus_queue.cc:260] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.927857  7351 ts_tablet_manager.cc:1434] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260501 13:57:50.927753  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:50.928369  7161 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.928839  7351 tablet_bootstrap.cc:492] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: Bootstrap starting.
I20260501 13:57:50.933398  7378 leader_election.cc:290] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:50.933629  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:50.934224  7236 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.935077  7351 tablet_bootstrap.cc:654] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: Neither blocks nor log segments found. Creating new log.
I20260501 13:57:50.936823  7161 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 1.
I20260501 13:57:50.937829  7273 leader_election.cc:304] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:50.938673  7378 raft_consensus.cc:2804] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:57:50.939167  7378 raft_consensus.cc:697] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:50.940160  7351 tablet_bootstrap.cc:492] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: No bootstrap required, opened a new log
I20260501 13:57:50.940651  7351 ts_tablet_manager.cc:1403] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260501 13:57:50.940104  7378 consensus_queue.cc:237] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.941568  7236 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 1.
I20260501 13:57:50.943043  7351 raft_consensus.cc:359] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.943538  7351 raft_consensus.cc:385] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:57:50.943809  7351 raft_consensus.cc:740] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Initialized, Role: FOLLOWER
I20260501 13:57:50.944528  7351 consensus_queue.cc:260] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.947214  7351 ts_tablet_manager.cc:1434] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260501 13:57:50.948064  7375 raft_consensus.cc:493] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:50.948542  7375 raft_consensus.cc:515] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:50.949985  7057 catalog_manager.cc:5671] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 0 to 1, leader changed from <none> to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 1 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:50.951105  7375 leader_election.cc:290] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:50.981493  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:50.981401  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:50.982587  7310 raft_consensus.cc:2393] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f59eee95bae45828184f266524f0e6a in current term 1: Already voted for candidate 6d8ae211b9584459ab383e642801be69 in this term.
I20260501 13:57:50.983654  7200 leader_election.cc:304] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a; no voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:50.984409  7375 raft_consensus.cc:3060] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:50.989640  7375 raft_consensus.cc:2749] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:51.045230  7375 raft_consensus.cc:493] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:51.045789  7375 raft_consensus.cc:515] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.047577  7375 leader_election.cc:290] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.048556  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:51.048712  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:51.049389  7310 raft_consensus.cc:2393] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f59eee95bae45828184f266524f0e6a in current term 1: Already voted for candidate 6d8ae211b9584459ab383e642801be69 in this term.
I20260501 13:57:51.050230  7200 leader_election.cc:304] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a; no voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:51.050880  7375 raft_consensus.cc:3060] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:51.053122  7413 raft_consensus.cc:493] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:51.053680  7413 raft_consensus.cc:515] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:51.055161  7413 leader_election.cc:290] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.056231  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:51.056229  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:51.057176  7161 raft_consensus.cc:2393] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f59eee95bae45828184f266524f0e6a in current term 1: Already voted for candidate 178975541daa460c857a2d2995ccb56a in this term.
I20260501 13:57:51.057250  7375 raft_consensus.cc:2749] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:51.058219  7199 leader_election.cc:304] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a; no voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:51.058828  7375 raft_consensus.cc:3060] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:51.063480  7375 raft_consensus.cc:2749] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:51.066829  7236 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:51.067440  7375 raft_consensus.cc:493] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:51.067951  7375 raft_consensus.cc:515] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.070883  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:51.071157  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:51.071805  7161 raft_consensus.cc:2393] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f59eee95bae45828184f266524f0e6a in current term 1: Already voted for candidate 178975541daa460c857a2d2995ccb56a in this term.
I20260501 13:57:51.072868  7375 leader_election.cc:290] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.072963  7199 leader_election.cc:304] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a; no voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:51.074219  7375 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:51.076334  7359 consensus_queue.cc:1048] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.081621  7375 raft_consensus.cc:2749] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:51.084949  7310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:34180
I20260501 13:57:51.085701  7310 raft_consensus.cc:606] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:57:51.091629  7310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:34180
I20260501 13:57:51.092200  7310 raft_consensus.cc:606] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:57:51.102777  7359 consensus_queue.cc:1048] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.118427  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:43070
I20260501 13:57:51.119076  7161 raft_consensus.cc:606] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Received request to transfer leadership to TS 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:51.120385  7378 consensus_queue.cc:1048] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.124608  7310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
mode: GRACEFUL
new_leader_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:34180
I20260501 13:57:51.125196  7310 raft_consensus.cc:606] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Received request to transfer leadership to TS 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:51.129246  7357 raft_consensus.cc:993] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:57:51.129655  7355 raft_consensus.cc:1081] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:57:51.134306  7355 consensus_queue.cc:1048] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.139420  7161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43052
I20260501 13:57:51.140154  7161 raft_consensus.cc:493] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.140561  7161 raft_consensus.cc:3060] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.141778  7310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
mode: GRACEFUL
new_leader_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:34180
I20260501 13:57:51.142382  7310 raft_consensus.cc:606] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Received request to transfer leadership to TS 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:51.147668  7161 raft_consensus.cc:515] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:51.149504  7161 leader_election.cc:290] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 2 election: Requested vote from peers 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:51.150377  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:51.151098  7310 raft_consensus.cc:3055] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.151244  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f49c7f51ef4ea3a4a58014a2e8be2c" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:51.151866  7236 raft_consensus.cc:3060] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.151523  7310 raft_consensus.cc:740] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:51.154031  7310 consensus_queue.cc:260] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:51.155097  7310 raft_consensus.cc:3060] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.159198  7236 raft_consensus.cc:2468] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 2.
I20260501 13:57:51.159766  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:43070
I20260501 13:57:51.160329  7126 leader_election.cc:304] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:51.160420  7161 raft_consensus.cc:606] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Received request to transfer leadership to TS 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:51.160498  7310 raft_consensus.cc:2468] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 2.
I20260501 13:57:51.161162  7359 raft_consensus.cc:2804] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.161680  7359 raft_consensus.cc:697] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:51.162478  7359 consensus_queue.cc:237] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } }
I20260501 13:57:51.166426  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:43070
I20260501 13:57:51.167009  7161 raft_consensus.cc:606] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Received request to transfer leadership to TS 178975541daa460c857a2d2995ccb56a
I20260501 13:57:51.168234  7378 consensus_queue.cc:1048] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.168656  7375 raft_consensus.cc:493] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:57:51.169114  7375 raft_consensus.cc:515] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.170295  7359 consensus_queue.cc:1048] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.171064  7375 leader_election.cc:290] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.171649  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ae211b9584459ab383e642801be69" is_pre_election: true
I20260501 13:57:51.173509  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178975541daa460c857a2d2995ccb56a" is_pre_election: true
I20260501 13:57:51.173074  7058 catalog_manager.cc:5671] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 1 to 2, leader changed from 178975541daa460c857a2d2995ccb56a (127.6.77.131) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:51.174422  7310 raft_consensus.cc:2393] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f59eee95bae45828184f266524f0e6a in current term 1: Already voted for candidate 6d8ae211b9584459ab383e642801be69 in this term.
I20260501 13:57:51.175391  7200 leader_election.cc:304] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a; no voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69
I20260501 13:57:51.175952  7359 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.177129  7375 raft_consensus.cc:3060] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:51.184530  7388 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:51.200591  7379 consensus_queue.cc:1048] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.207326  7375 raft_consensus.cc:2749] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:57:51.210768  7236 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:57:51.218595  7426 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.222584  7359 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.226770  7357 raft_consensus.cc:993] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: : Instructing follower 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.227680  7357 raft_consensus.cc:1081] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Signalling peer 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.242973  7233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:46820
I20260501 13:57:51.246080  7355 consensus_queue.cc:1048] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:51.254499  7233 raft_consensus.cc:493] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.255090  7233 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.268865  7233 raft_consensus.cc:515] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.280143  7378 consensus_queue.cc:1048] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:57:51.281601  7359 raft_consensus.cc:993] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: : Instructing follower 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.282076  7426 raft_consensus.cc:1081] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Signalling peer 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.283767  7234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:46836
I20260501 13:57:51.284085  7233 leader_election.cc:290] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.284359  7234 raft_consensus.cc:493] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.284729  7234 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.286185  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:51.286803  7161 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.294165  7161 raft_consensus.cc:2468] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.293952  7234 raft_consensus.cc:515] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.295513  7199 leader_election.cc:304] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:51.296625  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:51.297293  7310 raft_consensus.cc:3055] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.297426  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:51.297657  7310 raft_consensus.cc:740] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:51.297963  7424 raft_consensus.cc:2804] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.298511  7424 raft_consensus.cc:697] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Leader. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:57:51.298655  7234 leader_election.cc:290] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.298734  7310 consensus_queue.cc:260] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.299439  7424 consensus_queue.cc:237] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.300154  7310 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.303908  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:51.304533  7309 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.306969  7310 raft_consensus.cc:2468] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.297999  7160 raft_consensus.cc:3055] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.307703  7160 raft_consensus.cc:740] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:51.308462  7160 consensus_queue.cc:260] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.309355  7160 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.309927  7309 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.310822  7200 leader_election.cc:304] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:57:51.311443  7375 raft_consensus.cc:2804] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.311822  7375 raft_consensus.cc:697] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Leader. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:57:51.312659  7375 consensus_queue.cc:237] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.315001  7160 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.319919  7378 consensus_queue.cc:1048] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.329887  7058 catalog_manager.cc:5671] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a reported cstate change: term changed from 1 to 2, leader changed from 178975541daa460c857a2d2995ccb56a (127.6.77.131) to 3f59eee95bae45828184f266524f0e6a (127.6.77.130). New cstate: current_term: 2 leader_uuid: "3f59eee95bae45828184f266524f0e6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:51.331142  7426 consensus_queue.cc:1048] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.332103  7357 raft_consensus.cc:993] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:57:51.332589  7378 raft_consensus.cc:1081] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:57:51.332003  7058 catalog_manager.cc:5671] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a reported cstate change: term changed from 1 to 2, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 3f59eee95bae45828184f266524f0e6a (127.6.77.130). New cstate: current_term: 2 leader_uuid: "3f59eee95bae45828184f266524f0e6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:51.334250  7160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43052
I20260501 13:57:51.334779  7160 raft_consensus.cc:493] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.335131  7160 raft_consensus.cc:3060] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.343532  7160 raft_consensus.cc:515] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.345655  7160 leader_election.cc:290] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 2 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.346832  7379 consensus_queue.cc:1048] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.348625  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:51.349200  7235 raft_consensus.cc:3060] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.353520  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f33eb23b84e1ca3ee6f32ace765da" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:51.354110  7309 raft_consensus.cc:3055] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.354437  7309 raft_consensus.cc:740] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:51.355219  7309 consensus_queue.cc:260] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.356542  7309 raft_consensus.cc:3060] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.356734  7379 consensus_queue.cc:1048] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.365737  7235 raft_consensus.cc:2468] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 2.
I20260501 13:57:51.367303  7309 raft_consensus.cc:2468] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 2.
I20260501 13:57:51.372960  7426 raft_consensus.cc:993] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: : Instructing follower 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:57:51.373433  7426 raft_consensus.cc:1081] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Signalling peer 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:57:51.376138  7125 leader_election.cc:304] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:51.377039  7359 raft_consensus.cc:2804] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.377489  7359 raft_consensus.cc:697] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:51.372442  7388 raft_consensus.cc:993] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: : Instructing follower 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.378569  7388 raft_consensus.cc:1081] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Signalling peer 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.378327  7359 consensus_queue.cc:237] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.379166  7310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:34166
I20260501 13:57:51.379702  7310 raft_consensus.cc:493] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.380105  7310 raft_consensus.cc:3060] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.380513  7234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:46836
I20260501 13:57:51.381137  7234 raft_consensus.cc:493] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.381481  7234 raft_consensus.cc:3060] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.384708  7426 consensus_queue.cc:1048] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.387763  7310 raft_consensus.cc:515] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.390067  7310 leader_election.cc:290] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:51.390475  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:51.391057  7160 raft_consensus.cc:3055] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.391361  7160 raft_consensus.cc:740] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:51.391762  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be1aca9ab3f400190daa1b72b757f73" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:51.392282  7160 consensus_queue.cc:260] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.393100  7234 raft_consensus.cc:515] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.393549  7160 raft_consensus.cc:3060] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.395387  7234 leader_election.cc:290] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.397910  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:51.398487  7161 raft_consensus.cc:3055] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.398835  7161 raft_consensus.cc:740] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:51.399639  7161 consensus_queue.cc:260] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.400842  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e9b52c2e434f0194ec2c36708f59be" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:51.400971  7161 raft_consensus.cc:3060] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.401456  7310 raft_consensus.cc:3060] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.405252  7160 raft_consensus.cc:2468] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 2.
I20260501 13:57:51.406500  7273 leader_election.cc:304] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 3f59eee95bae45828184f266524f0e6a
I20260501 13:57:51.407688  7378 raft_consensus.cc:2804] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.408182  7378 raft_consensus.cc:697] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:51.409003  7378 consensus_queue.cc:237] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.414693  7059 catalog_manager.cc:5671] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 1 to 2, leader changed from 178975541daa460c857a2d2995ccb56a (127.6.77.131) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:51.418493  7378 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.416303  7161 raft_consensus.cc:2468] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.420992  7058 catalog_manager.cc:5671] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 1 to 2, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 2 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:51.423043  7199 leader_election.cc:304] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:51.423978  7375 raft_consensus.cc:2804] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.424422  7375 raft_consensus.cc:697] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Leader. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:57:51.425253  7375 consensus_queue.cc:237] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.429276  7310 raft_consensus.cc:2468] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.436746  7058 catalog_manager.cc:5671] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a reported cstate change: term changed from 1 to 2, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 3f59eee95bae45828184f266524f0e6a (127.6.77.130). New cstate: current_term: 2 leader_uuid: "3f59eee95bae45828184f266524f0e6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:51.437446  7357 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:57:51.456293  7357 raft_consensus.cc:993] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: : Instructing follower 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:57:51.456840  7355 raft_consensus.cc:1081] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Signalling peer 3f59eee95bae45828184f266524f0e6a to start an election
W20260501 13:57:51.456959  7257 debug-util.cc:398] Leaking SignalData structure 0x7b08000fede0 after lost signal to thread 6457
W20260501 13:57:51.457983  7257 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff4c0 after lost signal to thread 7093
I20260501 13:57:51.458634  7234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:46820
I20260501 13:57:51.459215  7234 raft_consensus.cc:493] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:51.459599  7234 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:57:51.460114  7257 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9560 after lost signal to thread 7260
I20260501 13:57:51.466585  7234 raft_consensus.cc:515] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.468595  7234 leader_election.cc:290] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:57:51.469908  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:57:51.470624  7310 raft_consensus.cc:3055] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:51.470979  7310 raft_consensus.cc:740] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:51.471101  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:51.471657  7159 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.472065  7310 consensus_queue.cc:260] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.473639  7310 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.478247  7159 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.479274  7199 leader_election.cc:304] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:51.480000  7375 raft_consensus.cc:2804] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:51.482828  7375 raft_consensus.cc:697] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Leader. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:57:51.483920  7310 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:57:51.483794  7375 consensus_queue.cc:237] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:51.492704  7058 catalog_manager.cc:5671] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a reported cstate change: term changed from 1 to 2, leader changed from 178975541daa460c857a2d2995ccb56a (127.6.77.131) to 3f59eee95bae45828184f266524f0e6a (127.6.77.130). New cstate: current_term: 2 leader_uuid: "3f59eee95bae45828184f266524f0e6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:57:51.576426  7234 raft_consensus.cc:1275] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.577796  7359 consensus_queue.cc:1048] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.586410  7310 raft_consensus.cc:1275] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.588142  7426 consensus_queue.cc:1048] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.696655  7309 raft_consensus.cc:1275] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.698156  7375 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.710062  7159 raft_consensus.cc:1275] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.711342  7413 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.772485  7309 raft_consensus.cc:1275] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.773840  7413 consensus_queue.cc:1048] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.782367  7159 raft_consensus.cc:1275] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.783875  7375 consensus_queue.cc:1048] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.835078  7234 raft_consensus.cc:3060] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:51.840734  7234 raft_consensus.cc:1275] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.842269  7357 consensus_queue.cc:1048] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.851331  7159 raft_consensus.cc:1275] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.853545  7355 consensus_queue.cc:1048] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.875116  7161 raft_consensus.cc:1275] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.876399  7424 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.884464  7309 raft_consensus.cc:1275] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.886327  7375 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:51.893347  7159 raft_consensus.cc:1275] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.904103  7309 raft_consensus.cc:1275] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.906270  7359 consensus_queue.cc:1048] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.910557  7234 raft_consensus.cc:1275] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.900604  7375 consensus_queue.cc:1048] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260501 13:57:51.912699  7426 consensus_queue.cc:1048] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:51.925952  7310 raft_consensus.cc:1275] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:51.931241  7442 consensus_queue.cc:1048] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:54.202294  6454 auto_leader_rebalancer-test.cc:343] The leader distribution is 
I20260501 13:57:54.203277  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:54.224692  7159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:43080
I20260501 13:57:54.225214  7159 raft_consensus.cc:606] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Received request to transfer leadership to TS 178975541daa460c857a2d2995ccb56a
I20260501 13:57:54.227996  7159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:43080
I20260501 13:57:54.228485  7159 raft_consensus.cc:606] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Received request to transfer leadership to TS 178975541daa460c857a2d2995ccb56a
I20260501 13:57:54.229751  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260501 13:57:54.230485  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:54.296301  7359 raft_consensus.cc:993] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: : Instructing follower 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:57:54.296859  7445 raft_consensus.cc:1081] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Signalling peer 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:57:54.298321  7309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:34166
I20260501 13:57:54.298868  7309 raft_consensus.cc:493] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:54.299225  7309 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:54.304828  7309 raft_consensus.cc:515] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:54.306470  7309 leader_election.cc:290] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:54.307307  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:54.307909  7159 raft_consensus.cc:3055] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:54.307861  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:54.308298  7159 raft_consensus.cc:740] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:54.308498  7234 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:54.309188  7159 consensus_queue.cc:260] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:54.310426  7159 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:54.315337  7234 raft_consensus.cc:2468] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 2.
I20260501 13:57:54.316690  7275 leader_election.cc:304] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:57:54.317281  7159 raft_consensus.cc:2468] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 2.
I20260501 13:57:54.317639  7378 raft_consensus.cc:2804] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:54.319002  7378 raft_consensus.cc:697] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:54.320029  7378 consensus_queue.cc:237] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:54.329300  7057 catalog_manager.cc:5671] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 1 to 2, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 2 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:54.483105  7359 raft_consensus.cc:993] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: : Instructing follower 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:57:54.483593  7359 raft_consensus.cc:1081] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Signalling peer 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:57:54.484964  7309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:34166
I20260501 13:57:54.485476  7309 raft_consensus.cc:493] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:57:54.485839  7309 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:54.490394  7309 raft_consensus.cc:515] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:54.492029  7309 leader_election.cc:290] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:57:54.492743  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:57:54.493327  7159 raft_consensus.cc:3055] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:57:54.493314  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:57:54.493783  7159 raft_consensus.cc:740] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:57:54.493922  7234 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:54.494608  7159 consensus_queue.cc:260] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:54.495858  7159 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:57:54.502290  7159 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 2.
I20260501 13:57:54.503719  7273 leader_election.cc:304] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:57:54.504773  7378 raft_consensus.cc:2804] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:57:54.506310  7378 raft_consensus.cc:697] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:57:54.505573  7234 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 2.
I20260501 13:57:54.507278  7378 consensus_queue.cc:237] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:57:54.515811  7057 catalog_manager.cc:5671] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 1 to 2, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 2 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:57:54.752444  7161 raft_consensus.cc:1275] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:54.753954  7378 consensus_queue.cc:1048] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:57:54.769337  7234 raft_consensus.cc:1275] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:54.770982  7378 consensus_queue.cc:1048] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:55.064793  7234 raft_consensus.cc:1275] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:55.066107  7378 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:55.076639  7161 raft_consensus.cc:1275] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:57:55.078302  7462 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:57:55.231650  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:55.240466  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:55.241029  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:56.242221  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:56.247924  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:56.248288  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:57.249394  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:57.255179  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:57.255649  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:58.256565  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:58.263538  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:58.263973  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:57:59.264890  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:57:59.270370  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:57:59.270839  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:00.272039  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:00.277683  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:00.278117  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:01.279136  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:01.284300  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:01.284752  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:02.285846  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:02.291790  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:02.292598  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:03.293629  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:03.298902  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:03.299391  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:04.333010  6454 auto_leader_rebalancer-test.cc:362] The leader distribution is 
I20260501 13:58:04.343523  7310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:34180
I20260501 13:58:04.344316  7310 raft_consensus.cc:606] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:58:04.349136  7310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:34180
I20260501 13:58:04.349606  7310 raft_consensus.cc:606] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:58:04.369856  7233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:33394
I20260501 13:58:04.370404  7233 raft_consensus.cc:606] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:58:04.375161  7233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:33394
I20260501 13:58:04.375768  7233 raft_consensus.cc:606] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:58:04.380329  7233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
mode: GRACEFUL
new_leader_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:33394
I20260501 13:58:04.380787  7233 raft_consensus.cc:606] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Received request to transfer leadership to TS 6d8ae211b9584459ab383e642801be69
I20260501 13:58:04.502527  7475 raft_consensus.cc:993] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.503341  7473 raft_consensus.cc:1081] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.505295  7159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43052
I20260501 13:58:04.505919  7159 raft_consensus.cc:493] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:04.506422  7159 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.506775  7472 raft_consensus.cc:993] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.507431  7478 raft_consensus.cc:1081] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.509456  7161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43066
I20260501 13:58:04.510007  7161 raft_consensus.cc:493] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:04.510337  7161 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.514694  7159 raft_consensus.cc:515] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.517097  7159 leader_election.cc:290] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:04.517450  7161 raft_consensus.cc:515] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.518313  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:04.518797  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9dfc4b1674a7785d62d3db380c9cf" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:04.519220  7310 raft_consensus.cc:3055] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:58:04.519490  7161 leader_election.cc:290] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:04.519551  7310 raft_consensus.cc:740] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:58:04.519348  7233 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.521581  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:04.520731  7310 consensus_queue.cc:260] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.522218  7309 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.523006  7310 raft_consensus.cc:3060] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.524367  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f4d5fd22044ee39abaaed7782dce52" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:04.524988  7234 raft_consensus.cc:3055] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:58:04.525324  7234 raft_consensus.cc:740] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:58:04.526113  7234 consensus_queue.cc:260] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.527489  7233 raft_consensus.cc:2468] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.528532  7234 raft_consensus.cc:3060] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.529306  7126 leader_election.cc:304] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:58:04.530329  7465 raft_consensus.cc:2804] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:58:04.532083  7310 raft_consensus.cc:2468] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.534737  7465 raft_consensus.cc:697] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:04.535295  7309 raft_consensus.cc:2468] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.536898  7125 leader_election.cc:304] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:58:04.536418  7465 consensus_queue.cc:237] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.537832  7472 raft_consensus.cc:993] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.537770  7234 raft_consensus.cc:2468] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.538116  7479 raft_consensus.cc:2804] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:58:04.538548  7472 raft_consensus.cc:1081] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.540495  7479 raft_consensus.cc:697] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:04.541157  7161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43066
I20260501 13:58:04.541663  7479 consensus_queue.cc:237] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.541846  7161 raft_consensus.cc:493] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:04.543442  7161 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.549141  7058 catalog_manager.cc:5671] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 2 to 3, leader changed from 178975541daa460c857a2d2995ccb56a (127.6.77.131) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:04.554131  7161 raft_consensus.cc:515] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.556090  7161 leader_election.cc:290] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:04.556980  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:04.557327  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:04.557618  7234 raft_consensus.cc:3055] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:58:04.557880  7309 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.557993  7234 raft_consensus.cc:740] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:58:04.558964  7234 consensus_queue.cc:260] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.560283  7234 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.565441  7309 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.566895  7125 leader_election.cc:304] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:58:04.568105  7234 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.568145  7479 raft_consensus.cc:2804] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:58:04.568971  7479 raft_consensus.cc:697] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:04.569099  7472 raft_consensus.cc:993] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.569746  7472 raft_consensus.cc:1081] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.570011  7479 consensus_queue.cc:237] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.571341  7161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43066
I20260501 13:58:04.571997  7161 raft_consensus.cc:493] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:04.572400  7161 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.573083  7058 catalog_manager.cc:5671] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 2 to 3, leader changed from 3f59eee95bae45828184f266524f0e6a (127.6.77.130) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:04.579674  7161 raft_consensus.cc:515] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.582155  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:04.582352  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:04.582760  7234 raft_consensus.cc:3055] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:58:04.582923  7309 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.583134  7234 raft_consensus.cc:740] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:58:04.584013  7234 consensus_queue.cc:260] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.585120  7234 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.585732  7161 leader_election.cc:290] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:04.589406  7309 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.590492  7125 leader_election.cc:304] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:58:04.591403  7479 raft_consensus.cc:2804] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:58:04.591858  7234 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.591941  7479 raft_consensus.cc:697] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:04.593513  7479 consensus_queue.cc:237] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.593359  7058 catalog_manager.cc:5671] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 2 to 3, leader changed from 3f59eee95bae45828184f266524f0e6a (127.6.77.130) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:04.606068  7058 catalog_manager.cc:5671] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 2 to 3, leader changed from 3f59eee95bae45828184f266524f0e6a (127.6.77.130) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:04.670692  7475 raft_consensus.cc:993] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: : Instructing follower 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.671214  7473 raft_consensus.cc:1081] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Signalling peer 6d8ae211b9584459ab383e642801be69 to start an election
I20260501 13:58:04.672777  7161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
 from {username='slave'} at 127.0.0.1:43052
I20260501 13:58:04.673204  7161 raft_consensus.cc:493] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:04.673458  7161 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.677829  7161 raft_consensus.cc:515] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.679092  7161 leader_election.cc:290] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Requested vote from peers 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:04.680015  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:04.680202  7309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "6d8ae211b9584459ab383e642801be69" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:04.680500  7234 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.680815  7309 raft_consensus.cc:3055] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:58:04.681103  7309 raft_consensus.cc:740] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:58:04.681694  7309 consensus_queue.cc:260] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.682641  7309 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:04.684839  7234 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.686003  7126 leader_election.cc:304] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f59eee95bae45828184f266524f0e6a, 6d8ae211b9584459ab383e642801be69; no voters: 
I20260501 13:58:04.686812  7479 raft_consensus.cc:2804] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:58:04.687340  7479 raft_consensus.cc:697] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:04.688355  7309 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8ae211b9584459ab383e642801be69 in term 3.
I20260501 13:58:04.688920  7479 consensus_queue.cc:237] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:04.696605  7058 catalog_manager.cc:5671] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 reported cstate change: term changed from 2 to 3, leader changed from 178975541daa460c857a2d2995ccb56a (127.6.77.131) to 6d8ae211b9584459ab383e642801be69 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "6d8ae211b9584459ab383e642801be69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:04.954191  7309 raft_consensus.cc:1275] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:04.955492  7479 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:04.965888  7234 raft_consensus.cc:1275] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:04.967288  7465 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.090564  7309 raft_consensus.cc:1275] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.091910  7465 consensus_queue.cc:1048] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.101583  7234 raft_consensus.cc:1275] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.103557  7465 consensus_queue.cc:1048] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:05.105531  7234 raft_consensus.cc:1275] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.107015  7479 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.119232  7309 raft_consensus.cc:1275] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.120703  7480 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.131608  7309 raft_consensus.cc:1275] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.132903  7479 consensus_queue.cc:1048] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.141081  7234 raft_consensus.cc:1275] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.143270  7234 raft_consensus.cc:1275] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.144585  7480 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.144887  7465 consensus_queue.cc:1048] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:05.158696  7309 raft_consensus.cc:1275] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Refusing update from remote peer 6d8ae211b9584459ab383e642801be69: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:05.161126  7465 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:07.418057  6454 auto_leader_rebalancer-test.cc:377] The leader distribution is 
I20260501 13:58:07.418859  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:07.425957  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:43080
I20260501 13:58:07.426666  7161 raft_consensus.cc:606] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Received request to transfer leadership to TS 178975541daa460c857a2d2995ccb56a
I20260501 13:58:07.429373  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:43080
I20260501 13:58:07.429888  7161 raft_consensus.cc:606] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Received request to transfer leadership to TS 178975541daa460c857a2d2995ccb56a
I20260501 13:58:07.432224  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6420220b679249c8b244b387453cde91"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:43080
I20260501 13:58:07.432639  7161 raft_consensus.cc:606] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Received request to transfer leadership to TS 3f59eee95bae45828184f266524f0e6a
I20260501 13:58:07.434553  7161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b"
dest_uuid: "6d8ae211b9584459ab383e642801be69"
mode: GRACEFUL
new_leader_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:43080
I20260501 13:58:07.434938  7161 raft_consensus.cc:606] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Received request to transfer leadership to TS 3f59eee95bae45828184f266524f0e6a
I20260501 13:58:07.435889  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260501 13:58:07.436353  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:07.627955  7465 raft_consensus.cc:993] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: : Instructing follower 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:58:07.628556  7505 raft_consensus.cc:1081] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Signalling peer 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:58:07.630281  7233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:46836
I20260501 13:58:07.630688  7233 raft_consensus.cc:493] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:07.631059  7233 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.636124  7233 raft_consensus.cc:515] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.638638  7233 leader_election.cc:290] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 4 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:07.639578  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:58:07.639927  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f08af800f64472bb999f24e9f2b67b" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:07.640367  7161 raft_consensus.cc:3055] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:58:07.640501  7310 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.640743  7161 raft_consensus.cc:740] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:07.641568  7161 consensus_queue.cc:260] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.642627  7161 raft_consensus.cc:3060] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.645367  7310 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 4.
I20260501 13:58:07.646546  7200 leader_election.cc:304] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:58:07.647420  7497 raft_consensus.cc:2804] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:58:07.648479  7497 raft_consensus.cc:697] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 4 LEADER]: Becoming Leader. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:58:07.649052  7161 raft_consensus.cc:2468] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 4.
I20260501 13:58:07.649648  7497 consensus_queue.cc:237] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.657181  7057 catalog_manager.cc:5671] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a reported cstate change: term changed from 3 to 4, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 3f59eee95bae45828184f266524f0e6a (127.6.77.130). New cstate: current_term: 4 leader_uuid: "3f59eee95bae45828184f266524f0e6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:07.674036  7465 raft_consensus.cc:993] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: : Instructing follower 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:58:07.674517  7505 raft_consensus.cc:1081] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Signalling peer 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:58:07.675807  7310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:34166
I20260501 13:58:07.676317  7310 raft_consensus.cc:493] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:07.676576  7310 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.680856  7310 raft_consensus.cc:515] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.682602  7310 leader_election.cc:290] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 4 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:58:07.683492  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:58:07.683686  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ef2a47f96046d1831bbaf8c3279469" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:07.684103  7161 raft_consensus.cc:3055] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:58:07.684231  7233 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.684437  7161 raft_consensus.cc:740] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:07.685190  7161 consensus_queue.cc:260] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.686117  7161 raft_consensus.cc:3060] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.688545  7233 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 4.
I20260501 13:58:07.689661  7275 leader_election.cc:304] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:58:07.690543  7473 raft_consensus.cc:2804] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:58:07.691399  7161 raft_consensus.cc:2468] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 4.
I20260501 13:58:07.691893  7473 raft_consensus.cc:697] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 4 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:58:07.693046  7473 consensus_queue.cc:237] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.697062  7465 raft_consensus.cc:993] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: : Instructing follower 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:58:07.697588  7505 raft_consensus.cc:1081] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Signalling peer 178975541daa460c857a2d2995ccb56a to start an election
I20260501 13:58:07.699288  7310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a"
dest_uuid: "178975541daa460c857a2d2995ccb56a"
 from {username='slave'} at 127.0.0.1:34166
I20260501 13:58:07.699784  7310 raft_consensus.cc:493] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:07.700122  7310 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.701311  7057 catalog_manager.cc:5671] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 3 to 4, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 4 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:07.704416  7310 raft_consensus.cc:515] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.706080  7310 leader_election.cc:290] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 4 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079)
I20260501 13:58:07.706974  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:58:07.707126  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed835eddfa64365a64f26e4d9565e4a" candidate_uuid: "178975541daa460c857a2d2995ccb56a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f59eee95bae45828184f266524f0e6a"
I20260501 13:58:07.707485  7161 raft_consensus.cc:3055] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:58:07.707531  7233 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.707952  7161 raft_consensus.cc:740] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:07.708662  7161 consensus_queue.cc:260] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.709749  7161 raft_consensus.cc:3060] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:58:07.713845  7233 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 4.
I20260501 13:58:07.714797  7275 leader_election.cc:304] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:58:07.715392  7161 raft_consensus.cc:2468] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178975541daa460c857a2d2995ccb56a in term 4.
I20260501 13:58:07.715590  7473 raft_consensus.cc:2804] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:58:07.716220  7473 raft_consensus.cc:697] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 4 LEADER]: Becoming Leader. State: Replica: 178975541daa460c857a2d2995ccb56a, State: Running, Role: LEADER
I20260501 13:58:07.717033  7473 consensus_queue.cc:237] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.724509  7057 catalog_manager.cc:5671] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a reported cstate change: term changed from 3 to 4, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 178975541daa460c857a2d2995ccb56a (127.6.77.131). New cstate: current_term: 4 leader_uuid: "178975541daa460c857a2d2995ccb56a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:07.766213  7465 raft_consensus.cc:993] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: : Instructing follower 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:58:07.766707  7465 raft_consensus.cc:1081] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Signalling peer 3f59eee95bae45828184f266524f0e6a to start an election
I20260501 13:58:07.768136  7233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6420220b679249c8b244b387453cde91"
dest_uuid: "3f59eee95bae45828184f266524f0e6a"
 from {username='slave'} at 127.0.0.1:46836
I20260501 13:58:07.768627  7233 raft_consensus.cc:493] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:07.768893  7233 raft_consensus.cc:3060] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:07.773324  7233 raft_consensus.cc:515] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.774768  7233 leader_election.cc:290] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Requested vote from peers 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931), 178975541daa460c857a2d2995ccb56a (127.6.77.131:45035)
I20260501 13:58:07.775695  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8ae211b9584459ab383e642801be69"
I20260501 13:58:07.775974  7310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420220b679249c8b244b387453cde91" candidate_uuid: "3f59eee95bae45828184f266524f0e6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178975541daa460c857a2d2995ccb56a"
I20260501 13:58:07.776381  7161 raft_consensus.cc:3055] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:07.776734  7161 raft_consensus.cc:740] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8ae211b9584459ab383e642801be69, State: Running, Role: LEADER
I20260501 13:58:07.776777  7310 raft_consensus.cc:3060] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:07.777617  7161 consensus_queue.cc:260] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.778645  7161 raft_consensus.cc:3060] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:07.781678  7310 raft_consensus.cc:2468] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:58:07.782836  7200 leader_election.cc:304] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178975541daa460c857a2d2995ccb56a, 3f59eee95bae45828184f266524f0e6a; no voters: 
I20260501 13:58:07.783659  7497 raft_consensus.cc:2804] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:07.783764  7161 raft_consensus.cc:2468] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f59eee95bae45828184f266524f0e6a in term 2.
I20260501 13:58:07.784264  7497 raft_consensus.cc:697] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Becoming Leader. State: Replica: 3f59eee95bae45828184f266524f0e6a, State: Running, Role: LEADER
I20260501 13:58:07.785280  7497 consensus_queue.cc:237] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } }
I20260501 13:58:07.792279  7057 catalog_manager.cc:5671] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a reported cstate change: term changed from 1 to 2, leader changed from 6d8ae211b9584459ab383e642801be69 (127.6.77.129) to 3f59eee95bae45828184f266524f0e6a (127.6.77.130). New cstate: current_term: 2 leader_uuid: "3f59eee95bae45828184f266524f0e6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:08.160539  7161 raft_consensus.cc:1275] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:58:08.161887  7473 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:08.173081  7233 raft_consensus.cc:1275] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:58:08.174754  7473 consensus_queue.cc:1048] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:08.213066  7161 raft_consensus.cc:1275] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:58:08.214183  7473 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:08.224934  7233 raft_consensus.cc:1275] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Refusing update from remote peer 178975541daa460c857a2d2995ccb56a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:58:08.226167  7310 raft_consensus.cc:1275] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:58:08.227574  7522 consensus_queue.cc:1048] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f59eee95bae45828184f266524f0e6a" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:08.227766  7497 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:08.243221  7161 raft_consensus.cc:1275] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:58:08.244700  7497 consensus_queue.cc:1048] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:08.257587  7161 raft_consensus.cc:1275] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:08.259094  7497 consensus_queue.cc:1048] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ae211b9584459ab383e642801be69" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 45931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:08.268960  7310 raft_consensus.cc:1275] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Refusing update from remote peer 3f59eee95bae45828184f266524f0e6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:08.270697  7525 consensus_queue.cc:1048] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "178975541daa460c857a2d2995ccb56a" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:08.437422  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:08.442948  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:08.443442  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:09.444423  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:09.450116  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:09.450551  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:10.451700  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:10.457660  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:10.458166  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:11.459201  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:11.464598  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:11.465037  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:12.466252  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:12.472990  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:12.473663  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:13.474658  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:13.480006  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:13.480439  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:14.481393  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:14.486884  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:14.487360  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:15.488232  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:15.493721  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:15.494191  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:16.549422  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:16.555043  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 13:58:16.555465  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260501 13:58:16.935724  7090 debug-util.cc:398] Leaking SignalData structure 0x7b0800052de0 after lost signal to thread 6457
W20260501 13:58:16.936667  7090 debug-util.cc:398] Leaking SignalData structure 0x7b08000534c0 after lost signal to thread 7093
W20260501 13:58:16.937489  7090 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6740 after lost signal to thread 7185
W20260501 13:58:16.938246  7090 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0740 after lost signal to thread 7260
W20260501 13:58:16.938970  7090 debug-util.cc:398] Leaking SignalData structure 0x7b08000becc0 after lost signal to thread 7334
I20260501 13:58:17.592314  6454 auto_leader_rebalancer-test.cc:388] The leader distribution is 
I20260501 13:58:17.592952  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
W20260501 13:58:17.600181  7273 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260501 13:58:17.604667  7273 consensus_peers.cc:597] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a -> Peer 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931): Couldn't send request to peer 6d8ae211b9584459ab383e642801be69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.640190  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 13:58:17.641223  6454 tablet_replica.cc:333] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.642395  6454 raft_consensus.cc:2243] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.643303  6454 raft_consensus.cc:2272] T 08e9b52c2e434f0194ec2c36708f59be P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.646476  6454 tablet_replica.cc:333] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.647275  6454 raft_consensus.cc:2243] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.647986  6454 raft_consensus.cc:2272] T 6be1aca9ab3f400190daa1b72b757f73 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.650843  6454 tablet_replica.cc:333] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.651554  6454 raft_consensus.cc:2243] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.652201  6454 raft_consensus.cc:2272] T 67f08af800f64472bb999f24e9f2b67b P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.654820  6454 tablet_replica.cc:333] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.655566  6454 raft_consensus.cc:2243] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.656190  6454 raft_consensus.cc:2272] T 16ef2a47f96046d1831bbaf8c3279469 P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.658839  6454 tablet_replica.cc:333] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.659623  6454 raft_consensus.cc:2243] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.660328  6454 raft_consensus.cc:2272] T 6420220b679249c8b244b387453cde91 P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.662985  6454 tablet_replica.cc:333] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.663717  6454 raft_consensus.cc:2243] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.664302  6454 raft_consensus.cc:2272] T 1ed835eddfa64365a64f26e4d9565e4a P 6d8ae211b9584459ab383e642801be69 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.666692  6454 tablet_replica.cc:333] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.667397  6454 raft_consensus.cc:2243] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.668466  6454 raft_consensus.cc:2272] T 98f4d5fd22044ee39abaaed7782dce52 P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.670881  6454 tablet_replica.cc:333] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.671519  6454 raft_consensus.cc:2243] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 2 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.672699  6454 raft_consensus.cc:2272] T 2f0f33eb23b84e1ca3ee6f32ace765da P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.675436  6454 tablet_replica.cc:333] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.676137  6454 raft_consensus.cc:2243] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 3 LEADER]: Raft consensus shutting down.
W20260501 13:58:17.676304  7273 consensus_peers.cc:597] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a -> Peer 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931): Couldn't send request to peer 6d8ae211b9584459ab383e642801be69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.677297  6454 raft_consensus.cc:2272] T 87a9dfc4b1674a7785d62d3db380c9cf P 6d8ae211b9584459ab383e642801be69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.679651  6454 tablet_replica.cc:333] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69: stopping tablet replica
I20260501 13:58:17.680312  6454 raft_consensus.cc:2243] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 2 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.681387  6454 raft_consensus.cc:2272] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 6d8ae211b9584459ab383e642801be69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.712689  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
W20260501 13:58:17.738313  7199 consensus_peers.cc:597] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a -> Peer 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931): Couldn't send request to peer 6d8ae211b9584459ab383e642801be69. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:45931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.746384  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
W20260501 13:58:17.783632  7275 consensus_peers.cc:597] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a -> Peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Couldn't send request to peer 3f59eee95bae45828184f266524f0e6a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.789883  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 13:58:17.790724  6454 tablet_replica.cc:333] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
W20260501 13:58:17.791633  7275 consensus_peers.cc:597] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a -> Peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Couldn't send request to peer 3f59eee95bae45828184f266524f0e6a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.791863  6454 raft_consensus.cc:2243] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.792995  6454 raft_consensus.cc:2272] T 67f08af800f64472bb999f24e9f2b67b P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.794971  6454 tablet_replica.cc:333] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.795516  6454 raft_consensus.cc:2243] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.796115  6454 raft_consensus.cc:2272] T 6be1aca9ab3f400190daa1b72b757f73 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.797957  6454 tablet_replica.cc:333] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.798553  6454 raft_consensus.cc:2243] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Raft consensus shutting down.
W20260501 13:58:17.799137  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:58:17.799342  6454 raft_consensus.cc:2272] T 08e9b52c2e434f0194ec2c36708f59be P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.801595  6454 tablet_replica.cc:333] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.802160  6454 raft_consensus.cc:2243] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.802603  6454 raft_consensus.cc:2272] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.804688  6454 tablet_replica.cc:333] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.805214  6454 raft_consensus.cc:2243] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.805677  6454 raft_consensus.cc:2272] T 98f4d5fd22044ee39abaaed7782dce52 P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.807521  6454 tablet_replica.cc:333] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.808081  6454 raft_consensus.cc:2243] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.808581  6454 raft_consensus.cc:2272] T 1ed835eddfa64365a64f26e4d9565e4a P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.810436  6454 tablet_replica.cc:333] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.810964  6454 raft_consensus.cc:2243] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.811448  6454 raft_consensus.cc:2272] T 2f0f33eb23b84e1ca3ee6f32ace765da P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.813592  6454 tablet_replica.cc:333] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.814076  6454 raft_consensus.cc:2243] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.814539  6454 raft_consensus.cc:2272] T 87a9dfc4b1674a7785d62d3db380c9cf P 3f59eee95bae45828184f266524f0e6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.816401  6454 tablet_replica.cc:333] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.816920  6454 raft_consensus.cc:2243] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 2 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.817799  6454 raft_consensus.cc:2272] T 6420220b679249c8b244b387453cde91 P 3f59eee95bae45828184f266524f0e6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.819693  6454 tablet_replica.cc:333] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a: stopping tablet replica
I20260501 13:58:17.820161  6454 raft_consensus.cc:2243] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.820658  6454 raft_consensus.cc:2272] T 16ef2a47f96046d1831bbaf8c3279469 P 3f59eee95bae45828184f266524f0e6a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260501 13:58:17.848215  7275 consensus_peers.cc:597] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a -> Peer 3f59eee95bae45828184f266524f0e6a (127.6.77.130:34079): Couldn't send request to peer 3f59eee95bae45828184f266524f0e6a. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:34079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.909626  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
I20260501 13:58:17.935467  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
W20260501 13:58:17.969971  7273 consensus_peers.cc:597] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a -> Peer 6d8ae211b9584459ab383e642801be69 (127.6.77.129:45931): Couldn't send request to peer 6d8ae211b9584459ab383e642801be69. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:45931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:17.980414  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 13:58:17.981307  6454 tablet_replica.cc:333] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:17.982116  6454 raft_consensus.cc:2243] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.982786  6454 raft_consensus.cc:2272] T 67f08af800f64472bb999f24e9f2b67b P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.985152  6454 tablet_replica.cc:333] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:17.985718  6454 raft_consensus.cc:2243] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 2 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.986572  6454 raft_consensus.cc:2272] T 6be1aca9ab3f400190daa1b72b757f73 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.988689  6454 tablet_replica.cc:333] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:17.989321  6454 raft_consensus.cc:2243] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.989820  6454 raft_consensus.cc:2272] T 08e9b52c2e434f0194ec2c36708f59be P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.991696  6454 tablet_replica.cc:333] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:17.992276  6454 raft_consensus.cc:2243] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:17.992774  6454 raft_consensus.cc:2272] T 6420220b679249c8b244b387453cde91 P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.994665  6454 tablet_replica.cc:333] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:17.995179  6454 raft_consensus.cc:2243] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.996131  6454 raft_consensus.cc:2272] T 16ef2a47f96046d1831bbaf8c3279469 P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:17.998019  6454 tablet_replica.cc:333] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:17.998575  6454 raft_consensus.cc:2243] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 4 LEADER]: Raft consensus shutting down.
I20260501 13:58:17.999426  6454 raft_consensus.cc:2272] T 1ed835eddfa64365a64f26e4d9565e4a P 178975541daa460c857a2d2995ccb56a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:18.001439  6454 tablet_replica.cc:333] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:18.001964  6454 raft_consensus.cc:2243] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:18.002429  6454 raft_consensus.cc:2272] T 98f4d5fd22044ee39abaaed7782dce52 P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:18.004449  6454 tablet_replica.cc:333] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:18.004937  6454 raft_consensus.cc:2243] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:18.005401  6454 raft_consensus.cc:2272] T 87a9dfc4b1674a7785d62d3db380c9cf P 178975541daa460c857a2d2995ccb56a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:18.007382  6454 tablet_replica.cc:333] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:18.007958  6454 raft_consensus.cc:2243] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:18.008414  6454 raft_consensus.cc:2272] T 2f0f33eb23b84e1ca3ee6f32ace765da P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:18.010423  6454 tablet_replica.cc:333] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a: stopping tablet replica
I20260501 13:58:18.010900  6454 raft_consensus.cc:2243] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:18.011390  6454 raft_consensus.cc:2272] T 87f49c7f51ef4ea3a4a58014a2e8be2c P 178975541daa460c857a2d2995ccb56a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:18.035650  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 13:58:18.072093  6454 master.cc:562] Master@127.6.77.190:37365 shutting down...
I20260501 13:58:18.104964  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 1 LEADER]: Raft consensus shutting down.
I20260501 13:58:18.105679  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:18.106040  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P efd3ed5a7d134ac89ba98486aeb98353: stopping tablet replica
W20260501 13:58:19.123924  6454 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7090)
I20260501 13:58:19.171759  6454 master.cc:584] Master@127.6.77.190:37365 shutdown complete.
178975541daa460c857a2d2995ccb56a  1
3f59eee95bae45828184f266524f0e6a  4
6d8ae211b9584459ab383e642801be69  5
178975541daa460c857a2d2995ccb56a  3
3f59eee95bae45828184f266524f0e6a  4
6d8ae211b9584459ab383e642801be69  3
178975541daa460c857a2d2995ccb56a  1
3f59eee95bae45828184f266524f0e6a  1
6d8ae211b9584459ab383e642801be69  8
178975541daa460c857a2d2995ccb56a  3
3f59eee95bae45828184f266524f0e6a  3
6d8ae211b9584459ab383e642801be69  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (30093 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260501 13:58:19.217795  6454 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.77.190:38503
I20260501 13:58:19.218963  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:58:19.225193  7552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.225551  7553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.226186  7555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:58:19.228322  6454 server_base.cc:1061] running on GCE node
I20260501 13:58:19.229295  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:58:19.229470  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:58:19.229668  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643899229635 us; error 0 us; skew 500 ppm
I20260501 13:58:19.230213  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:58:19.233136  6454 webserver.cc:492] Webserver started at http://127.6.77.190:42359/ using document root <none> and password file <none>
I20260501 13:58:19.233649  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:58:19.233839  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:58:19.234138  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:58:19.235337  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/master-0-root/instance:
uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.240118  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260501 13:58:19.243716  7560 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.244622  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260501 13:58:19.244946  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/master-0-root
uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.245203  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:58:19.264608  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:58:19.265846  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:58:19.307999  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.190:38503
I20260501 13:58:19.308144  7611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.190:38503 every 8 connection(s)
I20260501 13:58:19.312142  7612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:19.322975  7612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Bootstrap starting.
I20260501 13:58:19.328398  7612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:19.333318  7612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: No bootstrap required, opened a new log
I20260501 13:58:19.335744  7612 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" member_type: VOTER }
I20260501 13:58:19.336272  7612 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:19.336544  7612 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eb6c3b6d06a4c02bcd619b78c2cbb38, State: Initialized, Role: FOLLOWER
I20260501 13:58:19.337190  7612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" member_type: VOTER }
I20260501 13:58:19.337704  7612 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260501 13:58:19.337956  7612 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260501 13:58:19.338240  7612 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:19.342990  7612 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" member_type: VOTER }
I20260501 13:58:19.343573  7612 leader_election.cc:304] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0eb6c3b6d06a4c02bcd619b78c2cbb38; no voters: 
I20260501 13:58:19.344949  7612 leader_election.cc:290] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260501 13:58:19.345535  7615 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:19.347025  7615 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 LEADER]: Becoming Leader. State: Replica: 0eb6c3b6d06a4c02bcd619b78c2cbb38, State: Running, Role: LEADER
I20260501 13:58:19.347792  7615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" member_type: VOTER }
I20260501 13:58:19.348287  7612 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [sys.catalog]: configured and running, proceeding with master startup.
I20260501 13:58:19.353183  7616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" member_type: VOTER } }
I20260501 13:58:19.353299  7617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0eb6c3b6d06a4c02bcd619b78c2cbb38. Latest consensus state: current_term: 1 leader_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb6c3b6d06a4c02bcd619b78c2cbb38" member_type: VOTER } }
I20260501 13:58:19.354435  7616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [sys.catalog]: This master's current role is: LEADER
I20260501 13:58:19.354537  7617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [sys.catalog]: This master's current role is: LEADER
I20260501 13:58:19.362401  7623 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260501 13:58:19.367947  7623 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260501 13:58:19.368985  6454 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260501 13:58:19.377429  7623 catalog_manager.cc:1357] Generated new cluster ID: acd2f86e84ab433db59cc9d26855a8ba
I20260501 13:58:19.377719  7623 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260501 13:58:19.396790  7623 catalog_manager.cc:1380] Generated new certificate authority record
I20260501 13:58:19.398360  7623 catalog_manager.cc:1514] Loading token signing keys...
I20260501 13:58:19.411252  7623 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Generated new TSK 0
I20260501 13:58:19.411963  7623 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260501 13:58:19.435277  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:58:19.441753  7633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.443046  7634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.444783  7636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:58:19.445122  6454 server_base.cc:1061] running on GCE node
I20260501 13:58:19.446178  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:58:19.446372  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:58:19.446581  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643899446566 us; error 0 us; skew 500 ppm
I20260501 13:58:19.447108  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:58:19.450284  6454 webserver.cc:492] Webserver started at http://127.6.77.129:39141/ using document root <none> and password file <none>
I20260501 13:58:19.450740  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:58:19.450899  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:58:19.451122  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:58:19.452546  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/instance:
uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.457551  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260501 13:58:19.461346  7641 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.462178  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260501 13:58:19.462440  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.462715  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:58:19.481983  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:58:19.483234  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:58:19.484803  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:58:19.487255  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:58:19.487429  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.487725  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:58:19.487938  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260501 13:58:19.536661  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:36443
I20260501 13:58:19.536798  7703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:36443 every 8 connection(s)
I20260501 13:58:19.541788  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:58:19.550536  7708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.551896  7709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.554807  7711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:58:19.554843  6454 server_base.cc:1061] running on GCE node
I20260501 13:58:19.557374  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:58:19.557651  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:58:19.557849  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643899557810 us; error 0 us; skew 500 ppm
I20260501 13:58:19.558455  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:58:19.558519  7704 heartbeater.cc:344] Connected to a master server at 127.6.77.190:38503
I20260501 13:58:19.558949  7704 heartbeater.cc:461] Registering TS with master...
I20260501 13:58:19.560105  7704 heartbeater.cc:507] Master 127.6.77.190:38503 requested a full tablet report, sending...
I20260501 13:58:19.561710  6454 webserver.cc:492] Webserver started at http://127.6.77.130:40079/ using document root <none> and password file <none>
I20260501 13:58:19.562317  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:58:19.562510  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:58:19.562803  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:58:19.563180  7577 ts_manager.cc:194] Registered new tserver with Master: bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:19.564267  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/instance:
uuid: "109c9ba263c34ff8aee17bc446cf258e"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.565469  7577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57594
I20260501 13:58:19.569645  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260501 13:58:19.573155  7716 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.574100  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260501 13:58:19.574370  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root
uuid: "109c9ba263c34ff8aee17bc446cf258e"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.574631  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:58:19.600589  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:58:19.601887  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:58:19.603461  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:58:19.605882  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:58:19.606056  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.606371  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:58:19.606544  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.656885  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.130:41997
I20260501 13:58:19.657003  7778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.130:41997 every 8 connection(s)
I20260501 13:58:19.662089  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:58:19.670459  7782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:19.673187  7783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:58:19.675052  6454 server_base.cc:1061] running on GCE node
I20260501 13:58:19.675879  7779 heartbeater.cc:344] Connected to a master server at 127.6.77.190:38503
I20260501 13:58:19.676399  7779 heartbeater.cc:461] Registering TS with master...
W20260501 13:58:19.677103  7785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:58:19.677469  7779 heartbeater.cc:507] Master 127.6.77.190:38503 requested a full tablet report, sending...
I20260501 13:58:19.678143  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:58:19.678431  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:58:19.678646  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643899678626 us; error 0 us; skew 500 ppm
I20260501 13:58:19.679427  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:58:19.680281  7577 ts_manager.cc:194] Registered new tserver with Master: 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:19.682219  6454 webserver.cc:492] Webserver started at http://127.6.77.131:44025/ using document root <none> and password file <none>
I20260501 13:58:19.682274  7577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57608
I20260501 13:58:19.682956  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:58:19.683216  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:58:19.683552  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:58:19.685102  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/instance:
uuid: "ca8dd10afb304b4c96cfcec7e2309947"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.689834  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260501 13:58:19.693432  7790 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.694303  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260501 13:58:19.694623  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root
uuid: "ca8dd10afb304b4c96cfcec7e2309947"
format_stamp: "Formatted at 2026-05-01 13:58:19 on dist-test-slave-1sft"
I20260501 13:58:19.694875  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:58:19.706130  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:58:19.707332  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:58:19.708850  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:58:19.711270  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:58:19.711555  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:19.711839  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:58:19.712026  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260501 13:58:19.760027  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.131:35015
I20260501 13:58:19.760244  7852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.131:35015 every 8 connection(s)
I20260501 13:58:19.776572  7853 heartbeater.cc:344] Connected to a master server at 127.6.77.190:38503
I20260501 13:58:19.777053  7853 heartbeater.cc:461] Registering TS with master...
I20260501 13:58:19.777873  7853 heartbeater.cc:507] Master 127.6.77.190:38503 requested a full tablet report, sending...
I20260501 13:58:19.780474  7577 ts_manager.cc:194] Registered new tserver with Master: ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:19.780735  6454 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016518345s
I20260501 13:58:19.782044  7577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57618
I20260501 13:58:19.808851  7577 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 13:58:19.815984  7577 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260501 13:58:20.022025  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 43c8497c73c3498ca73ca16b7f2da7cd (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260501 13:58:20.025403  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 75d27004f21449f5bfdade4d62aeba88 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260501 13:58:20.025240  7816 tablet_service.cc:1511] Processing CreateTablet for tablet cac472405b2a42bb98dafbac4e20584b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260501 13:58:20.023882  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c8497c73c3498ca73ca16b7f2da7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.027490  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac472405b2a42bb98dafbac4e20584b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.029047  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d27004f21449f5bfdade4d62aeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.028743  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 43c8497c73c3498ca73ca16b7f2da7cd (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260501 13:58:20.030488  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c8497c73c3498ca73ca16b7f2da7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.038383  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 75d27004f21449f5bfdade4d62aeba88 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260501 13:58:20.039383  7666 tablet_service.cc:1511] Processing CreateTablet for tablet c6b7bef99f44450d853fce321082a78b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260501 13:58:20.039908  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d27004f21449f5bfdade4d62aeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.040771  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b7bef99f44450d853fce321082a78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.042222  7667 tablet_service.cc:1511] Processing CreateTablet for tablet cac472405b2a42bb98dafbac4e20584b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260501 13:58:20.043581  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac472405b2a42bb98dafbac4e20584b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.050587  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260501 13:58:20.052068  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.050587  7815 tablet_service.cc:1511] Processing CreateTablet for tablet c6b7bef99f44450d853fce321082a78b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260501 13:58:20.057757  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b7bef99f44450d853fce321082a78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.074910  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 43c8497c73c3498ca73ca16b7f2da7cd (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260501 13:58:20.076303  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c8497c73c3498ca73ca16b7f2da7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.085685  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 75d27004f21449f5bfdade4d62aeba88 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260501 13:58:20.087320  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d27004f21449f5bfdade4d62aeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.088403  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260501 13:58:20.089370  7741 tablet_service.cc:1511] Processing CreateTablet for tablet c6b7bef99f44450d853fce321082a78b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260501 13:58:20.090538  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.091784  7664 tablet_service.cc:1511] Processing CreateTablet for tablet f1ee722489b34f13bc6b2cc16825e5c9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260501 13:58:20.093158  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ee722489b34f13bc6b2cc16825e5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.093225  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260501 13:58:20.095028  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.097223  7742 tablet_service.cc:1511] Processing CreateTablet for tablet cac472405b2a42bb98dafbac4e20584b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260501 13:58:20.100389  7739 tablet_service.cc:1511] Processing CreateTablet for tablet f1ee722489b34f13bc6b2cc16825e5c9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260501 13:58:20.105124  7663 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab3422d02d5408caed8cf6c79922e21 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260501 13:58:20.106423  7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3422d02d5408caed8cf6c79922e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.108806  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b7bef99f44450d853fce321082a78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.108978  7662 tablet_service.cc:1511] Processing CreateTablet for tablet a7e6863e401d47c485d22868ddfb6a08 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260501 13:58:20.110232  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e6863e401d47c485d22868ddfb6a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.112154  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac472405b2a42bb98dafbac4e20584b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.113044  7661 tablet_service.cc:1511] Processing CreateTablet for tablet a769b271cb04497eb1cb86169399ceb2 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260501 13:58:20.114328  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a769b271cb04497eb1cb86169399ceb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.117017  7660 tablet_service.cc:1511] Processing CreateTablet for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260501 13:58:20.118305  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.122961  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab3422d02d5408caed8cf6c79922e21 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260501 13:58:20.123667  7811 tablet_service.cc:1511] Processing CreateTablet for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260501 13:58:20.123984  7738 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab3422d02d5408caed8cf6c79922e21 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260501 13:58:20.124538  7817 tablet_service.cc:1511] Processing CreateTablet for tablet f1ee722489b34f13bc6b2cc16825e5c9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260501 13:58:20.125301  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.125162  7813 tablet_service.cc:1511] Processing CreateTablet for tablet a7e6863e401d47c485d22868ddfb6a08 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260501 13:58:20.126569  7813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e6863e401d47c485d22868ddfb6a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.126411  7737 tablet_service.cc:1511] Processing CreateTablet for tablet a7e6863e401d47c485d22868ddfb6a08 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260501 13:58:20.128183  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ee722489b34f13bc6b2cc16825e5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.127632  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 5cde3c3e4a3b462b8f274fec8e2adbe3 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260501 13:58:20.128831  7736 tablet_service.cc:1511] Processing CreateTablet for tablet a769b271cb04497eb1cb86169399ceb2 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260501 13:58:20.129091  7812 tablet_service.cc:1511] Processing CreateTablet for tablet a769b271cb04497eb1cb86169399ceb2 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260501 13:58:20.131745  7735 tablet_service.cc:1511] Processing CreateTablet for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260501 13:58:20.133111  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ee722489b34f13bc6b2cc16825e5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.132769  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2975a86035451cb56a7caf76296505 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260501 13:58:20.136343  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cde3c3e4a3b462b8f274fec8e2adbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.140223  7812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a769b271cb04497eb1cb86169399ceb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.140741  7738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3422d02d5408caed8cf6c79922e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.143916  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3422d02d5408caed8cf6c79922e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.144749  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.145097  7869 tablet_bootstrap.cc:492] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:20.146437  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 5cde3c3e4a3b462b8f274fec8e2adbe3 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260501 13:58:20.147717  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cde3c3e4a3b462b8f274fec8e2adbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.147892  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a769b271cb04497eb1cb86169399ceb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.153388  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e6863e401d47c485d22868ddfb6a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.157836  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2975a86035451cb56a7caf76296505 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260501 13:58:20.159178  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2975a86035451cb56a7caf76296505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.164429  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 5ecf82e363814b0084cab2799c85ee9d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260501 13:58:20.165745  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecf82e363814b0084cab2799c85ee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.168597  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2975a86035451cb56a7caf76296505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.163666  7869 tablet_bootstrap.cc:654] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.172051  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 5ecf82e363814b0084cab2799c85ee9d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260501 13:58:20.173671  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecf82e363814b0084cab2799c85ee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.185837  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 39ab56a6d5d641c4b64cc945f297bd2b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260501 13:58:20.187412  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ab56a6d5d641c4b64cc945f297bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.199200  7868 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:20.212268  7868 tablet_bootstrap.cc:654] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.262306  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 39ab56a6d5d641c4b64cc945f297bd2b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260501 13:58:20.263618  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ab56a6d5d641c4b64cc945f297bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.270251  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 5cde3c3e4a3b462b8f274fec8e2adbe3 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260501 13:58:20.271557  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cde3c3e4a3b462b8f274fec8e2adbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.274456  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9517b581244993be7b40b089a96bd0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260501 13:58:20.282373  7869 tablet_bootstrap.cc:492] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:20.282863  7869 ts_tablet_manager.cc:1403] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.010s
I20260501 13:58:20.298661  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9517b581244993be7b40b089a96bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.314245  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 365625e9a5a1458e951f04698e1cc682 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260501 13:58:20.315541  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365625e9a5a1458e951f04698e1cc682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.297178  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9517b581244993be7b40b089a96bd0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260501 13:58:20.317560  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9517b581244993be7b40b089a96bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.308286  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 1551821b4ac3438ea79dc8c95256cfde (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260501 13:58:20.320547  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1551821b4ac3438ea79dc8c95256cfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.275473  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2975a86035451cb56a7caf76296505 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260501 13:58:20.322037  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2975a86035451cb56a7caf76296505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.284978  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 5ecf82e363814b0084cab2799c85ee9d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260501 13:58:20.329082  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecf82e363814b0084cab2799c85ee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.329759  7735 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9517b581244993be7b40b089a96bd0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260501 13:58:20.330216  7738 tablet_service.cc:1511] Processing CreateTablet for tablet 1551821b4ac3438ea79dc8c95256cfde (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260501 13:58:20.331069  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9517b581244993be7b40b089a96bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.328860  7811 tablet_service.cc:1511] Processing CreateTablet for tablet 365625e9a5a1458e951f04698e1cc682 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260501 13:58:20.335142  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365625e9a5a1458e951f04698e1cc682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.329128  7868 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:20.284255  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 1551821b4ac3438ea79dc8c95256cfde (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260501 13:58:20.336355  7868 ts_tablet_manager.cc:1403] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.138s	user 0.027s	sys 0.025s
I20260501 13:58:20.336912  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1551821b4ac3438ea79dc8c95256cfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.339370  7738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1551821b4ac3438ea79dc8c95256cfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.342950  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 39ab56a6d5d641c4b64cc945f297bd2b (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260501 13:58:20.344417  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ab56a6d5d641c4b64cc945f297bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.347247  7741 tablet_service.cc:1511] Processing CreateTablet for tablet 365625e9a5a1458e951f04698e1cc682 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260501 13:58:20.348559  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365625e9a5a1458e951f04698e1cc682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.349148  7660 tablet_service.cc:1511] Processing CreateTablet for tablet c469ec5051564ef892cf10d14e1eb6d4 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260501 13:58:20.350373  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469ec5051564ef892cf10d14e1eb6d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 13:58:20.361405  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:20.362792  7737 tablet_service.cc:1511] Processing CreateTablet for tablet c469ec5051564ef892cf10d14e1eb6d4 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260501 13:58:20.363124  7818 tablet_service.cc:1511] Processing CreateTablet for tablet c469ec5051564ef892cf10d14e1eb6d4 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260501 13:58:20.364223  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469ec5051564ef892cf10d14e1eb6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.364552  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469ec5051564ef892cf10d14e1eb6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.369040  7868 raft_consensus.cc:359] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:20.370025  7868 raft_consensus.cc:385] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.370455  7868 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.371380  7868 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:20.373859  7872 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:20.378682  7869 raft_consensus.cc:359] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.379568  7869 raft_consensus.cc:385] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.379917  7869 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.380966  7869 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.383592  7666 tablet_service.cc:1511] Processing CreateTablet for tablet fed0245aa0064b4c8685aeb38d1de9c0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260501 13:58:20.385057  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed0245aa0064b4c8685aeb38d1de9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.395897  7736 tablet_service.cc:1511] Processing CreateTablet for tablet fed0245aa0064b4c8685aeb38d1de9c0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260501 13:58:20.397514  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed0245aa0064b4c8685aeb38d1de9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.406903  7814 tablet_service.cc:1511] Processing CreateTablet for tablet fed0245aa0064b4c8685aeb38d1de9c0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260501 13:58:20.408233  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed0245aa0064b4c8685aeb38d1de9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.408983  7738 tablet_service.cc:1511] Processing CreateTablet for tablet f9b540df5a794f06ab617858163d4297 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260501 13:58:20.412837  7738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b540df5a794f06ab617858163d4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.414255  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 26c659157efb4e3ba3d97b7ad9d62068 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260501 13:58:20.415599  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c659157efb4e3ba3d97b7ad9d62068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.416833  7665 tablet_service.cc:1511] Processing CreateTablet for tablet f9b540df5a794f06ab617858163d4297 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260501 13:58:20.418051  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b540df5a794f06ab617858163d4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.418237  7735 tablet_service.cc:1511] Processing CreateTablet for tablet 26c659157efb4e3ba3d97b7ad9d62068 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260501 13:58:20.419425  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c659157efb4e3ba3d97b7ad9d62068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.419786  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 26c659157efb4e3ba3d97b7ad9d62068 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260501 13:58:20.423548  7704 heartbeater.cc:499] Master 127.6.77.190:38503 was elected leader, sending a full tablet report...
I20260501 13:58:20.423914  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c659157efb4e3ba3d97b7ad9d62068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.429322  7868 ts_tablet_manager.cc:1434] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.002s
I20260501 13:58:20.429370  7853 heartbeater.cc:499] Master 127.6.77.190:38503 was elected leader, sending a full tablet report...
I20260501 13:58:20.430315  7868 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:20.431996  7741 tablet_service.cc:1511] Processing CreateTablet for tablet 367eab87da314007b62b7bd0a0905d38 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260501 13:58:20.432780  7869 ts_tablet_manager.cc:1434] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.150s	user 0.006s	sys 0.003s
I20260501 13:58:20.433759  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367eab87da314007b62b7bd0a0905d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.443380  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 367eab87da314007b62b7bd0a0905d38 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260501 13:58:20.444864  7811 tablet_service.cc:1511] Processing CreateTablet for tablet 367eab87da314007b62b7bd0a0905d38 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260501 13:58:20.448833  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367eab87da314007b62b7bd0a0905d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.455479  7868 tablet_bootstrap.cc:654] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.446463  7872 tablet_bootstrap.cc:654] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.467990  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 0a337f1f80f84ec1b4f2ed376a8436ea (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260501 13:58:20.472445  7818 tablet_service.cc:1511] Processing CreateTablet for tablet f9b540df5a794f06ab617858163d4297 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260501 13:58:20.473816  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b540df5a794f06ab617858163d4297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.473598  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 0a337f1f80f84ec1b4f2ed376a8436ea (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260501 13:58:20.474802  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a337f1f80f84ec1b4f2ed376a8436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.475761  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 0a337f1f80f84ec1b4f2ed376a8436ea (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260501 13:58:20.477144  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a337f1f80f84ec1b4f2ed376a8436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.498225  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 3c14b33d5ea8424cb04207b894010749 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260501 13:58:20.509791  7869 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
W20260501 13:58:20.515573  7854 tablet.cc:2404] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260501 13:58:20.510687  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a337f1f80f84ec1b4f2ed376a8436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.518517  7660 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec67fee0d084477a66b6f72a7e73330 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260501 13:58:20.518846  7811 tablet_service.cc:1511] Processing CreateTablet for tablet 3c14b33d5ea8424cb04207b894010749 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260501 13:58:20.519966  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec67fee0d084477a66b6f72a7e73330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.520028  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c14b33d5ea8424cb04207b894010749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.524055  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec67fee0d084477a66b6f72a7e73330 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260501 13:58:20.525295  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 789c720014934abe950ad611625f9bc9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260501 13:58:20.523422  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 3c14b33d5ea8424cb04207b894010749 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260501 13:58:20.526621  7663 tablet_service.cc:1511] Processing CreateTablet for tablet 789c720014934abe950ad611625f9bc9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260501 13:58:20.527390  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c14b33d5ea8424cb04207b894010749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.537624  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c14b33d5ea8424cb04207b894010749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.541910  7813 tablet_service.cc:1511] Processing CreateTablet for tablet ef09d109d10447e796ab96c9a6eddef0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260501 13:58:20.545600  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec67fee0d084477a66b6f72a7e73330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.546515  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c720014934abe950ad611625f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.557459  7872 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:20.558010  7872 ts_tablet_manager.cc:1403] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.185s	user 0.008s	sys 0.021s
I20260501 13:58:20.560503  7668 tablet_service.cc:1511] Processing CreateTablet for tablet ef09d109d10447e796ab96c9a6eddef0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260501 13:58:20.545614  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 789c720014934abe950ad611625f9bc9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260501 13:58:20.562093  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c720014934abe950ad611625f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.562012  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1d6c31dce44935952b27fbc57a2d38 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260501 13:58:20.563401  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1d6c31dce44935952b27fbc57a2d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.546525  7739 tablet_service.cc:1511] Processing CreateTablet for tablet ef09d109d10447e796ab96c9a6eddef0 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260501 13:58:20.565218  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef09d109d10447e796ab96c9a6eddef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.566159  7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c720014934abe950ad611625f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.567800  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367eab87da314007b62b7bd0a0905d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.568456  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec67fee0d084477a66b6f72a7e73330 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260501 13:58:20.568905  7813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef09d109d10447e796ab96c9a6eddef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.569705  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec67fee0d084477a66b6f72a7e73330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.574576  7664 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1d6c31dce44935952b27fbc57a2d38 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260501 13:58:20.576249  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1d6c31dce44935952b27fbc57a2d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.589432  7869 tablet_bootstrap.cc:654] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.601758  7872 raft_consensus.cc:359] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.602738  7872 raft_consensus.cc:385] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.603075  7872 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.604192  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef09d109d10447e796ab96c9a6eddef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.609907  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1d6c31dce44935952b27fbc57a2d38 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260501 13:58:20.611289  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1d6c31dce44935952b27fbc57a2d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.604035  7872 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.661370  7660 tablet_service.cc:1511] Processing CreateTablet for tablet 4b13ab5be933469ba7c57247efb0f8e9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260501 13:58:20.663211  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13ab5be933469ba7c57247efb0f8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.670842  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 4b13ab5be933469ba7c57247efb0f8e9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260501 13:58:20.672304  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13ab5be933469ba7c57247efb0f8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.674744  7868 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:20.675276  7868 ts_tablet_manager.cc:1403] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.245s	user 0.010s	sys 0.021s
I20260501 13:58:20.675796  7664 tablet_service.cc:1511] Processing CreateTablet for tablet 0f623f4077ef4ffdad05ca3c40797b9f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260501 13:58:20.677228  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f623f4077ef4ffdad05ca3c40797b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.678895  7868 raft_consensus.cc:359] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.679733  7868 raft_consensus.cc:385] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.680122  7868 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.681054  7868 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.683866  7868 ts_tablet_manager.cc:1434] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260501 13:58:20.684152  7874 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:20.685225  7779 heartbeater.cc:499] Master 127.6.77.190:38503 was elected leader, sending a full tablet report...
I20260501 13:58:20.685273  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 4b13ab5be933469ba7c57247efb0f8e9 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260501 13:58:20.699745  7872 ts_tablet_manager.cc:1434] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.141s	user 0.014s	sys 0.006s
I20260501 13:58:20.698344  7874 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.712487  7873 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:20.712867  7872 tablet_bootstrap.cc:492] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:20.713021  7873 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:20.713904  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 0f623f4077ef4ffdad05ca3c40797b9f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260501 13:58:20.714295  7874 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:20.715258  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f623f4077ef4ffdad05ca3c40797b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.715449  7873 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:20.722769  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13ab5be933469ba7c57247efb0f8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.738232  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 2caa4d7579144326a3f173b9182831e8 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260501 13:58:20.727135  7872 tablet_bootstrap.cc:654] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.743394  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2caa4d7579144326a3f173b9182831e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.746100  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 3df4d60525ad4852996138e9e813b608 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260501 13:58:20.747677  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df4d60525ad4852996138e9e813b608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.738734  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 0f623f4077ef4ffdad05ca3c40797b9f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260501 13:58:20.749686  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f623f4077ef4ffdad05ca3c40797b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.753496  7664 tablet_service.cc:1511] Processing CreateTablet for tablet ee17e865655f4db7affb37902439a8be (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260501 13:58:20.754972  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee17e865655f4db7affb37902439a8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.759519  7868 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:20.761834  7869 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:20.762390  7869 ts_tablet_manager.cc:1403] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.254s	user 0.032s	sys 0.033s
I20260501 13:58:20.765837  7869 raft_consensus.cc:359] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:20.766538  7737 tablet_service.cc:1511] Processing CreateTablet for tablet ee17e865655f4db7affb37902439a8be (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260501 13:58:20.767141  7868 tablet_bootstrap.cc:654] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.767931  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee17e865655f4db7affb37902439a8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.769430  7869 raft_consensus.cc:385] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.774758  7869 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.776192  7869 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:20.778698  7869 ts_tablet_manager.cc:1434] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260501 13:58:20.790016  7869 tablet_bootstrap.cc:492] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:20.804230  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 2caa4d7579144326a3f173b9182831e8 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260501 13:58:20.805773  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2caa4d7579144326a3f173b9182831e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.805644  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 2caa4d7579144326a3f173b9182831e8 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260501 13:58:20.806967  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2caa4d7579144326a3f173b9182831e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.809998  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 3df4d60525ad4852996138e9e813b608 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260501 13:58:20.811359  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df4d60525ad4852996138e9e813b608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.812863  7868 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:20.813410  7868 ts_tablet_manager.cc:1403] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.008s
I20260501 13:58:20.816844  7868 raft_consensus.cc:359] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.819802  7810 tablet_service.cc:1511] Processing CreateTablet for tablet ee17e865655f4db7affb37902439a8be (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260501 13:58:20.826608  7660 tablet_service.cc:1511] Processing CreateTablet for tablet 4d228d3d4af349679aafa8dfdebf1247 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260501 13:58:20.826925  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 4d228d3d4af349679aafa8dfdebf1247 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260501 13:58:20.827250  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 3df4d60525ad4852996138e9e813b608 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260501 13:58:20.826930  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 4d228d3d4af349679aafa8dfdebf1247 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260501 13:58:20.835196  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d228d3d4af349679aafa8dfdebf1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.835603  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d228d3d4af349679aafa8dfdebf1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.836803  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 47951612b03c496aa487574a115ca380 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260501 13:58:20.829527  7868 raft_consensus.cc:385] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.842680  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 47951612b03c496aa487574a115ca380 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260501 13:58:20.847754  7872 tablet_bootstrap.cc:492] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:20.848366  7872 ts_tablet_manager.cc:1403] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.136s	user 0.023s	sys 0.002s
I20260501 13:58:20.848718  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47951612b03c496aa487574a115ca380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.850407  7873 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:20.850854  7873 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.844802  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d228d3d4af349679aafa8dfdebf1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.845284  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee17e865655f4db7affb37902439a8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.853072  7873 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:20.859308  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47951612b03c496aa487574a115ca380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.851676  7872 raft_consensus.cc:359] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.862380  7872 raft_consensus.cc:385] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:20.862715  7872 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.864812  7868 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:20.865633  7868 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.867060  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df4d60525ad4852996138e9e813b608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.868870  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:20.873462  7643 leader_election.cc:343] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:20.880708  7872 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.881218  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:20.884214  7811 tablet_service.cc:1511] Processing CreateTablet for tablet 47951612b03c496aa487574a115ca380 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260501 13:58:20.884157  7735 tablet_service.cc:1511] Processing CreateTablet for tablet 539945233a6f4f6589f58e774245669e (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260501 13:58:20.885609  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47951612b03c496aa487574a115ca380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.886325  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539945233a6f4f6589f58e774245669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.886682  7872 ts_tablet_manager.cc:1434] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260501 13:58:20.887641  7872 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:20.889308  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 539945233a6f4f6589f58e774245669e (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260501 13:58:20.890568  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539945233a6f4f6589f58e774245669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.892936  7868 ts_tablet_manager.cc:1434] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.002s
W20260501 13:58:20.893554  7643 leader_election.cc:343] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:20.907056  7813 tablet_service.cc:1511] Processing CreateTablet for tablet 539945233a6f4f6589f58e774245669e (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260501 13:58:20.909348  7869 tablet_bootstrap.cc:654] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.911134  7813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539945233a6f4f6589f58e774245669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.902886  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:20.916668  7874 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:20.917021  7878 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:20.920374  7872 tablet_bootstrap.cc:654] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:20.920288  7878 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:20.924654  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 43e99f3322c2477888132a818eae4971 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260501 13:58:20.926005  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e99f3322c2477888132a818eae4971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.950893  7868 tablet_bootstrap.cc:492] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:20.970088  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 43e99f3322c2477888132a818eae4971 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260501 13:58:20.971487  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e99f3322c2477888132a818eae4971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.990305  7878 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:20.991707  7665 tablet_service.cc:1511] Processing CreateTablet for tablet c1e64ae6fa3e42b5be743466a0338478 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260501 13:58:20.992756  7817 tablet_service.cc:1511] Processing CreateTablet for tablet c1e64ae6fa3e42b5be743466a0338478 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260501 13:58:20.993664  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e64ae6fa3e42b5be743466a0338478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.994057  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e64ae6fa3e42b5be743466a0338478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:20.994295  7737 tablet_service.cc:1511] Processing CreateTablet for tablet c1e64ae6fa3e42b5be743466a0338478 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260501 13:58:20.991068  7878 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.006742  7663 tablet_service.cc:1511] Processing CreateTablet for tablet 962840f0434049bbb395d330e010962d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260501 13:58:21.008289  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 43e99f3322c2477888132a818eae4971 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260501 13:58:21.009558  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e99f3322c2477888132a818eae4971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.012183  7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962840f0434049bbb395d330e010962d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.023918  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e64ae6fa3e42b5be743466a0338478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.045737  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 962840f0434049bbb395d330e010962d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260501 13:58:21.047353  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962840f0434049bbb395d330e010962d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.047259  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 484e3aa806394c42a224a8dbb213dd30 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260501 13:58:21.048652  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484e3aa806394c42a224a8dbb213dd30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.049880  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 962840f0434049bbb395d330e010962d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260501 13:58:21.051149  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962840f0434049bbb395d330e010962d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.054826  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 959ae22d6e614940b93df344dbf7fa20 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260501 13:58:21.056627  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959ae22d6e614940b93df344dbf7fa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.058981  7664 tablet_service.cc:1511] Processing CreateTablet for tablet 484e3aa806394c42a224a8dbb213dd30 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260501 13:58:21.060386  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484e3aa806394c42a224a8dbb213dd30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.061175  7735 tablet_service.cc:1511] Processing CreateTablet for tablet 959ae22d6e614940b93df344dbf7fa20 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260501 13:58:21.062879  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959ae22d6e614940b93df344dbf7fa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.003705  7878 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.069857  7878 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.070627  7868 tablet_bootstrap.cc:700] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Time spent opening tablet: real 0.107s	user 0.002s	sys 0.002s
I20260501 13:58:21.070739  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 3031b746c62f413a9da6fed211d638da (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260501 13:58:21.071384  7868 tablet_bootstrap.cc:654] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.070935  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 3031b746c62f413a9da6fed211d638da (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260501 13:58:21.072100  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3031b746c62f413a9da6fed211d638da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.072549  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3031b746c62f413a9da6fed211d638da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.084858  7869 tablet_bootstrap.cc:492] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.085575  7869 ts_tablet_manager.cc:1403] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.306s	user 0.019s	sys 0.004s
I20260501 13:58:21.089771  7869 raft_consensus.cc:359] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.090749  7869 raft_consensus.cc:385] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.091125  7869 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.092061  7869 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.095085  7869 ts_tablet_manager.cc:1434] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260501 13:58:21.096431  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 484e3aa806394c42a224a8dbb213dd30 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260501 13:58:21.097350  7869 tablet_bootstrap.cc:492] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.097824  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484e3aa806394c42a224a8dbb213dd30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.108611  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 3031b746c62f413a9da6fed211d638da (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260501 13:58:21.109109  7744 tablet_service.cc:1511] Processing CreateTablet for tablet eed0026bd9c541b7b89c956e31761d54 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260501 13:58:21.110360  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3031b746c62f413a9da6fed211d638da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.110756  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed0026bd9c541b7b89c956e31761d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.112619  7874 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.113245  7874 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:21.115978  7812 tablet_service.cc:1511] Processing CreateTablet for tablet eed0026bd9c541b7b89c956e31761d54 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260501 13:58:21.117652  7812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed0026bd9c541b7b89c956e31761d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.142939  7669 tablet_service.cc:1511] Processing CreateTablet for tablet eed0026bd9c541b7b89c956e31761d54 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260501 13:58:21.143262  7667 tablet_service.cc:1511] Processing CreateTablet for tablet c445f628c10d40b5a232bb391c4c92de (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260501 13:58:21.144564  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed0026bd9c541b7b89c956e31761d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.160431  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c445f628c10d40b5a232bb391c4c92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.174731  7811 tablet_service.cc:1511] Processing CreateTablet for tablet c445f628c10d40b5a232bb391c4c92de (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260501 13:58:21.178095  7872 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:21.178654  7872 ts_tablet_manager.cc:1403] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.291s	user 0.020s	sys 0.012s
I20260501 13:58:21.180516  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.181262  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:21.181540  7736 tablet_service.cc:1511] Processing CreateTablet for tablet 91eb60ac1c7a48a0b3662ef7e5327f66 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260501 13:58:21.182001  7872 raft_consensus.cc:359] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:21.182703  7872 raft_consensus.cc:385] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.182963  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eb60ac1c7a48a0b3662ef7e5327f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.184484  7874 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:21.185348  7738 tablet_service.cc:1511] Processing CreateTablet for tablet c4f9a0d66d094218a7a19cb600d50a75 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260501 13:58:21.186702  7738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f9a0d66d094218a7a19cb600d50a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.189939  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 1f875366331345f08d2e236a76c1c71d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260501 13:58:21.191468  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f875366331345f08d2e236a76c1c71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.182976  7872 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.193359  7872 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:21.199769  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 91eb60ac1c7a48a0b3662ef7e5327f66 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260501 13:58:21.200380  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 959ae22d6e614940b93df344dbf7fa20 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260501 13:58:21.201243  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eb60ac1c7a48a0b3662ef7e5327f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.201696  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959ae22d6e614940b93df344dbf7fa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.204360  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:21.204804  7741 tablet_service.cc:1511] Processing CreateTablet for tablet ac3b0214563f48f689fc427a69b7b5dd (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260501 13:58:21.205052  7754 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:21.206449  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:21.207145  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:21.208159  7873 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:21.208534  7873 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:21.208854  7873 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.209122  7874 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.209625  7874 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.216946  7873 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:21.217029  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:21.239393  7662 tablet_service.cc:1511] Processing CreateTablet for tablet ac3b0214563f48f689fc427a69b7b5dd (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260501 13:58:21.217458  7792 leader_election.cc:343] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.219064  7872 ts_tablet_manager.cc:1434] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260501 13:58:21.220609  7743 tablet_service.cc:1511] Processing CreateTablet for tablet c445f628c10d40b5a232bb391c4c92de (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260501 13:58:21.211625  7869 tablet_bootstrap.cc:654] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.243850  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3b0214563f48f689fc427a69b7b5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.225371  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:21.244475  7754 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:21.244897  7873 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:21.245604  7828 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:21.215728  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.224973  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:21.248384  7753 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:21.225644  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:21.249590  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:21.228813  7660 tablet_service.cc:1511] Processing CreateTablet for tablet c4f9a0d66d094218a7a19cb600d50a75 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260501 13:58:21.251338  7792 leader_election.cc:343] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.251957  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f9a0d66d094218a7a19cb600d50a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.251811  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:21.253124  7873 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:21.211802  7874 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.256325  7874 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:21.258754  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:21.224239  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c445f628c10d40b5a232bb391c4c92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.259305  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c445f628c10d40b5a232bb391c4c92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.223666  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 1f875366331345f08d2e236a76c1c71d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260501 13:58:21.259305  7753 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.256709  7874 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:21.280046  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:21.281962  7813 tablet_service.cc:1511] Processing CreateTablet for tablet 91eb60ac1c7a48a0b3662ef7e5327f66 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260501 13:58:21.282657  7718 leader_election.cc:343] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.283476  7813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eb60ac1c7a48a0b3662ef7e5327f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.284176  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:21.285836  7718 leader_election.cc:343] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.290474  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 4262547d9184416ab702339797bead6f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260501 13:58:21.276686  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3b0214563f48f689fc427a69b7b5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.292919  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f875366331345f08d2e236a76c1c71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.292300  7874 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.294505  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262547d9184416ab702339797bead6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.296926  7872 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:21.298252  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 1f875366331345f08d2e236a76c1c71d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260501 13:58:21.299582  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f875366331345f08d2e236a76c1c71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.313328  7868 tablet_bootstrap.cc:492] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:21.313880  7868 ts_tablet_manager.cc:1403] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.396s	user 0.012s	sys 0.006s
I20260501 13:58:21.314352  7817 tablet_service.cc:1511] Processing CreateTablet for tablet c4f9a0d66d094218a7a19cb600d50a75 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260501 13:58:21.317513  7868 raft_consensus.cc:359] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.318410  7868 raft_consensus.cc:385] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.318786  7868 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.319730  7868 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.322535  7868 ts_tablet_manager.cc:1434] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260501 13:58:21.338516  7816 tablet_service.cc:1511] Processing CreateTablet for tablet ac3b0214563f48f689fc427a69b7b5dd (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260501 13:58:21.335656  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f9a0d66d094218a7a19cb600d50a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.343191  7741 tablet_service.cc:1511] Processing CreateTablet for tablet 23c164f5975a45b495c25c9e99b628d3 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260501 13:58:21.327293  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 4262547d9184416ab702339797bead6f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260501 13:58:21.350396  7753 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:21.351809  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c164f5975a45b495c25c9e99b628d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.351876  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262547d9184416ab702339797bead6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.352648  7868 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:21.354077  7872 tablet_bootstrap.cc:654] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.357160  7661 tablet_service.cc:1511] Processing CreateTablet for tablet b217e36f6e5e4fc38ba6e4ad89082fc6 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260501 13:58:21.358486  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b217e36f6e5e4fc38ba6e4ad89082fc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 13:58:21.303805  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54293.4us
I20260501 13:58:21.369233  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:21.372622  7740 tablet_service.cc:1511] Processing CreateTablet for tablet b217e36f6e5e4fc38ba6e4ad89082fc6 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260501 13:58:21.375897  7663 tablet_service.cc:1511] Processing CreateTablet for tablet 23c164f5975a45b495c25c9e99b628d3 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260501 13:58:21.381992  7873 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
W20260501 13:58:21.383518  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:21.384881  7812 tablet_service.cc:1511] Processing CreateTablet for tablet 4262547d9184416ab702339797bead6f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260501 13:58:21.397377  7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c164f5975a45b495c25c9e99b628d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.401945  7739 tablet_service.cc:1511] Processing CreateTablet for tablet c91be7730b684fbd94e69655ab35fd61 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260501 13:58:21.403299  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c91be7730b684fbd94e69655ab35fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.390519  7814 tablet_service.cc:1511] Processing CreateTablet for tablet b217e36f6e5e4fc38ba6e4ad89082fc6 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260501 13:58:21.404157  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3b0214563f48f689fc427a69b7b5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.406225  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b217e36f6e5e4fc38ba6e4ad89082fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.408643  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b217e36f6e5e4fc38ba6e4ad89082fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.409631  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 23c164f5975a45b495c25c9e99b628d3 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260501 13:58:21.410173  7812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262547d9184416ab702339797bead6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.412500  7667 tablet_service.cc:1511] Processing CreateTablet for tablet c91be7730b684fbd94e69655ab35fd61 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260501 13:58:21.394870  7874 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.413730  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c91be7730b684fbd94e69655ab35fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.421307  7874 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.427134  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c164f5975a45b495c25c9e99b628d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.446096  7868 tablet_bootstrap.cc:654] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:21.448838  7643 leader_election.cc:343] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.448987  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.450168  7678 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:21.450134  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:21.451692  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:21.452098  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.453073  7891 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.453406  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:21.454041  7679 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:21.460124  7718 leader_election.cc:343] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.460613  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:21.460803  7869 tablet_bootstrap.cc:492] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.460848  7668 tablet_service.cc:1511] Processing CreateTablet for tablet c6dc2741afba411fbd7695217702cdda (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260501 13:58:21.461450  7869 ts_tablet_manager.cc:1403] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.365s	user 0.024s	sys 0.027s
I20260501 13:58:21.461386  7878 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:21.462361  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6dc2741afba411fbd7695217702cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.463622  7891 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:21.464846  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:21.465915  7815 tablet_service.cc:1511] Processing CreateTablet for tablet c91be7730b684fbd94e69655ab35fd61 (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260501 13:58:21.467307  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c91be7730b684fbd94e69655ab35fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.468875  7810 tablet_service.cc:1511] Processing CreateTablet for tablet c6dc2741afba411fbd7695217702cdda (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260501 13:58:21.470191  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6dc2741afba411fbd7695217702cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.476316  7873 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:21.477376  7873 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } }
I20260501 13:58:21.477927  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:21.480130  7736 tablet_service.cc:1511] Processing CreateTablet for tablet c6dc2741afba411fbd7695217702cdda (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260501 13:58:21.480388  7899 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.480989  7899 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.485572  7872 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:21.486083  7872 ts_tablet_manager.cc:1403] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.189s	user 0.022s	sys 0.039s
I20260501 13:58:21.487566  7664 tablet_service.cc:1511] Processing CreateTablet for tablet 294b76c5890f455f97130fdbedace9af (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260501 13:58:21.488883  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294b76c5890f455f97130fdbedace9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.489117  7872 raft_consensus.cc:359] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.489843  7872 raft_consensus.cc:385] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.490134  7872 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.490247  7753 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:21.491160  7899 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:21.491012  7872 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.493297  7872 ts_tablet_manager.cc:1434] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260501 13:58:21.493786  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6dc2741afba411fbd7695217702cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.493935  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:21.525646  7869 raft_consensus.cc:359] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.526760  7869 raft_consensus.cc:385] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.527137  7869 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.540473  7872 tablet_bootstrap.cc:492] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:21.542763  7900 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.543278  7900 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.544935  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.545312  7900 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:21.546773  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:21.548136  7896 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
W20260501 13:58:21.548415  7643 leader_election.cc:343] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:21.571981  7792 leader_election.cc:343] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.574698  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:21.574747  7792 leader_election.cc:343] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.575839  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:21.576995  7900 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:21.584476  7869 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.582661  7896 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:21.589551  7896 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:21.582741  7792 leader_election.cc:343] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.593604  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.594496  7677 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:21.595691  7577 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:21.582849  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:21.597370  7874 raft_consensus.cc:2764] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260501 13:58:21.601147  7736 tablet_service.cc:1511] Processing CreateTablet for tablet 294b76c5890f455f97130fdbedace9af (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260501 13:58:21.602526  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294b76c5890f455f97130fdbedace9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.606667  7741 tablet_service.cc:1511] Processing CreateTablet for tablet 8489b3d6a1b74818947d84d7c795a5fb (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260501 13:58:21.607937  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8489b3d6a1b74818947d84d7c795a5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.607758  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 8489b3d6a1b74818947d84d7c795a5fb (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260501 13:58:21.612975  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 294b76c5890f455f97130fdbedace9af (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260501 13:58:21.609040  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8489b3d6a1b74818947d84d7c795a5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.599485  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:21.619923  7891 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.620396  7891 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.621294  7868 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:21.621841  7868 ts_tablet_manager.cc:1403] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.269s	user 0.018s	sys 0.042s
I20260501 13:58:21.622534  7891 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.625300  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:58:21.626539  7718 leader_election.cc:343] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.619654  7873 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:21.627509  7873 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:21.628026  7873 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.633810  7872 tablet_bootstrap.cc:654] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.637388  7873 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.639683  7873 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:21.640897  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:21.641570  7679 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.641851  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:21.643291  7792 leader_election.cc:343] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.651275  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:21.652801  7718 leader_election.cc:343] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.653319  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:21.658237  7891 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:21.659545  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294b76c5890f455f97130fdbedace9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.661170  7868 raft_consensus.cc:359] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.661463  7679 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:21.661407  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 8489b3d6a1b74818947d84d7c795a5fb (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260501 13:58:21.665691  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8489b3d6a1b74818947d84d7c795a5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.664049  7868 raft_consensus.cc:385] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.666231  7868 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.667099  7868 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.670553  7868 ts_tablet_manager.cc:1434] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260501 13:58:21.671918  7868 tablet_bootstrap.cc:492] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:21.662942  7869 ts_tablet_manager.cc:1434] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.201s	user 0.023s	sys 0.022s
I20260501 13:58:21.671144  7576 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:21.673229  7869 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.680996  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:21.682199  7900 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:21.682693  7900 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:21.683518  7900 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.687398  7737 tablet_service.cc:1511] Processing CreateTablet for tablet b1911462b92946d6b35f09cf9509128d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260501 13:58:21.688371  7662 tablet_service.cc:1511] Processing CreateTablet for tablet b1911462b92946d6b35f09cf9509128d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260501 13:58:21.688930  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1911462b92946d6b35f09cf9509128d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.689488  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1911462b92946d6b35f09cf9509128d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.695896  7669 tablet_service.cc:1511] Processing CreateTablet for tablet d76c50227fdf4363bff9df76fdb05b2f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260501 13:58:21.697238  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76c50227fdf4363bff9df76fdb05b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.704823  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 7211edc2aa9543b3996e3279fffe4edc (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260501 13:58:21.705664  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 7211edc2aa9543b3996e3279fffe4edc (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260501 13:58:21.706162  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7211edc2aa9543b3996e3279fffe4edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.703382  7660 tablet_service.cc:1511] Processing CreateTablet for tablet 7211edc2aa9543b3996e3279fffe4edc (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260501 13:58:21.707242  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7211edc2aa9543b3996e3279fffe4edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.688946  7810 tablet_service.cc:1511] Processing CreateTablet for tablet b1911462b92946d6b35f09cf9509128d (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260501 13:58:21.708961  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1911462b92946d6b35f09cf9509128d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.710572  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7211edc2aa9543b3996e3279fffe4edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.701035  7736 tablet_service.cc:1511] Processing CreateTablet for tablet d76c50227fdf4363bff9df76fdb05b2f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260501 13:58:21.714563  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76c50227fdf4363bff9df76fdb05b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.714284  7663 tablet_service.cc:1511] Processing CreateTablet for tablet 93b661856a9e45bf823981177d99ae0c (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260501 13:58:21.715528  7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b661856a9e45bf823981177d99ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.720391  7868 tablet_bootstrap.cc:654] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.729038  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 93b661856a9e45bf823981177d99ae0c (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260501 13:58:21.728977  7818 tablet_service.cc:1511] Processing CreateTablet for tablet d76c50227fdf4363bff9df76fdb05b2f (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260501 13:58:21.723702  7869 tablet_bootstrap.cc:654] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.739703  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b661856a9e45bf823981177d99ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.744122  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76c50227fdf4363bff9df76fdb05b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.756392  7872 tablet_bootstrap.cc:492] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:21.757014  7872 ts_tablet_manager.cc:1403] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.217s	user 0.012s	sys 0.011s
I20260501 13:58:21.760195  7872 raft_consensus.cc:359] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.760958  7872 raft_consensus.cc:385] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.761264  7872 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.762022  7872 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.765288  7872 ts_tablet_manager.cc:1434] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260501 13:58:21.752705  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 93b661856a9e45bf823981177d99ae0c (DEFAULT_TABLE table=test-workload [id=c5936b8507254212aa6fe952ce09c0eb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260501 13:58:21.777328  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b661856a9e45bf823981177d99ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:21.790671  7872 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:21.796072  7872 tablet_bootstrap.cc:654] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.798727  7869 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.799307  7869 ts_tablet_manager.cc:1403] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.005s
I20260501 13:58:21.801589  7868 tablet_bootstrap.cc:492] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:21.802182  7868 ts_tablet_manager.cc:1403] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.008s
I20260501 13:58:21.802712  7869 raft_consensus.cc:359] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.803496  7869 raft_consensus.cc:385] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.805133  7869 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.805583  7868 raft_consensus.cc:359] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.805878  7869 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.806387  7868 raft_consensus.cc:385] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.806818  7868 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.808523  7869 ts_tablet_manager.cc:1434] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260501 13:58:21.809609  7869 tablet_bootstrap.cc:492] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.809717  7872 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:21.810294  7872 ts_tablet_manager.cc:1403] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260501 13:58:21.811167  7896 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.811662  7896 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.813722  7896 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.813436  7872 raft_consensus.cc:359] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.814170  7872 raft_consensus.cc:385] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.814473  7872 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.815399  7868 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.815615  7577 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:21.817191  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:21.817806  7828 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:21.819034  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:21.816110  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:21.820104  7896 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:21.820452  7896 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:21.820784  7896 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.821487  7872 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.824754  7869 tablet_bootstrap.cc:654] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.828502  7878 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:21.829018  7878 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.831068  7878 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.831408  7868 ts_tablet_manager.cc:1434] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260501 13:58:21.832968  7872 ts_tablet_manager.cc:1434] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.005s
W20260501 13:58:21.833425  7643 leader_election.cc:343] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.834050  7872 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:21.834595  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:21.836608  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:21.837990  7718 leader_election.cc:343] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.838506  7868 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
W20260501 13:58:21.839218  7718 leader_election.cc:343] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.839677  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:21.841622  7878 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:21.842795  7872 tablet_bootstrap.cc:654] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.843379  7896 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.846369  7896 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:21.847905  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:21.850611  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:21.853204  7828 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:21.853837  7868 tablet_bootstrap.cc:654] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:21.852476  7643 leader_election.cc:343] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:21.865559  7869 tablet_bootstrap.cc:492] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.866156  7869 ts_tablet_manager.cc:1403] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260501 13:58:21.867986  7872 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:21.868477  7872 ts_tablet_manager.cc:1403] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.014s
I20260501 13:58:21.870139  7869 raft_consensus.cc:359] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.870908  7869 raft_consensus.cc:385] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.871210  7869 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.871829  7828 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:21.865559  7868 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:21.871137  7872 raft_consensus.cc:359] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.872633  7868 ts_tablet_manager.cc:1403] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.001s
I20260501 13:58:21.873133  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:21.874051  7896 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:21.872659  7869 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.874516  7896 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:21.875399  7896 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.876351  7869 ts_tablet_manager.cc:1434] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260501 13:58:21.877066  7872 raft_consensus.cc:385] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.877417  7872 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.877842  7869 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.878930  7872 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.876372  7868 raft_consensus.cc:359] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.882665  7868 raft_consensus.cc:385] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.883047  7868 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.884117  7868 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.885423  7869 tablet_bootstrap.cc:654] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.888427  7868 ts_tablet_manager.cc:1434] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260501 13:58:21.889739  7868 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:21.881553  7872 ts_tablet_manager.cc:1434] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260501 13:58:21.902560  7872 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:21.902480  7576 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:21.903219  7900 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:21.907683  7869 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.908239  7869 ts_tablet_manager.cc:1403] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.011s
I20260501 13:58:21.909029  7868 tablet_bootstrap.cc:654] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.911795  7869 raft_consensus.cc:359] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.912654  7869 raft_consensus.cc:385] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.912945  7869 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.914758  7869 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.916728  7872 tablet_bootstrap.cc:654] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.918165  7869 ts_tablet_manager.cc:1434] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260501 13:58:21.920135  7869 tablet_bootstrap.cc:492] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.927196  7869 tablet_bootstrap.cc:654] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.933516  7900 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:21.940580  7869 tablet_bootstrap.cc:492] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.941133  7869 ts_tablet_manager.cc:1403] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260501 13:58:21.944095  7869 raft_consensus.cc:359] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.944782  7869 raft_consensus.cc:385] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.945065  7869 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.946014  7869 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.948261  7869 ts_tablet_manager.cc:1434] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 13:58:21.949162  7869 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.954633  7869 tablet_bootstrap.cc:654] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.967061  7869 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.967526  7869 ts_tablet_manager.cc:1403] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260501 13:58:21.971252  7869 raft_consensus.cc:359] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.972047  7869 raft_consensus.cc:385] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:21.972307  7869 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:21.973054  7869 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:21.975304  7869 ts_tablet_manager.cc:1434] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:58:21.976248  7869 tablet_bootstrap.cc:492] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:21.981885  7869 tablet_bootstrap.cc:654] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:21.995772  7869 tablet_bootstrap.cc:492] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:21.996381  7868 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:21.996419  7869 ts_tablet_manager.cc:1403] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260501 13:58:21.996961  7868 ts_tablet_manager.cc:1403] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.107s	user 0.043s	sys 0.043s
I20260501 13:58:21.999966  7873 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.000437  7873 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.000385  7869 raft_consensus.cc:359] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.000602  7868 raft_consensus.cc:359] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.001391  7869 raft_consensus.cc:385] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.001561  7868 raft_consensus.cc:385] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.001941  7869 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.002656  7873 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:22.001984  7868 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.003052  7869 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.003613  7868 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.003965  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.004598  7754 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:22.005182  7873 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.005375  7872 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:22.005905  7872 ts_tablet_manager.cc:1403] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.104s	user 0.033s	sys 0.050s
I20260501 13:58:22.005709  7873 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.005977  7869 ts_tablet_manager.cc:1434] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260501 13:58:22.006024  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.007346  7869 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:22.007751  7873 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:22.008271  7873 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.008595  7873 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.008935  7873 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.009958  7872 raft_consensus.cc:359] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.011155  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.010648  7872 raft_consensus.cc:385] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.011730  7872 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.012530  7872 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.013603  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.014249  7754 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:22.015471  7869 tablet_bootstrap.cc:654] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.016942  7868 ts_tablet_manager.cc:1434] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260501 13:58:22.017205  7896 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.017967  7868 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:22.017696  7896 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.019658  7878 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.019732  7896 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.020192  7878 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.022398  7878 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.024241  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.024924  7828 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:22.026193  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.026476  7868 tablet_bootstrap.cc:654] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.020310  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.027061  7878 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.027411  7878 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.028650  7878 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.029486  7900 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.029875  7900 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.030206  7900 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.031836  7872 ts_tablet_manager.cc:1434] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260501 13:58:22.031524  7873 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.032836  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.033506  7872 tablet_bootstrap.cc:492] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:22.034198  7873 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:22.027462  7792 leader_election.cc:343] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.045152  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.046669  7828 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
W20260501 13:58:22.048990  7792 leader_election.cc:343] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.049158  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.050014  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:58:22.051357  7643 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:22.038286  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.049204  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.055456  7753 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.069005  7872 tablet_bootstrap.cc:654] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.076175  7878 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:22.082088  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:22.093016  7900 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.093971  7753 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:22.095293  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.096451  7930 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.096956  7930 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:22.097191  7878 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.098629  7930 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.102996  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.103345  7900 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:22.079726  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.103688  7828 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.105465  7868 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:22.106129  7868 ts_tablet_manager.cc:1403] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.016s
W20260501 13:58:22.107507  7718 leader_election.cc:343] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.104280  7896 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.108522  7896 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.108915  7896 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.113142  7868 raft_consensus.cc:359] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.114133  7868 raft_consensus.cc:385] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.114496  7868 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
W20260501 13:58:22.117915  7792 leader_election.cc:343] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.118191  7828 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:22.120157  7868 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.120990  7869 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:22.121556  7869 ts_tablet_manager.cc:1403] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.114s	user 0.026s	sys 0.025s
I20260501 13:58:22.122572  7868 ts_tablet_manager.cc:1434] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260501 13:58:22.122159  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.123335  7868 tablet_bootstrap.cc:492] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:22.124496  7878 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.125048  7878 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:22.125228  7869 raft_consensus.cc:359] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.125912  7869 raft_consensus.cc:385] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.126222  7869 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.126003  7878 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.128361  7896 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.130241  7868 tablet_bootstrap.cc:654] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.130550  7896 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.133261  7869 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.136101  7869 ts_tablet_manager.cc:1434] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260501 13:58:22.138337  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.138958  7753 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.141677  7577 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:22.145453  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:22.146114  7677 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.146581  7872 tablet_bootstrap.cc:492] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:22.147094  7872 ts_tablet_manager.cc:1403] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.015s
I20260501 13:58:22.146299  7575 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:22.150486  7872 raft_consensus.cc:359] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.151170  7872 raft_consensus.cc:385] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.151430  7872 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
W20260501 13:58:22.152241  7643 leader_election.cc:343] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.152264  7872 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.154325  7903 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.154851  7903 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.155445  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.155658  7677 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:22.157204  7869 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:22.161016  7896 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:22.163187  7903 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.165009  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:22.165284  7872 ts_tablet_manager.cc:1434] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260501 13:58:22.165534  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.166288  7872 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
W20260501 13:58:22.167912  7643 leader_election.cc:343] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:22.168604  7643 leader_election.cc:343] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:22.171092  7792 leader_election.cc:343] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.171396  7930 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:22.172624  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:22.173890  7643 leader_election.cc:343] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.174386  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.176187  7903 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.178296  7869 tablet_bootstrap.cc:654] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.179173  7868 tablet_bootstrap.cc:492] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:22.179723  7868 ts_tablet_manager.cc:1403] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.005s
I20260501 13:58:22.180136  7872 tablet_bootstrap.cc:654] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.183197  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.184027  7828 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.198681  7753 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:22.201304  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:22.202903  7930 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.203524  7930 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:22.204859  7930 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.218956  7869 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:22.219506  7869 ts_tablet_manager.cc:1403] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.009s
I20260501 13:58:22.227722  7828 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:22.228615  7868 raft_consensus.cc:359] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.229063  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:22.229370  7868 raft_consensus.cc:385] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.229689  7868 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.230058  7904 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.230353  7868 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.231418  7904 raft_consensus.cc:697] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:22.232461  7904 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.238775  7868 ts_tablet_manager.cc:1434] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260501 13:58:22.240180  7868 tablet_bootstrap.cc:492] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:22.243716  7869 raft_consensus.cc:359] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.244607  7869 raft_consensus.cc:385] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.244916  7869 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.245599  7869 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.247392  7869 ts_tablet_manager.cc:1434] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260501 13:58:22.248399  7869 tablet_bootstrap.cc:492] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:22.250530  7574 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:22.253556  7872 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:22.253937  7872 ts_tablet_manager.cc:1403] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.013s
I20260501 13:58:22.256306  7868 tablet_bootstrap.cc:654] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.256814  7872 raft_consensus.cc:359] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.257525  7872 raft_consensus.cc:385] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.257807  7872 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.258479  7872 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.260715  7872 ts_tablet_manager.cc:1434] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260501 13:58:22.261638  7872 tablet_bootstrap.cc:492] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:22.262838  7576 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:22.266502  7869 tablet_bootstrap.cc:654] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.268433  7872 tablet_bootstrap.cc:654] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.273608  7878 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.274080  7878 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.276115  7878 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.278884  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.279495  7828 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:22.279901  7868 tablet_bootstrap.cc:492] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:22.280350  7868 ts_tablet_manager.cc:1403] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.006s
I20260501 13:58:22.280790  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.281491  7904 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.282083  7904 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.282655  7878 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.283134  7878 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.283491  7878 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.286795  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.287423  7677 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:22.284493  7904 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.287808  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.288774  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.289302  7828 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:22.290704  7868 raft_consensus.cc:359] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.291360  7868 raft_consensus.cc:385] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.290726  7643 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.291790  7868 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.292491  7868 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.293298  7904 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.300560  7878 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.301151  7904 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.302371  7904 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.302668  7754 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 1: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:58:22.302953  7891 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.303524  7891 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.306010  7891 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.306669  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.294512  7868 ts_tablet_manager.cc:1434] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260501 13:58:22.308706  7868 tablet_bootstrap.cc:492] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:22.308771  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.309506  7828 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:22.311240  7718 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.313637  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:22.313957  7891 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.314508  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.315063  7828 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.316812  7872 tablet_bootstrap.cc:492] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:22.317276  7872 ts_tablet_manager.cc:1403] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.003s
I20260501 13:58:22.320261  7935 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.320230  7872 raft_consensus.cc:359] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.321018  7872 raft_consensus.cc:385] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.320791  7935 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.321292  7872 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.321987  7872 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.322731  7935 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:22.323719  7828 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:22.323972  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.312877  7878 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.325626  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.326206  7678 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:22.327131  7869 tablet_bootstrap.cc:492] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:22.327507  7869 ts_tablet_manager.cc:1403] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.005s
I20260501 13:58:22.328594  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:58:22.329464  7792 leader_election.cc:343] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.330210  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.330771  7869 raft_consensus.cc:359] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.331615  7869 raft_consensus.cc:385] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.331724  7935 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.331997  7869 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.332093  7891 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.332111  7935 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.332878  7869 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.333524  7935 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.335743  7869 ts_tablet_manager.cc:1434] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:58:22.336771  7869 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:22.332265  7878 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.342182  7878 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:22.347287  7754 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.349543  7869 tablet_bootstrap.cc:654] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.350239  7868 tablet_bootstrap.cc:654] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.351320  7872 ts_tablet_manager.cc:1434] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.012s
I20260501 13:58:22.352255  7872 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:22.353706  7903 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.343338  7878 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.354207  7903 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.356447  7935 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.357149  7896 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.357664  7896 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.357854  7904 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.358999  7677 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:22.360244  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:22.360881  7678 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.360949  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.366684  7753 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:22.370570  7935 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:22.365131  7903 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.380034  7904 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.369606  7896 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.381924  7904 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.382488  7904 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.371766  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.384409  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:22.385605  7792 leader_election.cc:343] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.387079  7904 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.387285  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:22.389362  7904 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.389312  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.389820  7904 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.390046  7828 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:22.390184  7904 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.392916  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.393716  7826 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 1: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:58:22.395462  7872 tablet_bootstrap.cc:654] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.390709  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.397151  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:22.390980  7643 leader_election.cc:343] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.371711  7949 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260501 13:58:22.402755  7678 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
W20260501 13:58:22.410915  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:22.414204  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.415180  7827 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:22.414366  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.415104  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:22.416450  7575 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 13:58:22.417508  7643 leader_election.cc:343] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.417405  7904 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.418900  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.419752  7904 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.419916  7754 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:22.420384  7904 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.420992  7868 tablet_bootstrap.cc:492] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:22.420833  7904 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.422184  7904 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.422245  7950 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:22.422849  7950 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:22.423269  7950 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.429483  7904 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.430363  7869 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:22.430990  7869 ts_tablet_manager.cc:1403] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.002s
I20260501 13:58:22.431538  7904 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.433437  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:22.435191  7935 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.435851  7935 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:22.434489  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.437384  7754 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.437188  7935 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.422278  7868 ts_tablet_manager.cc:1403] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.114s	user 0.006s	sys 0.018s
I20260501 13:58:22.445338  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.447479  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.451282  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.452131  7826 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.453665  7868 raft_consensus.cc:359] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.454537  7868 raft_consensus.cc:385] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.454840  7868 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.458782  7868 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.465103  7868 ts_tablet_manager.cc:1434] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260501 13:58:22.466387  7868 tablet_bootstrap.cc:492] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:22.466596  7643 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.467859  7904 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.470502  7878 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.471014  7878 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.473013  7878 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.477463  7904 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260501 13:58:22.479314  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.480118  7869 raft_consensus.cc:359] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.482122  7869 raft_consensus.cc:385] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.482383  7869 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.483043  7869 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:22.481748  7643 leader_election.cc:343] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.485894  7826 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:22.490131  7869 ts_tablet_manager.cc:1434] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260501 13:58:22.490258  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:58:22.490268  7643 leader_election.cc:343] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.493114  7869 tablet_bootstrap.cc:492] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:22.493327  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:22.496001  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.496603  7754 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:22.498368  7878 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:58:22.499943  7904 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.500424  7904 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:22.501232  7904 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.513454  7949 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.514091  7949 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.515158  7868 tablet_bootstrap.cc:654] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.498000  7950 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.535511  7872 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:22.536087  7872 ts_tablet_manager.cc:1403] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.184s	user 0.031s	sys 0.043s
I20260501 13:58:22.537297  7950 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.538817  7872 raft_consensus.cc:359] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.539307  7872 raft_consensus.cc:385] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.539474  7872 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.520193  7576 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:22.521694  7949 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.544179  7869 tablet_bootstrap.cc:654] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.546128  7872 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.549275  7949 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.549466  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.549746  7949 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.550195  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:22.550724  7753 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.551453  7896 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.552224  7896 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:22.516167  7878 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.553890  7891 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:22.554401  7949 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.559866  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.559752  7872 ts_tablet_manager.cc:1434] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260501 13:58:22.560933  7751 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:22.562973  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.573148  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:22.573879  7826 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.573561  7930 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.567626  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.575456  7930 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.564599  7896 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.573118  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.557963  7878 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.580739  7752 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.589675  7643 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.594116  7930 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:22.595508  7869 tablet_bootstrap.cc:492] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:22.595697  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.596143  7869 ts_tablet_manager.cc:1403] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.003s
I20260501 13:58:22.596227  7872 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:22.596810  7754 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:58:22.598409  7643 leader_election.cc:343] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:22.599098  7643 leader_election.cc:343] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.599479  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.602460  7903 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.608356  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.610776  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.584888  7826 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:22.600181  7904 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.605511  7869 raft_consensus.cc:359] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.616541  7869 raft_consensus.cc:385] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.616845  7869 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.617434  7869 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.628381  7869 ts_tablet_manager.cc:1434] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260501 13:58:22.634624  7891 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 13:58:22.636469  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:22.639855  7930 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:22.640422  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.634061  7878 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.629256  7753 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:22.663707  7869 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:22.663589  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.671550  7899 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:22.693447  7574 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:22.663188  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:22.711882  7903 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:22.712409  7903 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:22.713223  7903 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:22.714311  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56481.6us
W20260501 13:58:22.721225  7961 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260501 13:58:22.722653  7930 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 13:58:22.733355  7960 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260501 13:58:22.775636  7872 tablet_bootstrap.cc:654] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.779557  7868 tablet_bootstrap.cc:492] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:22.780053  7868 ts_tablet_manager.cc:1403] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.314s	user 0.011s	sys 0.008s
I20260501 13:58:22.722770  7935 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.058s
I20260501 13:58:22.785928  7904 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.802278  7868 raft_consensus.cc:359] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.803604  7868 raft_consensus.cc:385] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.804164  7868 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.805097  7868 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.809521  7904 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:22.832301  7962 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260501 13:58:22.840758  7891 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.851280  7868 ts_tablet_manager.cc:1434] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260501 13:58:22.841363  7891 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.853788  7903 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:58:22.853703  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44965.4us
I20260501 13:58:22.855768  7869 tablet_bootstrap.cc:654] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.857643  7868 tablet_bootstrap.cc:492] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:22.864508  7970 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260501 13:58:22.872984  7891 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.856318  7903 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:22.875748  7792 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:22.892993  7903 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:22.890434  7878 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.905979  7872 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:22.912226  7872 ts_tablet_manager.cc:1403] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.016s
I20260501 13:58:22.893607  7899 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260501 13:58:22.906595  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:22.919584  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.937139  7872 raft_consensus.cc:359] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.938047  7872 raft_consensus.cc:385] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.938334  7872 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.939872  7872 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.948756  7962 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:22.949326  7868 tablet_bootstrap.cc:654] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:22.949514  7962 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:22.957907  7792 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:22.958673  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:22.959966  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:22.969715  7643 leader_election.cc:343] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.969586  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:22.973176  7962 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:22.973690  7643 leader_election.cc:343] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:22.977435  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 92340.2us
W20260501 13:58:22.978889  7718 leader_election.cc:343] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:22.979730  7718 leader_election.cc:343] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.980216  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.981235  7976 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.982431  7868 tablet_bootstrap.cc:492] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:22.982915  7868 ts_tablet_manager.cc:1403] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.003s
I20260501 13:58:22.985077  7872 ts_tablet_manager.cc:1434] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
W20260501 13:58:22.983477  7643 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:22.987615  7869 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:22.988200  7869 ts_tablet_manager.cc:1403] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.325s	user 0.019s	sys 0.013s
I20260501 13:58:22.987799  7948 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260501 13:58:22.990532  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:22.992167  7643 leader_election.cc:343] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:22.992731  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:22.993741  7903 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:22.996637  7868 raft_consensus.cc:359] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.997673  7868 raft_consensus.cc:385] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.996726  7869 raft_consensus.cc:359] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.998154  7869 raft_consensus.cc:385] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:22.998142  7868 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.998545  7869 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:22.999101  7868 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:22.999182  7869 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.009016  7869 ts_tablet_manager.cc:1434] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.010s
I20260501 13:58:23.009277  7868 ts_tablet_manager.cc:1434] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260501 13:58:23.010007  7869 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.010121  7868 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.013489  7962 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:23.021719  7872 tablet_bootstrap.cc:492] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.042673  7751 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:23.045269  7903 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260501 13:58:23.048579  7868 tablet_bootstrap.cc:654] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.050041  7872 tablet_bootstrap.cc:654] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.052337  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.053493  7903 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.054283  7903 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.054617  7903 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.059099  7575 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.062251  7575 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.094616  7869 tablet_bootstrap.cc:654] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.101286  7903 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.103489  7903 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.106287  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:23.107093  7751 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.109930  7827 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.116882  7979 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:23.121150  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:23.126732  7868 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.127179  7868 ts_tablet_manager.cc:1403] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.014s
W20260501 13:58:23.128846  7643 leader_election.cc:343] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.130399  7950 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:23.144582  7751 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:23.155689  7869 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.151706  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.156523  7869 ts_tablet_manager.cc:1403] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.004s
I20260501 13:58:23.151909  7868 raft_consensus.cc:359] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.156754  7904 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:23.150645  7872 tablet_bootstrap.cc:492] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.157025  7868 raft_consensus.cc:385] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.157544  7868 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.157574  7872 ts_tablet_manager.cc:1403] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.019s
I20260501 13:58:23.157706  7904 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:23.158427  7868 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.158661  7904 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.159729  7869 raft_consensus.cc:359] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.160761  7869 raft_consensus.cc:385] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.161037  7869 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.161626  7869 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.162169  7872 raft_consensus.cc:359] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.162792  7872 raft_consensus.cc:385] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.163059  7872 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.163697  7869 ts_tablet_manager.cc:1434] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260501 13:58:23.164568  7869 tablet_bootstrap.cc:492] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.164552  7872 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.163406  7868 ts_tablet_manager.cc:1434] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.000s
I20260501 13:58:23.166668  7868 tablet_bootstrap.cc:492] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.181711  7872 ts_tablet_manager.cc:1434] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260501 13:58:23.186808  7935 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:58:23.190074  7872 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.191254  7935 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.199496  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.200212  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.205106  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:23.198062  7935 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.206403  7991 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:58:23.208822  7869 tablet_bootstrap.cc:654] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.226749  7574 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.231328  7868 tablet_bootstrap.cc:654] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.231719  7869 tablet_bootstrap.cc:492] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.232272  7869 ts_tablet_manager.cc:1403] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.018s
I20260501 13:58:23.232476  7872 tablet_bootstrap.cc:654] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.235157  7869 raft_consensus.cc:359] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.235966  7869 raft_consensus.cc:385] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.236281  7869 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.237004  7869 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.239648  7869 ts_tablet_manager.cc:1434] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260501 13:58:23.241286  7869 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.245998  7676 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.253583  7869 tablet_bootstrap.cc:654] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.253676  7904 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:23.262322  7872 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.262606  7868 tablet_bootstrap.cc:492] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.262843  7872 ts_tablet_manager.cc:1403] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.073s	user 0.005s	sys 0.013s
I20260501 13:58:23.263238  7868 ts_tablet_manager.cc:1403] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.006s
I20260501 13:58:23.266660  7872 raft_consensus.cc:359] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.267375  7872 raft_consensus.cc:385] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.268484  7872 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.269335  7872 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.271872  7872 ts_tablet_manager.cc:1434] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260501 13:58:23.275951  7872 tablet_bootstrap.cc:492] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.283144  7872 tablet_bootstrap.cc:654] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.271548  7868 raft_consensus.cc:359] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.284485  7868 raft_consensus.cc:385] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.284857  7868 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.287474  7868 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.295753  7904 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:23.302220  7904 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.302758  7904 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.306917  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.307459  7752 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:23.308015  7904 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.308734  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:23.310333  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.313727  7869 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
W20260501 13:58:23.314055  7643 leader_election.cc:343] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.314011  7868 ts_tablet_manager.cc:1434] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.000s
I20260501 13:58:23.314987  7904 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.315412  7904 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.315526  7869 ts_tablet_manager.cc:1403] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.020s
I20260501 13:58:23.315773  7904 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.316157  7868 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.326458  7868 tablet_bootstrap.cc:654] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.318819  7869 raft_consensus.cc:359] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.326929  7869 raft_consensus.cc:385] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.327255  7869 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.327942  7869 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.330590  7869 ts_tablet_manager.cc:1434] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260501 13:58:23.331568  7869 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.332366  7904 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.336185  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:23.336763  7752 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.341233  7869 tablet_bootstrap.cc:654] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.345430  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:58:23.347142  7643 leader_election.cc:343] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.347999  7904 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.353214  7752 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:23.354445  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.355285  7904 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:23.355722  7904 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:23.356555  7904 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.360621  7869 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.361110  7869 ts_tablet_manager.cc:1403] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.008s
I20260501 13:58:23.363487  7868 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.363965  7868 ts_tablet_manager.cc:1403] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260501 13:58:23.363993  7869 raft_consensus.cc:359] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.364813  7869 raft_consensus.cc:385] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.365077  7869 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.365684  7869 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.366595  7891 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.367058  7891 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.367786  7869 ts_tablet_manager.cc:1434] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260501 13:58:23.371876  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.374796  7825 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:23.375020  7869 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.371956  7891 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.375706  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:23.370963  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.376770  7676 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:23.376889  7891 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.377233  7891 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.377552  7891 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.372529  7868 raft_consensus.cc:359] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.379602  7868 raft_consensus.cc:385] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.379899  7868 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.380784  7868 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.382946  7868 ts_tablet_manager.cc:1434] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260501 13:58:23.383570  7869 tablet_bootstrap.cc:654] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.383913  7868 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.389916  7891 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.392663  7872 tablet_bootstrap.cc:492] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.393237  7872 ts_tablet_manager.cc:1403] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.118s	user 0.027s	sys 0.056s
I20260501 13:58:23.394788  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:23.395417  7676 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.397159  7872 raft_consensus.cc:359] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.397851  7872 raft_consensus.cc:385] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.398018  7869 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.398140  7872 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.398504  7869 ts_tablet_manager.cc:1403] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260501 13:58:23.398826  7872 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.401862  7872 ts_tablet_manager.cc:1434] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:58:23.402554  7676 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:23.402765  7904 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.402987  7872 tablet_bootstrap.cc:492] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.402712  7869 raft_consensus.cc:359] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.403471  7869 raft_consensus.cc:385] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.403349  7904 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.403751  7869 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.403780  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:23.389930  7574 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.404733  7878 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:23.405241  7878 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:23.405375  7904 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.406075  7878 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.409406  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.409821  7869 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.410575  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:23.412719  7643 leader_election.cc:343] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:23.413311  7643 leader_election.cc:343] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.413731  7643 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.391546  7868 tablet_bootstrap.cc:654] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.416210  7904 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:23.416333  7891 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.418443  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:23.419062  7825 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.422098  7869 ts_tablet_manager.cc:1434] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260501 13:58:23.426837  7869 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
W20260501 13:58:23.435776  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:23.437398  7872 tablet_bootstrap.cc:654] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.445947  7869 tablet_bootstrap.cc:654] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.456414  7868 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.460839  7904 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.461424  7868 ts_tablet_manager.cc:1403] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.022s
I20260501 13:58:23.461493  7904 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.461334  7574 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.463616  7903 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.464205  7903 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.465583  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.466022  7903 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.449337  7825 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:23.463660  7904 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.468966  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:23.470427  7643 leader_election.cc:343] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.470811  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.471392  7752 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:23.471927  7868 raft_consensus.cc:359] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.473367  7868 raft_consensus.cc:385] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.473664  7868 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.473223  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:58:23.474484  7643 leader_election.cc:343] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.474373  7868 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.475747  7935 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.476222  7935 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.478145  7935 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.479501  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.480971  7903 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.481479  7903 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.481923  7903 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.473240  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:23.486301  7792 leader_election.cc:343] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.486465  7868 ts_tablet_manager.cc:1434] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260501 13:58:23.488251  7868 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.488662  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.489300  7676 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:23.492666  7869 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.493176  7869 ts_tablet_manager.cc:1403] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.009s
W20260501 13:58:23.493664  7643 leader_election.cc:343] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.494016  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.494609  7904 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:23.495468  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:23.496232  7935 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.497570  7935 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.497992  7935 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.494632  7752 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.501652  7903 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.502830  7991 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.504703  7991 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.505941  7869 raft_consensus.cc:359] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.506587  7869 raft_consensus.cc:385] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.506851  7869 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.507068  7991 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.507556  7869 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.509563  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.511857  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.512288  7751 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:23.513859  7869 ts_tablet_manager.cc:1434] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260501 13:58:23.513890  7868 tablet_bootstrap.cc:654] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.514140  7792 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:23.514981  7869 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.516215  7991 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.525156  7903 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.527176  7872 tablet_bootstrap.cc:492] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.527697  7872 ts_tablet_manager.cc:1403] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.030s
I20260501 13:58:23.529461  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:23.530062  7826 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.528877  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:23.532262  7869 tablet_bootstrap.cc:654] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.532239  7751 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.531618  7935 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.537688  7935 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.539803  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:23.539908  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:23.540720  7676 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:23.546698  7792 leader_election.cc:343] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.554813  7826 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:23.556049  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:23.558650  7676 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:23.563344  7903 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:23.573223  7950 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 13:58:23.573689  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:23.580399  7935 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:23.580873  7935 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:23.581745  7935 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.587028  7991 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:23.588023  7751 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:23.579010  7903 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:23.592748  7903 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.598181  7872 raft_consensus.cc:359] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.598951  7872 raft_consensus.cc:385] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.599299  7872 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.600186  7872 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.604298  7868 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.604928  7868 ts_tablet_manager.cc:1403] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.117s	user 0.025s	sys 0.018s
I20260501 13:58:23.605103  7872 ts_tablet_manager.cc:1434] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260501 13:58:23.606078  7872 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.610443  7868 raft_consensus.cc:359] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.611321  7868 raft_consensus.cc:385] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.611662  7868 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.612864  7869 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.613319  7869 ts_tablet_manager.cc:1403] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.007s
I20260501 13:58:23.616035  7868 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.618417  7868 ts_tablet_manager.cc:1434] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260501 13:58:23.619333  7868 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.640849  7575 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:23.659243  7575 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.662546  7869 raft_consensus.cc:359] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.662945  7904 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:23.663331  7869 raft_consensus.cc:385] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.664338  7868 tablet_bootstrap.cc:654] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.663594  7869 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.666035  7869 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.669015  7869 ts_tablet_manager.cc:1434] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260501 13:58:23.669941  7869 tablet_bootstrap.cc:492] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.670369  7872 tablet_bootstrap.cc:654] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.677160  7869 tablet_bootstrap.cc:654] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.678206  7872 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.678640  7872 ts_tablet_manager.cc:1403] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.073s	user 0.006s	sys 0.006s
I20260501 13:58:23.682251  7872 raft_consensus.cc:359] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.682871  7872 raft_consensus.cc:385] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.683102  7872 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.683808  7869 tablet_bootstrap.cc:492] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.683671  7872 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.684299  7869 ts_tablet_manager.cc:1403] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260501 13:58:23.685618  7872 ts_tablet_manager.cc:1434] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260501 13:58:23.687435  7868 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.687925  7868 ts_tablet_manager.cc:1403] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.002s
I20260501 13:58:23.692656  7872 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.699548  7872 tablet_bootstrap.cc:654] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.701354  7868 raft_consensus.cc:359] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.702153  7868 raft_consensus.cc:385] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.702440  7868 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.704357  7869 raft_consensus.cc:359] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.705080  7869 raft_consensus.cc:385] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.705336  7869 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.705927  7869 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.708299  7869 ts_tablet_manager.cc:1434] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260501 13:58:23.708336  7872 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.708990  7872 ts_tablet_manager.cc:1403] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260501 13:58:23.709607  7869 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.703275  7868 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.711771  7872 raft_consensus.cc:359] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.712435  7872 raft_consensus.cc:385] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.712690  7872 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.713316  7872 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.714941  7869 tablet_bootstrap.cc:654] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.715538  7872 ts_tablet_manager.cc:1434] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260501 13:58:23.716969  7872 tablet_bootstrap.cc:492] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.720310  7899 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.720779  7899 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.721637  7868 ts_tablet_manager.cc:1434] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260501 13:58:23.722617  7868 tablet_bootstrap.cc:492] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.723773  7872 tablet_bootstrap.cc:654] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.725476  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.725836  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.726353  7750 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:23.728185  7792 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:23.722653  7899 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.729033  7935 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.732311  7869 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.732826  7869 ts_tablet_manager.cc:1403] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260501 13:58:23.735600  7869 raft_consensus.cc:359] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.736624  7869 raft_consensus.cc:385] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.736654  7872 tablet_bootstrap.cc:492] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.737033  7869 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.737300  7872 ts_tablet_manager.cc:1403] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260501 13:58:23.737663  7869 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.741132  7872 raft_consensus.cc:359] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.741801  7872 raft_consensus.cc:385] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.742062  7872 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.742678  7872 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.744774  7872 ts_tablet_manager.cc:1434] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260501 13:58:23.745193  7869 ts_tablet_manager.cc:1434] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260501 13:58:23.745713  7872 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.745958  7869 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.747997  7935 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:23.750787  7904 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.751258  7904 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.761694  7904 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.766374  7904 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.766721  7869 tablet_bootstrap.cc:654] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.766901  7904 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.769238  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.769784  7904 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.770694  7868 tablet_bootstrap.cc:654] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.770115  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.771240  7750 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:23.769912  7826 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:23.770478  7935 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.772809  7935 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.773295  7872 tablet_bootstrap.cc:654] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.774667  7935 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.776916  7904 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.776988  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.777647  7750 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:23.777474  7904 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.778973  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:23.779858  7935 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.780283  7935 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.780681  7935 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.783800  7962 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:23.785795  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:23.788522  7962 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.788903  7962 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.789253  7962 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.789650  7935 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.793272  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.793778  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:23.793644  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.794586  7752 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.795763  7935 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.798895  7962 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.800760  7962 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.800818  7904 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.803958  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.804814  7679 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
W20260501 13:58:23.806283  7643 leader_election.cc:343] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.805105  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:23.807935  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:23.807962  7678 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.808568  7750 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.818197  7750 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:23.820694  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:23.821357  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:23.827309  7827 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.822964  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.831341  7872 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.831892  7872 ts_tablet_manager.cc:1403] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.007s
I20260501 13:58:23.833103  7868 tablet_bootstrap.cc:492] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.833578  7868 ts_tablet_manager.cc:1403] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.111s	user 0.021s	sys 0.046s
I20260501 13:58:23.833854  7869 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.834746  7869 ts_tablet_manager.cc:1403] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.028s
I20260501 13:58:23.836580  7872 raft_consensus.cc:359] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:23.824429  7643 leader_election.cc:343] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.837499  7872 raft_consensus.cc:385] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.838222  7872 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.838054  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.837257  7868 raft_consensus.cc:359] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.838835  7868 raft_consensus.cc:385] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.839362  7868 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.840322  7962 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:23.840617  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:23.841460  7962 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
W20260501 13:58:23.841496  7643 leader_election.cc:343] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.842047  7962 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:58:23.842545  7643 leader_election.cc:343] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.842957  7643 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:23.842918  7962 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.848335  7903 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:23.840246  7868 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.851136  7868 ts_tablet_manager.cc:1434] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260501 13:58:23.852579  7868 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.819772  7678 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:23.824138  7752 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:23.839018  7872 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.858780  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:23.859365  7872 ts_tablet_manager.cc:1434] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260501 13:58:23.859741  7869 raft_consensus.cc:359] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.860682  7869 raft_consensus.cc:385] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.861092  7869 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.862046  7869 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.865748  7869 ts_tablet_manager.cc:1434] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260501 13:58:23.867043  7872 tablet_bootstrap.cc:492] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:23.867620  7869 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.862890  7827 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:23.865775  7935 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:23.871191  7935 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:23.883124  7903 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:23.884855  7935 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.895694  7868 tablet_bootstrap.cc:654] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.910540  7575 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:23.913048  7869 tablet_bootstrap.cc:654] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.912539  7574 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:23.920897  7872 tablet_bootstrap.cc:654] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.933218  7868 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.933727  7868 ts_tablet_manager.cc:1403] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.006s
I20260501 13:58:23.933887  7869 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.934360  7869 ts_tablet_manager.cc:1403] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260501 13:58:23.937170  7869 raft_consensus.cc:359] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.937362  7868 raft_consensus.cc:359] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.937845  7869 raft_consensus.cc:385] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.937700  7878 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:23.938062  7868 raft_consensus.cc:385] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.938148  7869 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.938527  7868 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.939224  7868 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.941533  7868 ts_tablet_manager.cc:1434] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:58:23.942516  7868 tablet_bootstrap.cc:492] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.943706  7869 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.945895  7869 ts_tablet_manager.cc:1434] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260501 13:58:23.947039  7869 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.948679  7868 tablet_bootstrap.cc:654] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.953405  7869 tablet_bootstrap.cc:654] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.959692  7868 tablet_bootstrap.cc:492] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:23.960219  7868 ts_tablet_manager.cc:1403] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260501 13:58:23.962688  7872 tablet_bootstrap.cc:492] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:23.963873  7872 ts_tablet_manager.cc:1403] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.005s
I20260501 13:58:23.967674  7868 raft_consensus.cc:359] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.968417  7868 raft_consensus.cc:385] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.968667  7868 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.970708  7868 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.971715  7899 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.972373  7899 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.972963  7868 ts_tablet_manager.cc:1434] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260501 13:58:23.973908  7868 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:23.974766  7899 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:23.976292  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:23.977697  7792 leader_election.cc:343] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:23.978117  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.979624  7869 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:23.979651  7678 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:23.980232  7869 ts_tablet_manager.cc:1403] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.015s
I20260501 13:58:23.981201  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:23.982374  7935 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:23.982729  7935 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:23.983083  7935 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:23.982970  7869 raft_consensus.cc:359] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.983466  7868 tablet_bootstrap.cc:654] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.983743  7869 raft_consensus.cc:385] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:23.984124  7869 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:23.984759  7869 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.986768  7869 ts_tablet_manager.cc:1434] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260501 13:58:23.988085  7869 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:23.988859  7878 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.989351  7878 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:23.993103  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:23.994547  7869 tablet_bootstrap.cc:654] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:23.995193  7878 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:23.997151  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:23.999006  7962 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:23.999646  7962 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.001772  7962 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.002542  7868 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:24.003028  7868 ts_tablet_manager.cc:1403] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260501 13:58:24.007252  7868 raft_consensus.cc:359] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.007628  7903 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:24.008039  7868 raft_consensus.cc:385] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.008304  7868 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.008920  7868 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.009963  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.010776  7878 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.011054  7868 ts_tablet_manager.cc:1434] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260501 13:58:24.012073  7868 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:24.012650  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.016063  7869 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
W20260501 13:58:24.014837  7643 leader_election.cc:343] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.016554  7869 ts_tablet_manager.cc:1403] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.003s
I20260501 13:58:24.016767  7878 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.017262  7878 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.017472  7891 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:24.019134  7878 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.019346  7868 tablet_bootstrap.cc:654] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.019407  7869 raft_consensus.cc:359] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.020207  7869 raft_consensus.cc:385] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.021440  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.022159  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.022850  7752 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
W20260501 13:58:24.023488  7718 leader_election.cc:343] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.024327  7878 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.020465  7869 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.025064  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.024916  7878 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.025435  7869 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.028247  7904 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.028705  7904 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.029132  7904 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.029387  7869 ts_tablet_manager.cc:1434] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260501 13:58:24.031553  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.032976  7878 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.034298  7869 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:24.036563  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.037416  7825 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:24.040408  7869 tablet_bootstrap.cc:654] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.044204  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.045378  7878 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.045850  7878 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.046276  7878 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.048592  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.049484  7676 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:24.058740  7878 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.061012  7869 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:24.061517  7869 ts_tablet_manager.cc:1403] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.002s
I20260501 13:58:24.061203  7904 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.062402  7679 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:24.057278  7935 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.064396  7869 raft_consensus.cc:359] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.065049  7869 raft_consensus.cc:385] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.065316  7869 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.065858  7904 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.065904  7869 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.066864  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.068030  7891 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.075289  7869 ts_tablet_manager.cc:1434] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260501 13:58:24.076284  7869 tablet_bootstrap.cc:492] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:24.078083  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:24.080977  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:24.083137  7869 tablet_bootstrap.cc:654] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.085762  7891 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 13:58:24.084892  7643 leader_election.cc:343] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.087600  7904 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:24.097061  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:24.098869  7792 leader_election.cc:343] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.113432  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:24.114311  7679 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.094192  7935 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.114603  7872 raft_consensus.cc:359] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.118424  7872 raft_consensus.cc:385] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.124522  7872 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.155362  7904 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.156062  7904 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.155175  7872 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.132781  7899 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.159157  7899 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.161090  7899 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.134150  7679 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:24.126495  7868 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:24.147221  7962 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.164143  7868 ts_tablet_manager.cc:1403] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.152s	user 0.053s	sys 0.039s
I20260501 13:58:24.167706  7868 raft_consensus.cc:359] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.164152  7962 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.168628  7868 raft_consensus.cc:385] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.168943  7868 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.169590  7868 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.170357  7962 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.171164  7868 ts_tablet_manager.cc:1434] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260501 13:58:24.172384  7868 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:24.107062  7752 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:24.178841  7868 tablet_bootstrap.cc:654] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:24.199139  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 52977.4us
I20260501 13:58:24.202225  7868 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:24.202751  7868 ts_tablet_manager.cc:1403] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.009s
I20260501 13:58:24.203399  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.206606  7868 raft_consensus.cc:359] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.207476  7868 raft_consensus.cc:385] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.207834  7868 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.208575  7868 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.211279  7868 ts_tablet_manager.cc:1434] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260501 13:58:24.212553  7868 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:24.213425  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.214443  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.213450  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.216765  7878 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.219226  7868 tablet_bootstrap.cc:654] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.223594  7868 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:24.158483  7904 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.224083  7868 ts_tablet_manager.cc:1403] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260501 13:58:24.226325  7868 raft_consensus.cc:359] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.227041  7868 raft_consensus.cc:385] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.227327  7868 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.227898  7868 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:24.228266  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 53406.8us
I20260501 13:58:24.228660  7869 tablet_bootstrap.cc:492] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:24.229128  7869 ts_tablet_manager.cc:1403] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.153s	user 0.052s	sys 0.055s
I20260501 13:58:24.229353  7868 ts_tablet_manager.cc:1434] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260501 13:58:24.230239  7868 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:24.170370  7872 ts_tablet_manager.cc:1434] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.206s	user 0.003s	sys 0.004s
I20260501 13:58:24.231680  7872 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:24.232940  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:24.233145  8043 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.235116  7826 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:24.236296  7643 leader_election.cc:343] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.235122  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:24.238988  7679 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:24.243623  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 91369.9us
I20260501 13:58:24.249879  7752 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.249938  7950 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.250520  7950 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.251348  7826 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:24.252585  7950 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.253598  7679 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:24.236469  8043 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:24.247128  7643 leader_election.cc:343] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.263715  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.264827  7872 tablet_bootstrap.cc:654] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.264891  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:24.266626  8045 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:24.267231  8045 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:24.268034  7868 tablet_bootstrap.cc:654] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.268296  8045 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.270084  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.271281  8051 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:24.272795  8051 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:24.274174  7869 raft_consensus.cc:359] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.274935  7869 raft_consensus.cc:385] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.275255  7869 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.276191  7869 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:24.285907  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:24.287070  7751 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.289630  7869 ts_tablet_manager.cc:1434] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.002s
I20260501 13:58:24.291065  7869 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:24.291217  8043 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.294190  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.294049  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.294904  7826 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:24.273886  8051 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.295935  8047 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.296310  8047 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.296636  8047 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.297204  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.304360  8043 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.304755  8043 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.305086  8043 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.314146  8045 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.314442  7872 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:24.314924  7872 ts_tablet_manager.cc:1403] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.008s
I20260501 13:58:24.314677  8045 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.315507  7576 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:24.317859  7872 raft_consensus.cc:359] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.318146  8045 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.318521  7872 raft_consensus.cc:385] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.318827  7872 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
W20260501 13:58:24.320289  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 62007.7us
I20260501 13:58:24.321110  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.320315  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.322041  7868 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
W20260501 13:58:24.322149  7643 leader_election.cc:343] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.322561  7868 ts_tablet_manager.cc:1403] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.011s
W20260501 13:58:24.322433  7792 leader_election.cc:343] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.322603  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.323410  7904 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 13:58:24.323760  7643 leader_election.cc:343] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.324167  7643 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.324779  7904 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.325644  7868 raft_consensus.cc:359] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.326126  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.326399  7868 raft_consensus.cc:385] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.326323  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.326954  7825 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:24.328469  8043 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.329034  8045 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.322459  7950 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:24.330096  7950 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:24.329632  8045 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.330938  7950 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.332525  8045 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.333619  8047 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.334499  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.335539  8047 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.338188  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:24.336899  7868 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.346496  7825 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:24.346455  7868 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.319464  7872 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.347153  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:24.347973  7751 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:58:24.349118  7872 ts_tablet_manager.cc:1434] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.003s
I20260501 13:58:24.336268  8043 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.347848  7752 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.351938  8051 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.352233  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.352414  8051 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.353006  8047 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.353520  7872 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:24.353498  8047 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.354121  8047 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.355541  7869 tablet_bootstrap.cc:654] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.358845  8051 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.360770  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.361119  7872 tablet_bootstrap.cc:654] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.361632  7575 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:24.365856  8047 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.367096  7825 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:24.367671  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.368364  7679 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.352854  7868 ts_tablet_manager.cc:1434] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260501 13:58:24.369722  7872 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:24.370258  7872 ts_tablet_manager.cc:1403] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260501 13:58:24.370283  8047 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.372555  7869 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:24.373052  7869 ts_tablet_manager.cc:1403] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260501 13:58:24.373705  7872 raft_consensus.cc:359] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.374361  7872 raft_consensus.cc:385] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.374619  7872 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.375352  7872 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.377096  7869 raft_consensus.cc:359] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.377874  7869 raft_consensus.cc:385] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.377877  7872 ts_tablet_manager.cc:1434] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 13:58:24.378378  7869 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.379057  7872 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:24.379016  8047 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.379639  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:24.379802  8047 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.380262  7752 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.380028  7869 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.382018  8047 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.382565  7869 ts_tablet_manager.cc:1434] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 13:58:24.383301  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.383526  7869 tablet_bootstrap.cc:492] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
W20260501 13:58:24.384745  7792 leader_election.cc:343] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.407406  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.408300  7679 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.409555  7872 tablet_bootstrap.cc:654] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.410842  7869 tablet_bootstrap.cc:654] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.414825  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.415722  7679 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.422335  7869 tablet_bootstrap.cc:492] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:24.422895  7869 ts_tablet_manager.cc:1403] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.015s
I20260501 13:58:24.427456  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:24.428143  7678 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.428061  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.428814  7676 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.370679  7868 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:24.427906  7577 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:24.433902  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.429491  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:24.434881  7679 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.436319  7678 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:24.435431  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:24.437086  7869 raft_consensus.cc:359] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.437899  7869 raft_consensus.cc:385] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.438055  7676 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:24.439088  7869 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.439402  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.440766  7869 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.442679  7869 ts_tablet_manager.cc:1434] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.001s
I20260501 13:58:24.443416  7869 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:24.453893  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.455349  7903 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.455724  7903 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.456084  7903 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.457015  7752 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:24.459081  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.460052  8047 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:24.461202  8047 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:24.461884  7904 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.462352  7904 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.462340  8047 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.464542  7904 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.470528  7903 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.473505  7868 tablet_bootstrap.cc:654] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.477608  7903 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.480451  7868 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:24.481003  7868 ts_tablet_manager.cc:1403] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.004s
I20260501 13:58:24.481251  7872 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
W20260501 13:58:24.481415  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:24.481730  7872 ts_tablet_manager.cc:1403] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.103s	user 0.039s	sys 0.018s
I20260501 13:58:24.482748  8045 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 13:58:24.487520  7679 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:24.488389  7872 raft_consensus.cc:359] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.489063  7872 raft_consensus.cc:385] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.489334  7872 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.489943  7872 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.491971  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.492120  7792 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:24.492722  7872 ts_tablet_manager.cc:1434] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260501 13:58:24.492913  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.494345  8045 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.494305  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:24.494800  8045 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.495151  8045 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.494472  7872 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:24.495458  8044 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:24.496445  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.496891  8044 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.497318  8044 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:58:24.490569  7643 leader_election.cc:343] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.497989  8044 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.499140  8043 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.502104  7869 tablet_bootstrap.cc:654] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.493182  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.505098  7868 raft_consensus.cc:359] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.506506  7868 raft_consensus.cc:385] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.506798  7868 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.507423  7868 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.553978  7868 ts_tablet_manager.cc:1434] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
I20260501 13:58:24.555527  8045 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.505993  8051 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.505412  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:58:24.558784  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 52710.1us
I20260501 13:58:24.559058  7868 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:24.570164  7872 tablet_bootstrap.cc:654] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:24.575203  7643 leader_election.cc:343] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.563838  7577 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:58:24.580343  7643 leader_election.cc:343] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.580731  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.583302  7962 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.583895  8047 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:24.584347  8047 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:24.584328  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:24.578737  7935 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.585227  7935 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.585381  8047 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.592152  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:24.593022  7825 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:24.594192  7935 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.594762  7869 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:24.581689  7904 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260501 13:58:24.595270  7869 ts_tablet_manager.cc:1403] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.152s	user 0.003s	sys 0.013s
I20260501 13:58:24.596020  7903 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260501 13:58:24.596199  7643 leader_election.cc:343] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.599187  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.606225  7950 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.609102  7869 raft_consensus.cc:359] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.609784  7869 raft_consensus.cc:385] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.609814  8045 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.610188  7869 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.610845  7869 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.606341  7935 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.612210  7935 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.614650  7935 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.574069  8044 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:24.603015  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 97696.6us
I20260501 13:58:24.639885  8044 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.642409  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.643301  8067 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.643376  7752 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.643936  8067 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.645956  8067 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.646088  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.647612  7677 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:24.656234  7869 ts_tablet_manager.cc:1434] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.001s
I20260501 13:58:24.657447  7869 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:24.657922  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:24.649940  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.647864  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.664659  7872 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:24.665275  7872 ts_tablet_manager.cc:1403] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.171s	user 0.028s	sys 0.015s
I20260501 13:58:24.648317  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:58:24.671424  7643 leader_election.cc:343] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.673667  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.683446  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.687934  7872 raft_consensus.cc:359] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.688694  7872 raft_consensus.cc:385] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:24.688804  7750 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:24.688984  7872 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:24.689621  7872 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.691785  7872 ts_tablet_manager.cc:1434] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.007s
I20260501 13:58:24.692052  7675 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:24.696010  7868 tablet_bootstrap.cc:654] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:24.697050  7872 tablet_bootstrap.cc:492] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
W20260501 13:58:24.700505  7643 leader_election.cc:343] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.700824  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.702284  7904 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:24.704665  7577 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:24.729261  8051 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.730014  8051 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.732967  8051 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.742388  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.745223  7676 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:24.745750  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.737841  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:24.746575  7825 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:24.747618  8045 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.748057  8045 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.748395  8045 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.755837  8068 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:24.758535  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.760042  8051 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.760529  8051 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.760878  8051 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.783190  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:24.796703  8068 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.797449  8068 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.803339  8045 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.805923  8045 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:24.834411  8049 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.835104  8049 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.839411  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:24.840349  7679 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:24.840893  8049 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.841980  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:24.842607  8068 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.807006  8051 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.844190  8049 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:24.944499  7950 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.951448  7950 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:24.952742  7750 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:58:24.954039  7950 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:24.939265  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:58:24.946506  8074 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260501 13:58:24.955441  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.960772  7869 tablet_bootstrap.cc:654] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:24.961921  7643 leader_election.cc:343] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.961490  7962 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.949877  8049 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:24.960470  7676 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.962016  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:24.975353  8049 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.972525  8044 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:24.963155  7962 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:24.986404  7643 leader_election.cc:343] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.991021  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:24.992369  7826 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:24.994464  7962 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:24.996999  7643 leader_election.cc:343] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.997439  7643 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:24.994968  8044 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.001169  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.002981  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:25.003417  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:25.004271  8051 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:25.003038  7868 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:25.006263  7868 ts_tablet_manager.cc:1403] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.448s	user 0.015s	sys 0.012s
I20260501 13:58:24.985929  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:25.017320  7643 leader_election.cc:343] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:24.999774  7962 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.015887  8051 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260501 13:58:25.027634  7643 leader_election.cc:343] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.028112  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:25.026981  8078 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260501 13:58:25.029590  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:25.030758  8068 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.030954  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:25.031738  7827 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:25.031746  8044 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:25.038355  7643 leader_election.cc:343] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.038830  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:25.021395  7823 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:25.040928  7872 tablet_bootstrap.cc:654] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.040798  8080 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.042951  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:58:25.043900  7792 leader_election.cc:343] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.053799  7792 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:25.056226  8078 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.060138  7868 raft_consensus.cc:359] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.060937  7868 raft_consensus.cc:385] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.061203  7868 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.062498  7868 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.064419  7868 ts_tablet_manager.cc:1434] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260501 13:58:25.065719  7868 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:25.066752  7792 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:25.069015  8049 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.069456  8077 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.068831  7676 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:25.071430  8082 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.073803  8081 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:25.081065  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:25.083851  7754 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.084591  7962 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:25.086014  7868 tablet_bootstrap.cc:654] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.104471  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:25.105261  7675 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.113271  7869 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:25.113821  7869 ts_tablet_manager.cc:1403] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.457s	user 0.015s	sys 0.012s
I20260501 13:58:25.143146  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:25.136193  8049 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:25.147114  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:25.147743  7825 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.143915  7674 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.170233  7872 tablet_bootstrap.cc:492] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:25.170970  7872 ts_tablet_manager.cc:1403] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.478s	user 0.015s	sys 0.005s
I20260501 13:58:25.178828  7869 raft_consensus.cc:359] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.179584  7869 raft_consensus.cc:385] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.183632  7754 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:25.184132  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:25.186960  7869 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.190279  7869 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.201022  7869 ts_tablet_manager.cc:1434] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.003s
I20260501 13:58:25.204200  7872 raft_consensus.cc:359] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.205003  7872 raft_consensus.cc:385] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.205297  7872 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.205930  7872 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.215794  7869 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:25.224216  7872 ts_tablet_manager.cc:1434] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260501 13:58:25.236925  7872 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:25.219466  7674 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:25.239657  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:25.240602  8051 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:25.241077  8051 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:25.241000  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:25.221365  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.242528  7675 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:25.244546  8046 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:25.246626  8046 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:25.242084  8051 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.247956  8081 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:25.247623  8046 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:25.252148  8087 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260501 13:58:25.258718  7868 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:25.259357  7868 ts_tablet_manager.cc:1403] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.040s
I20260501 13:58:25.260869  8081 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:25.264361  7869 tablet_bootstrap.cc:654] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.265365  7825 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:25.275556  7868 raft_consensus.cc:359] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.276365  7868 raft_consensus.cc:385] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.276739  7868 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.277365  7868 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.279781  7868 ts_tablet_manager.cc:1434] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260501 13:58:25.277849  7872 tablet_bootstrap.cc:654] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.281281  7868 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
W20260501 13:58:25.284698  7792 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:25.312809  7577 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:25.316792  7575 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:25.325925  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:25.331034  7792 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:25.332733  8046 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:25.334132  8046 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.335203  8046 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:25.335590  8045 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:25.336015  7868 tablet_bootstrap.cc:654] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.343840  8081 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:25.343557  7935 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.347735  8081 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:25.347790  7935 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.349064  8081 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.355594  7935 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.365491  7872 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:25.366026  7872 ts_tablet_manager.cc:1403] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.021s
I20260501 13:58:25.373873  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:25.374913  7677 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:25.404158  7745 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.404331  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.410333  8081 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.413100  7869 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:25.414534  7869 ts_tablet_manager.cc:1403] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.024s
I20260501 13:58:25.410851  8081 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.418468  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:25.424044  7868 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:25.424639  7868 ts_tablet_manager.cc:1403] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.022s
I20260501 13:58:25.426079  7935 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:25.426506  7935 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:25.426859  7935 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.430634  7869 raft_consensus.cc:359] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.431274  7869 raft_consensus.cc:385] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.431552  7869 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.432732  8081 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.434283  7869 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.434425  7872 raft_consensus.cc:359] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.435016  7872 raft_consensus.cc:385] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.435276  7872 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.435882  7872 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.437770  7869 ts_tablet_manager.cc:1434] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260501 13:58:25.438527  7869 tablet_bootstrap.cc:492] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:25.440174  7872 ts_tablet_manager.cc:1434] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260501 13:58:25.441888  7872 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
W20260501 13:58:25.454336  7792 leader_election.cc:343] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.456297  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:25.457010  7676 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:25.457096  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.469271  7935 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.486321  7868 raft_consensus.cc:359] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.486934  7868 raft_consensus.cc:385] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.487143  7868 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.487733  7868 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:25.492614  7792 leader_election.cc:343] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.493909  7935 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.498235  7872 tablet_bootstrap.cc:654] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.498409  7868 ts_tablet_manager.cc:1434] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260501 13:58:25.499325  7869 tablet_bootstrap.cc:654] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.499503  7868 tablet_bootstrap.cc:492] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:25.503118  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:25.514742  7935 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:25.515281  7935 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:25.515646  7935 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.524986  7868 tablet_bootstrap.cc:654] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.528759  7746 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.534127  7872 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:25.539271  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:25.560196  7872 ts_tablet_manager.cc:1403] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.008s
I20260501 13:58:25.539778  7935 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.562618  7935 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.545189  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:25.563035  8081 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.562888  7872 raft_consensus.cc:359] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.563542  7675 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.563508  8081 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.565490  8081 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.563658  7872 raft_consensus.cc:385] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.566977  7872 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
W20260501 13:58:25.569657  7792 leader_election.cc:343] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.547796  7869 tablet_bootstrap.cc:492] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:25.567545  7872 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.570616  7869 ts_tablet_manager.cc:1403] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.015s
I20260501 13:58:25.572233  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:25.572824  7676 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.576216  7872 ts_tablet_manager.cc:1434] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260501 13:58:25.576399  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:25.577350  7872 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:25.582367  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:25.583230  7679 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:25.585515  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:25.586354  8046 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:25.586834  8046 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:25.587275  8046 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.587360  7577 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:25.591205  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.591528  7869 raft_consensus.cc:359] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:25.592036  7792 leader_election.cc:343] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.592232  7869 raft_consensus.cc:385] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.592494  7869 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.593117  7869 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.598781  7869 ts_tablet_manager.cc:1434] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260501 13:58:25.600099  7869 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
W20260501 13:58:25.604264  7792 leader_election.cc:343] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.616503  7675 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:25.618096  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:25.619715  8081 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:25.618471  7676 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:25.620380  8081 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:25.620110  7872 tablet_bootstrap.cc:654] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.624779  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:25.626827  8081 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.638967  7868 tablet_bootstrap.cc:492] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:25.631372  7935 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:25.641755  7868 ts_tablet_manager.cc:1403] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.142s	user 0.025s	sys 0.022s
I20260501 13:58:25.641583  7935 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:25.624555  8046 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.644419  8046 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.645408  7868 raft_consensus.cc:359] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.646071  7868 raft_consensus.cc:385] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.646312  7868 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.646258  7935 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.647051  7868 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.650067  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:25.652297  7792 leader_election.cc:343] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.654400  7868 ts_tablet_manager.cc:1434] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260501 13:58:25.655581  7868 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:25.707103  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:25.710002  7675 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.713748  7872 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:25.716145  7935 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:25.732086  7577 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:25.718256  8049 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:25.757737  8082 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260501 13:58:25.780259  8118 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.781179  8118 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.788569  8118 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:25.793324  8049 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:25.794543  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:25.809605  7643 leader_election.cc:343] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.810633  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.812642  7869 tablet_bootstrap.cc:654] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.771692  7872 ts_tablet_manager.cc:1403] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.006s
W20260501 13:58:25.818120  7643 leader_election.cc:343] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.818671  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:25.819696  8118 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.826431  7868 tablet_bootstrap.cc:654] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:25.843901  8051 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.844789  8051 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.832502  7675 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:25.856794  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:25.839293  7872 raft_consensus.cc:359] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.858052  8081 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:25.860764  8081 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:25.861894  8051 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:25.862190  8081 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.859714  7872 raft_consensus.cc:385] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:25.882608  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:25.883896  7826 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:25.873646  7872 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.890998  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:25.897033  7674 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:25.900095  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:25.900014  8045 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:25.903214  7869 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:25.911001  7869 ts_tablet_manager.cc:1403] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.311s	user 0.021s	sys 0.019s
I20260501 13:58:25.911300  7872 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.918463  8120 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.919440  8120 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:25.920508  7872 ts_tablet_manager.cc:1434] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.000s
I20260501 13:58:25.925042  8120 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:25.929601  7872 tablet_bootstrap.cc:492] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:25.928808  7575 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:25.917382  8051 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:25.941039  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:25.942665  7643 leader_election.cc:343] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.942890  8082 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:25.943295  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:25.943591  8082 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:25.945062  7643 leader_election.cc:343] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:25.945457  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:25.949071  7868 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:25.946393  8120 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:25.959009  8082 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:25.973474  7868 ts_tablet_manager.cc:1403] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.318s	user 0.021s	sys 0.012s
I20260501 13:58:25.976785  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:25.977614  7679 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:25.990124  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:25.992002  8081 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:25.992393  8081 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:25.992738  8081 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:25.997884  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:26.012465  7868 raft_consensus.cc:359] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.013366  7868 raft_consensus.cc:385] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.013675  7868 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:25.995013  7869 raft_consensus.cc:359] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.017979  7869 raft_consensus.cc:385] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.018527  7869 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.019423  8081 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.018018  7575 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:26.022630  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:26.023241  7676 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.019569  7869 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.026435  7868 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.030359  7869 ts_tablet_manager.cc:1434] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.002s
I20260501 13:58:26.031893  7869 tablet_bootstrap.cc:492] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.036407  8081 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.038295  8046 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.038851  8046 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.041949  7868 ts_tablet_manager.cc:1434] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260501 13:58:26.043447  7868 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.046970  8051 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.048748  8051 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.049302  8051 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.051090  7676 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:26.052560  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:26.054085  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.051461  8051 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.056893  7935 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:26.057504  7935 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:26.059245  7935 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.058928  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.064714  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.065639  7676 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:26.066967  7869 tablet_bootstrap.cc:654] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.066794  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.069581  8051 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.069151  8046 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.070815  7868 tablet_bootstrap.cc:654] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.070757  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.071548  7674 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:26.073549  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:26.074347  8046 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:26.074765  8046 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:26.075151  8046 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.089484  8051 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.096388  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:26.097453  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.096272  8046 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.104521  7872 tablet_bootstrap.cc:654] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.104651  8046 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:26.112880  7792 leader_election.cc:343] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.114846  8046 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260501 13:58:26.116334  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:26.117501  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:26.119158  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:26.120187  7676 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:26.118304  7792 leader_election.cc:343] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:26.123565  7792 leader_election.cc:343] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.133038  7676 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
W20260501 13:58:26.130550  7792 leader_election.cc:343] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.138415  7869 tablet_bootstrap.cc:492] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.139001  7869 ts_tablet_manager.cc:1403] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.107s	user 0.004s	sys 0.013s
I20260501 13:58:26.141573  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:26.142419  7869 raft_consensus.cc:359] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.143710  7869 raft_consensus.cc:385] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.143993  7869 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.144523  7869 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.151057  7869 ts_tablet_manager.cc:1434] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260501 13:58:26.145325  8082 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:26.157915  7868 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.158627  7868 ts_tablet_manager.cc:1403] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.016s
I20260501 13:58:26.159188  8082 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:26.160671  8082 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.161898  7869 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.161643  7576 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:26.167379  7868 raft_consensus.cc:359] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.169965  7868 raft_consensus.cc:385] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.170317  7868 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.171119  7868 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.173390  7868 ts_tablet_manager.cc:1434] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260501 13:58:26.174031  7869 tablet_bootstrap.cc:654] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.177099  7868 tablet_bootstrap.cc:492] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.174328  8082 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:26.183657  7868 tablet_bootstrap.cc:654] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.195240  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:26.204797  8081 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:26.213653  7872 tablet_bootstrap.cc:492] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.215565  7872 ts_tablet_manager.cc:1403] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.286s	user 0.014s	sys 0.009s
I20260501 13:58:26.219868  8081 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:26.238680  7872 raft_consensus.cc:359] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.252753  7872 raft_consensus.cc:385] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.253158  7872 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.254020  7872 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.258258  7872 ts_tablet_manager.cc:1434] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
W20260501 13:58:26.259220  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:26.259941  7872 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.271123  8120 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.271852  8120 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.274454  8120 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.278081  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.280371  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:26.281795  7643 leader_election.cc:343] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.283671  7872 tablet_bootstrap.cc:654] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:26.285305  7643 leader_election.cc:343] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.285903  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.286906  7962 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.298005  7872 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.298749  7872 ts_tablet_manager.cc:1403] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.000s
I20260501 13:58:26.302567  7872 raft_consensus.cc:359] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.303499  7872 raft_consensus.cc:385] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.305326  7872 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.306303  7872 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.317651  7869 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.318349  7868 tablet_bootstrap.cc:492] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.324043  7868 ts_tablet_manager.cc:1403] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.147s	user 0.027s	sys 0.069s
I20260501 13:58:26.324577  7872 ts_tablet_manager.cc:1434] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260501 13:58:26.323549  7869 ts_tablet_manager.cc:1403] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.162s	user 0.036s	sys 0.058s
I20260501 13:58:26.326923  7868 raft_consensus.cc:359] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.328500  7868 raft_consensus.cc:385] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.328969  7868 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.327430  7869 raft_consensus.cc:359] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.329689  7868 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.330215  7869 raft_consensus.cc:385] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.330502  7869 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.331139  7869 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.327724  7872 tablet_bootstrap.cc:492] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.332058  7868 ts_tablet_manager.cc:1434] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 13:58:26.333099  7868 tablet_bootstrap.cc:492] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.338927  7872 tablet_bootstrap.cc:654] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.339380  7868 tablet_bootstrap.cc:654] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.340783  7869 ts_tablet_manager.cc:1434] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260501 13:58:26.341763  7869 tablet_bootstrap.cc:492] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.348724  7869 tablet_bootstrap.cc:654] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.350382  7872 tablet_bootstrap.cc:492] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.350953  7872 ts_tablet_manager.cc:1403] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.006s
I20260501 13:58:26.353605  7868 tablet_bootstrap.cc:492] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.354054  7868 ts_tablet_manager.cc:1403] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260501 13:58:26.356537  8081 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.357039  8081 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.356724  7872 raft_consensus.cc:359] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.357999  7872 raft_consensus.cc:385] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.358430  7872 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.359015  8081 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.359521  7872 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.360966  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.361692  7676 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:26.362922  7872 ts_tablet_manager.cc:1434] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260501 13:58:26.364184  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.364434  7872 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.364393  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:26.363865  7868 raft_consensus.cc:359] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.365171  7868 raft_consensus.cc:385] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.365458  7868 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
W20260501 13:58:26.365626  7792 leader_election.cc:343] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.366111  7868 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.366592  8081 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:26.366986  8081 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:26.367336  8081 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.368853  7868 ts_tablet_manager.cc:1434] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260501 13:58:26.374054  7872 tablet_bootstrap.cc:654] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.374653  8081 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.377573  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:26.378049  7868 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.378182  7676 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.389232  7676 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:26.390393  8081 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.391033  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:26.389233  7868 tablet_bootstrap.cc:654] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.391866  7869 tablet_bootstrap.cc:492] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.392341  7869 ts_tablet_manager.cc:1403] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.018s
I20260501 13:58:26.392289  8081 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:26.392660  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:26.392942  8081 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:26.393723  7872 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.394258  7872 ts_tablet_manager.cc:1403] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260501 13:58:26.393822  8081 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.395282  7869 raft_consensus.cc:359] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.396099  7869 raft_consensus.cc:385] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.396361  7869 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
W20260501 13:58:26.397114  7792 leader_election.cc:343] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.397192  7869 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.401079  7869 ts_tablet_manager.cc:1434] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 13:58:26.403175  7872 raft_consensus.cc:359] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.404515  7869 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.406209  7872 raft_consensus.cc:385] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.406594  7872 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.407352  7872 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.409847  7872 ts_tablet_manager.cc:1434] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260501 13:58:26.411360  7872 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.412220  7869 tablet_bootstrap.cc:654] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.413666  7577 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:26.417919  7868 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.418608  7868 ts_tablet_manager.cc:1403] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260501 13:58:26.422188  7868 raft_consensus.cc:359] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.428000  7868 raft_consensus.cc:385] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.428371  7868 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.429086  7868 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.429697  7869 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.430814  7869 ts_tablet_manager.cc:1403] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260501 13:58:26.430270  7872 tablet_bootstrap.cc:654] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.433833  7869 raft_consensus.cc:359] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.437237  7869 raft_consensus.cc:385] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.437502  7869 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.436266  7868 ts_tablet_manager.cc:1434] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260501 13:58:26.443660  7868 tablet_bootstrap.cc:492] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.438246  7869 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.449128  7869 ts_tablet_manager.cc:1434] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260501 13:58:26.450450  7869 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.456590  8130 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.457281  8130 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.462007  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.462977  8130 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.464737  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.465530  7825 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:26.466090  7676 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:26.468346  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:26.469861  8130 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:26.470443  8130 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:26.470907  8130 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.471881  7868 tablet_bootstrap.cc:654] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.473627  8046 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.474098  8051 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.474108  8046 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.474752  8051 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.476605  8051 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.477658  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.478420  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:26.479364  7792 leader_election.cc:343] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.480206  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.480916  7676 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:26.481777  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.482959  8051 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.484018  7872 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.484277  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.484516  7872 ts_tablet_manager.cc:1403] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.073s	user 0.028s	sys 0.028s
I20260501 13:58:26.486181  7869 tablet_bootstrap.cc:654] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:26.486414  7792 leader_election.cc:343] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.486845  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:26.487605  8081 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.487798  7872 raft_consensus.cc:359] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.488583  7872 raft_consensus.cc:385] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.488860  7872 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.481943  8046 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.489621  7872 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.492379  7872 ts_tablet_manager.cc:1434] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 13:58:26.493907  7872 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.496107  8118 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.496577  8118 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.498822  8118 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.499553  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.500036  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.500207  7746 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:26.500701  7825 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:26.501420  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:26.502015  7872 tablet_bootstrap.cc:654] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.502594  8118 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:58:26.502774  7962 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.503122  8118 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:26.503660  8118 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:26.503403  7962 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.505970  7962 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.506599  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:26.508801  7643 leader_election.cc:343] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.508787  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:26.510466  7643 leader_election.cc:343] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.511009  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.512027  7962 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.518461  8081 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:26.518594  8130 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.529573  7869 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.530320  7869 ts_tablet_manager.cc:1403] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.001s
I20260501 13:58:26.535207  8051 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.538592  7869 raft_consensus.cc:359] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.539484  8130 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.542040  7869 raft_consensus.cc:385] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.542016  8118 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.542793  7872 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.542675  7869 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.543315  7872 ts_tablet_manager.cc:1403] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.032s
I20260501 13:58:26.540406  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:26.544020  7825 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.544265  8118 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.543701  7869 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.546447  7869 ts_tablet_manager.cc:1434] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260501 13:58:26.546622  7872 raft_consensus.cc:359] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.547422  7872 raft_consensus.cc:385] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.547719  7872 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.549870  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:26.550424  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:26.551033  7747 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:26.550519  7679 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.548579  7872 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.555114  7872 ts_tablet_manager.cc:1434] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260501 13:58:26.556226  7872 tablet_bootstrap.cc:492] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.558836  7747 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:26.559873  8081 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:26.547683  7869 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.563896  7872 tablet_bootstrap.cc:654] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.566128  7679 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:26.571847  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:26.572232  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:26.572813  8130 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:26.573292  8130 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:26.574165  8130 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.572844  7826 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:26.576686  8118 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.576833  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:26.577649  7962 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:26.577380  8118 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.581761  8118 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.584637  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:26.586346  7643 leader_election.cc:343] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.588958  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.593513  7826 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:26.598866  7869 tablet_bootstrap.cc:654] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.603912  7868 tablet_bootstrap.cc:492] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.604630  7868 ts_tablet_manager.cc:1403] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.161s	user 0.022s	sys 0.006s
I20260501 13:58:26.608322  7962 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:26.609386  7962 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.613107  8051 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.613597  8051 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.614449  7872 tablet_bootstrap.cc:492] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.615049  7872 ts_tablet_manager.cc:1403] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.020s
I20260501 13:58:26.615537  8051 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.618677  7872 raft_consensus.cc:359] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.620088  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.620311  7868 raft_consensus.cc:359] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.621167  7868 raft_consensus.cc:385] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.621518  7868 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.622272  7868 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.625329  7868 ts_tablet_manager.cc:1434] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260501 13:58:26.631769  7962 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.619601  7872 raft_consensus.cc:385] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.632462  7962 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.632934  7872 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.633651  7872 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.634490  7962 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:26.621325  7643 leader_election.cc:343] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.635100  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.635421  7872 ts_tablet_manager.cc:1434] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260501 13:58:26.636600  7872 tablet_bootstrap.cc:492] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.637354  7869 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.637236  8157 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.637998  7869 ts_tablet_manager.cc:1403] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.007s
I20260501 13:58:26.638998  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.640887  7869 raft_consensus.cc:359] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.641597  7869 raft_consensus.cc:385] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.641893  7869 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.639253  7868 tablet_bootstrap.cc:492] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.642742  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.643585  7826 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:26.645330  7872 tablet_bootstrap.cc:654] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.645491  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.646458  7676 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:58:26.647583  7643 leader_election.cc:343] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.648679  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.649250  7868 tablet_bootstrap.cc:654] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.649923  8051 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.642792  7869 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.653622  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:26.653839  7869 ts_tablet_manager.cc:1434] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260501 13:58:26.655085  7869 tablet_bootstrap.cc:492] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.657155  8157 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.657828  8157 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.658679  7962 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:26.659051  7962 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:26.659334  8051 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.659399  7962 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.660068  8157 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.664491  7869 tablet_bootstrap.cc:654] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.664794  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:26.667021  7643 leader_election.cc:343] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.672278  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.672415  7935 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:26.673590  8044 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260501 13:58:26.675310  7643 leader_election.cc:343] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.675853  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.678624  8157 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.683084  7747 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.692067  7868 tablet_bootstrap.cc:492] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.692843  7868 ts_tablet_manager.cc:1403] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.003s
I20260501 13:58:26.702489  7869 tablet_bootstrap.cc:492] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.701651  7868 raft_consensus.cc:359] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.703117  7869 ts_tablet_manager.cc:1403] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.018s
I20260501 13:58:26.703263  7868 raft_consensus.cc:385] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.703589  7868 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.705956  7868 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.706564  7869 raft_consensus.cc:359] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.707283  7869 raft_consensus.cc:385] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.707651  7869 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.708449  7869 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.708940  7962 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.711280  7962 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.712900  7825 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:26.713534  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:26.717716  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:26.718343  7825 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:26.721817  7643 leader_election.cc:343] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.713759  7868 ts_tablet_manager.cc:1434] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260501 13:58:26.715787  7869 ts_tablet_manager.cc:1434] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260501 13:58:26.731386  7869 tablet_bootstrap.cc:492] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.731540  8046 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:26.732513  7868 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.736291  7575 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:26.698660  7577 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 2, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:26.752424  8045 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.752916  7869 tablet_bootstrap.cc:654] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.752970  8045 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.754123  7825 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:26.755285  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:26.755861  8045 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.756964  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.757647  7676 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:26.758134  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.758524  7962 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:26.758623  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:26.759268  7962 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:26.759481  8046 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:26.759887  8046 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:58:26.759964  7792 leader_election.cc:343] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.760249  8046 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.760479  7962 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.764611  8130 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.765084  8130 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.768589  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.770056  7868 tablet_bootstrap.cc:654] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:26.770195  8130 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.783736  8157 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.784616  8157 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.776813  8046 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.791590  8046 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:26.800014  8051 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:26.800536  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.791919  8157 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:26.808885  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:26.808650  8051 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.810945  8051 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:26.813006  7643 leader_election.cc:343] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.817216  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:26.819545  7792 leader_election.cc:343] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.817296  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.818903  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:26.822445  7679 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.823966  7718 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.824137  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:26.824949  8051 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.839198  7869 tablet_bootstrap.cc:492] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:26.853483  7869 ts_tablet_manager.cc:1403] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.122s	user 0.032s	sys 0.026s
W20260501 13:58:26.914166  7643 leader_election.cc:343] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:26.916013  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:26.918519  7872 tablet_bootstrap.cc:492] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:26.919049  7872 ts_tablet_manager.cc:1403] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.283s	user 0.058s	sys 0.045s
I20260501 13:58:26.917333  8170 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:26.920969  7869 raft_consensus.cc:359] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.921712  7869 raft_consensus.cc:385] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.922019  7869 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.922710  7869 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.929445  7679 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:26.921726  7872 raft_consensus.cc:359] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.930450  7872 raft_consensus.cc:385] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.930722  7872 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.935295  7872 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.936528  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:26.942603  7868 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:26.942521  7935 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:26.943116  7868 ts_tablet_manager.cc:1403] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.004s
I20260501 13:58:26.943084  7935 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:26.945472  7872 ts_tablet_manager.cc:1434] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260501 13:58:26.943892  7935 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.948210  7869 ts_tablet_manager.cc:1434] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260501 13:58:26.950119  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:26.961192  7746 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:26.962881  7872 tablet_bootstrap.cc:492] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:26.950590  8044 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:26.955557  7868 raft_consensus.cc:359] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.965775  7868 raft_consensus.cc:385] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:26.966094  7868 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:26.966800  7868 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:26.972335  7868 ts_tablet_manager.cc:1434] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260501 13:58:26.975780  7868 tablet_bootstrap.cc:492] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:26.976773  7869 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:26.977880  7577 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:26.997213  7718 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.006428  8130 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.012188  8170 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.012801  8170 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.014189  7747 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.015007  8170 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.017935  7872 tablet_bootstrap.cc:654] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.020371  8044 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:27.032699  7868 tablet_bootstrap.cc:654] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.047205  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.055280  7872 tablet_bootstrap.cc:492] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:27.056072  7872 ts_tablet_manager.cc:1403] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.004s
I20260501 13:58:27.057538  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:27.058311  7643 leader_election.cc:343] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.067374  7745 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260501 13:58:27.064845  7643 leader_election.cc:343] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.068555  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.069581  7962 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.070180  7962 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:27.074993  8130 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 13:58:27.083654  7872 raft_consensus.cc:359] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.087129  7872 raft_consensus.cc:385] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.087445  7872 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.090986  7872 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.093051  7577 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:27.104212  8051 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.105139  8051 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.106861  7869 tablet_bootstrap.cc:654] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.107187  8051 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.125298  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.126145  7675 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:27.126188  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.129961  8157 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.130550  8157 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.134509  7872 ts_tablet_manager.cc:1434] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260501 13:58:27.143837  7872 tablet_bootstrap.cc:492] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:27.146975  8044 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.147994  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.148313  8044 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.150344  8044 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:27.151887  8157 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.141803  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:27.152413  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.153083  8051 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 13:58:27.153258  7718 leader_election.cc:343] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.153496  8051 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.153887  8051 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:27.153883  7792 leader_election.cc:343] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.206133  8082 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.206468  8051 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.206938  8082 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.216881  8082 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:27.234957  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.236980  7868 tablet_bootstrap.cc:492] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:27.237579  7868 ts_tablet_manager.cc:1403] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.262s	user 0.007s	sys 0.032s
I20260501 13:58:27.239224  7869 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:27.239774  7869 ts_tablet_manager.cc:1403] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.263s	user 0.018s	sys 0.000s
W20260501 13:58:27.242944  7792 leader_election.cc:343] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.247581  8051 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.256228  7869 raft_consensus.cc:359] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.257032  7869 raft_consensus.cc:385] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.257316  7869 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.257974  7869 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.247615  7872 tablet_bootstrap.cc:654] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.259660  7869 ts_tablet_manager.cc:1434] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.000s
I20260501 13:58:27.264438  7869 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:27.270843  7869 tablet_bootstrap.cc:654] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.273384  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.276090  7828 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 13:58:27.280647  7868 raft_consensus.cc:359] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.283402  8051 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:27.285423  7869 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:27.285338  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:58:27.290062  7643 leader_election.cc:343] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.292348  7869 ts_tablet_manager.cc:1403] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260501 13:58:27.295286  7869 raft_consensus.cc:359] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.296005  7869 raft_consensus.cc:385] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.296277  7869 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.296936  7869 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.297739  7872 tablet_bootstrap.cc:492] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:27.298242  7872 ts_tablet_manager.cc:1403] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.158s	user 0.015s	sys 0.001s
I20260501 13:58:27.298520  7869 ts_tablet_manager.cc:1434] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260501 13:58:27.299574  7869 tablet_bootstrap.cc:492] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:27.299839  7868 raft_consensus.cc:385] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.300186  7868 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.300863  7868 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.301293  7872 raft_consensus.cc:359] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.302033  7872 raft_consensus.cc:385] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.302318  7872 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.303268  7962 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.303735  7962 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.304404  7824 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.305817  7962 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.306360  7962 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.306810  7962 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.308681  7962 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.302920  7872 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.309587  7868 ts_tablet_manager.cc:1434] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.001s
I20260501 13:58:27.310606  7872 ts_tablet_manager.cc:1434] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260501 13:58:27.310734  7868 tablet_bootstrap.cc:492] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:27.311650  7872 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:27.315191  7824 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
W20260501 13:58:27.320412  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:27.328949  7869 tablet_bootstrap.cc:654] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.329311  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:27.330148  8051 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:27.330614  8051 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:27.331411  8051 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.332717  7868 tablet_bootstrap.cc:654] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.339268  8175 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.339617  7872 tablet_bootstrap.cc:654] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.339838  8175 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.341974  8175 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.344271  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.344506  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.344905  7679 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:27.346977  7868 tablet_bootstrap.cc:492] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:27.344807  7869 tablet_bootstrap.cc:492] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:27.348802  7872 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:27.349134  7869 ts_tablet_manager.cc:1403] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
I20260501 13:58:27.349269  7872 ts_tablet_manager.cc:1403] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.001s
I20260501 13:58:27.351806  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.352403  7676 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:27.352988  7868 ts_tablet_manager.cc:1403] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.005s
I20260501 13:58:27.352733  7872 raft_consensus.cc:359] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.353366  7872 raft_consensus.cc:385] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.353652  7872 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.354269  7872 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.355635  7868 raft_consensus.cc:359] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.356334  7868 raft_consensus.cc:385] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.352197  7869 raft_consensus.cc:359] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:27.356523  7718 leader_election.cc:343] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.356734  7872 ts_tablet_manager.cc:1434] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 13:58:27.356630  7868 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.356980  7869 raft_consensus.cc:385] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.357602  7869 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.357878  7868 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.358407  7869 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.359896  7868 ts_tablet_manager.cc:1434] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 13:58:27.360882  7868 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:27.361096  7869 ts_tablet_manager.cc:1434] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260501 13:58:27.361901  7872 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:27.366521  7868 tablet_bootstrap.cc:654] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.368433  7869 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:27.371198  7872 tablet_bootstrap.cc:654] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.374432  7745 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.378912  7869 tablet_bootstrap.cc:654] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.379305  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.381476  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.382100  7828 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:27.383874  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.385030  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.385632  7746 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:27.392490  7746 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.403985  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:27.405351  8046 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:27.405876  8046 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.406353  8046 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.408396  7575 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:27.409340  8175 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.409823  8175 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.414467  8175 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.415225  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.415997  7828 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:27.417856  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:27.418197  8082 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:27.418753  8175 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:58:27.419111  8175 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.419436  8175 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:27.424204  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:27.425544  7935 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:27.425872  7935 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.426158  7935 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.430263  8175 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:27.435949  7643 leader_election.cc:343] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.436460  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.437146  8118 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.438040  8046 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.438581  8118 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:27.439558  7962 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:27.443715  7935 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.445425  7935 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:27.445660  8046 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:27.450670  7643 leader_election.cc:343] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.451381  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:27.453140  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:27.454021  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:27.454609  7828 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:58:27.458508  7792 leader_election.cc:343] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.458427  8046 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.459455  8046 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.462517  8046 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:27.462864  7828 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:27.463773  8175 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.464506  8157 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:27.465015  8157 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.465431  8157 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.470162  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:27.474589  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.482291  7872 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:27.482856  7872 ts_tablet_manager.cc:1403] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.121s	user 0.007s	sys 0.005s
I20260501 13:58:27.482987  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:27.484213  8175 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:27.484695  8175 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:27.493494  7869 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:27.494680  7869 ts_tablet_manager.cc:1403] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.033s
I20260501 13:58:27.494809  8157 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.497797  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:27.498375  7676 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.498939  7869 raft_consensus.cc:359] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.500022  7869 raft_consensus.cc:385] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.500718  7869 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
W20260501 13:58:27.495760  7792 leader_election.cc:343] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.501791  7869 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:27.501788  7792 leader_election.cc:343] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.505080  7869 ts_tablet_manager.cc:1434] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260501 13:58:27.506534  7869 tablet_bootstrap.cc:492] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:27.507331  7676 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:27.485523  8175 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.510366  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.511929  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:27.497059  8157 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.517640  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.538640  7869 tablet_bootstrap.cc:654] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.536981  7824 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260501 13:58:27.524829  7872 raft_consensus.cc:359] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.544395  7872 raft_consensus.cc:385] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.544697  7872 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.547138  7868 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:27.547720  7868 ts_tablet_manager.cc:1403] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.187s	user 0.090s	sys 0.088s
I20260501 13:58:27.549338  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:27.550040  7745 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.550835  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:27.553181  7824 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.555168  8118 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.555634  8118 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.557950  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:58:27.558162  7643 leader_election.cc:343] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.558271  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.558566  7674 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.559046  7675 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:27.558651  7643 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.563575  7962 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.559068  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:27.566460  7676 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.568361  7868 raft_consensus.cc:359] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.569095  7868 raft_consensus.cc:385] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.569375  7868 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.570005  7868 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.557535  8118 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.574318  7872 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.576692  7962 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:27.580607  7872 ts_tablet_manager.cc:1434] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260501 13:58:27.581490  7676 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:27.581812  7872 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:27.583689  7745 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:27.584379  7869 tablet_bootstrap.cc:492] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:27.584887  7869 ts_tablet_manager.cc:1403] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.028s
I20260501 13:58:27.585657  7868 ts_tablet_manager.cc:1434] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260501 13:58:27.586762  7868 tablet_bootstrap.cc:492] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:27.587908  7869 raft_consensus.cc:359] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.588624  7869 raft_consensus.cc:385] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.588903  7869 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.590378  7872 tablet_bootstrap.cc:654] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.590050  7869 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.591769  7869 ts_tablet_manager.cc:1434] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260501 13:58:27.593047  7674 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:27.593775  7868 tablet_bootstrap.cc:654] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.597108  7869 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:27.604449  8118 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.605281  8118 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.616926  8118 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:27.617786  7718 leader_election.cc:343] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.618553  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.620136  8175 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.624228  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.625083  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.628238  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.628392  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:27.629407  8194 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:27.629554  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:27.629791  8194 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.630117  8194 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.630307  8045 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:27.630218  8120 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:27.630652  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:27.630925  8045 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:27.631532  8170 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:27.631933  8170 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:27.631932  8045 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.627676  7747 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260501 13:58:27.632943  8170 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.633742  7935 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:27.634207  7935 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:27.634979  7935 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.641178  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.641906  7747 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:27.650336  8170 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:58:27.650866  7643 leader_election.cc:343] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:27.661846  7643 leader_election.cc:343] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.677336  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:58:27.680673  7643 leader_election.cc:343] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.681313  7643 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.685005  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.683269  8157 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.694012  7824 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:27.705641  7935 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:27.693107  7962 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:27.718645  7869 tablet_bootstrap.cc:654] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.709158  7962 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.715646  7576 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:27.760387  7872 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:27.717797  8197 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:27.779053  7872 ts_tablet_manager.cc:1403] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.197s	user 0.030s	sys 0.029s
I20260501 13:58:27.780854  7935 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:58:27.768528  8201 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260501 13:58:27.782598  7935 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.757908  8120 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.778527  7962 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.788774  7935 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:27.758598  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52321us
I20260501 13:58:27.810664  7872 raft_consensus.cc:359] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.813422  7872 raft_consensus.cc:385] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.813865  7872 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.788259  8130 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.787966  8197 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:27.822660  7868 tablet_bootstrap.cc:492] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:27.823210  7868 ts_tablet_manager.cc:1403] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.237s	user 0.021s	sys 0.055s
I20260501 13:58:27.721299  8194 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.832155  8194 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:27.814899  7872 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.825026  8130 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.836869  8203 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.838883  7962 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.842571  7868 raft_consensus.cc:359] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.791605  8120 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.824242  8197 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.849022  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.854522  8203 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:27.849910  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 63022.7us
I20260501 13:58:27.850102  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:27.855489  7868 raft_consensus.cc:385] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.862836  8120 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.863096  8203 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.857883  7868 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:27.864656  7868 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.867381  7575 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:27.869468  7962 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.869691  7575 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:27.888332  8130 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:27.890591  7872 ts_tablet_manager.cc:1434] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.109s	user 0.020s	sys 0.024s
I20260501 13:58:27.892140  7872 tablet_bootstrap.cc:492] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:27.899197  8045 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:27.899775  8045 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.905743  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.906227  8045 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:27.909790  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.910599  7674 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:27.912156  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:27.912817  7673 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:27.912182  7792 leader_election.cc:343] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:27.919301  7792 leader_election.cc:343] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.920737  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.921691  7674 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:27.922952  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.923645  7751 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:27.932437  7868 ts_tablet_manager.cc:1434] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.007s
I20260501 13:58:27.935370  7868 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
W20260501 13:58:27.902787  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 101969us
I20260501 13:58:27.936990  7869 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:27.938795  7869 ts_tablet_manager.cc:1403] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.342s	user 0.015s	sys 0.022s
W20260501 13:58:27.941545  7643 leader_election.cc:343] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.944733  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:27.945050  7872 tablet_bootstrap.cc:654] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:27.947839  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:27.948443  7747 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.949225  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.952337  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.961835  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:27.959964  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:27.963028  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:27.962702  8045 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:27.963652  8045 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:27.964044  8045 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.963233  7828 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:27.961040  7869 raft_consensus.cc:359] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.967615  7869 raft_consensus.cc:385] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:27.967927  7869 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
W20260501 13:58:27.972239  7643 leader_election.cc:343] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:27.974416  7643 leader_election.cc:343] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:27.974416  7869 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:27.977312  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:27.976564  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:27.978127  7678 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:27.978273  7869 ts_tablet_manager.cc:1434] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260501 13:58:27.979329  7869 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:27.979430  8206 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:27.990877  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:27.969224  7673 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:28.000530  8045 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.003641  8051 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260501 13:58:28.006989  7643 leader_election.cc:343] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.007472  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.009528  8197 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:28.012838  7747 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:28.014914  7575 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:28.021198  8045 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:28.022132  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.024117  8208 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.024222  8130 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260501 13:58:28.013921  7828 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:28.031900  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:28.035516  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:28.036491  7935 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.037927  7872 tablet_bootstrap.cc:492] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:28.038466  7872 ts_tablet_manager.cc:1403] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.147s	user 0.023s	sys 0.023s
I20260501 13:58:28.032614  8082 raft_consensus.cc:2764] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260501 13:58:28.039685  7935 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:28.040910  7935 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.034828  8170 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.051348  8170 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:28.052366  8170 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.053963  7675 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260501 13:58:28.054385  7675 pending_rounds.cc:85] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 0
I20260501 13:58:28.054685  7675 pending_rounds.cc:107] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260501 13:58:28.054975  7675 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:58:28.069695  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:28.071434  7678 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.072050  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:28.082196  8130 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260501 13:58:28.108907  7792 leader_election.cc:343] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.109056  7868 tablet_bootstrap.cc:654] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.114848  7869 tablet_bootstrap.cc:654] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.120396  7824 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 13:58:28.128047  8213 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.128644  8213 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:28.132992  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:28.140208  8051 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260501 13:58:28.145844  7872 raft_consensus.cc:359] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.146593  7872 raft_consensus.cc:385] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.146869  7872 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.143249  7678 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:28.147501  7872 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.148294  8208 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:28.151674  7872 ts_tablet_manager.cc:1434] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
I20260501 13:58:28.154938  7872 tablet_bootstrap.cc:492] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:28.160059  8213 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.161731  8082 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:28.195009  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:28.212037  8046 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.211022  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:28.231458  7872 tablet_bootstrap.cc:654] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.229167  8046 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:28.231424  8130 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:58:28.239751  7643 leader_election.cc:343] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.242107  8130 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.246068  8130 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.246328  7869 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:28.246871  7869 ts_tablet_manager.cc:1403] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.268s	user 0.011s	sys 0.014s
I20260501 13:58:28.233582  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:28.250144  7643 leader_election.cc:343] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.250576  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.252784  7962 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:28.236382  8046 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.254339  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:28.249447  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:28.265894  8219 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260501 13:58:28.266410  7868 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:28.266937  7868 ts_tablet_manager.cc:1403] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.332s	user 0.019s	sys 0.007s
I20260501 13:58:28.272109  7868 raft_consensus.cc:359] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.272825  7868 raft_consensus.cc:385] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.273137  7868 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.280638  7868 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.255043  7673 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:28.289040  7575 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:28.297751  7869 raft_consensus.cc:359] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.298838  7869 raft_consensus.cc:385] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.299194  7869 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.301294  7869 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.303961  7872 tablet_bootstrap.cc:492] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:28.304471  7872 ts_tablet_manager.cc:1403] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.007s
I20260501 13:58:28.304607  7869 ts_tablet_manager.cc:1434] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260501 13:58:28.273092  8204 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260501 13:58:28.318682  7718 leader_election.cc:343] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.316577  7869 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:28.316658  8194 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260501 13:58:28.351411  7868 ts_tablet_manager.cc:1434] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.004s
I20260501 13:58:28.353469  7868 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:28.357713  7576 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:28.364048  7868 tablet_bootstrap.cc:654] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.371906  7869 tablet_bootstrap.cc:654] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.365597  7872 raft_consensus.cc:359] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.372327  7872 raft_consensus.cc:385] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.372696  7872 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.366937  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.380645  7872 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.389001  8175 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.389506  8175 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.392072  7872 ts_tablet_manager.cc:1434] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.003s
I20260501 13:58:28.382853  8130 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:28.398554  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:28.396136  8130 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:28.403915  8130 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.404104  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:28.414613  7868 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:28.415584  7868 ts_tablet_manager.cc:1403] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.014s
I20260501 13:58:28.418494  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.429994  7872 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:28.398104  8175 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.427791  8227 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 13:58:28.434340  8228 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260501 13:58:28.441745  7868 raft_consensus.cc:359] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.442350  7868 raft_consensus.cc:385] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.442595  7868 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.443104  7868 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.452782  8130 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.456082  7868 ts_tablet_manager.cc:1434] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.002s
I20260501 13:58:28.456336  8130 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.457109  7868 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:28.457481  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:28.458011  7676 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.429215  8203 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260501 13:58:28.467193  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:28.468281  7754 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:28.471396  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:28.482412  7676 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:28.482945  7869 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:28.484227  7869 ts_tablet_manager.cc:1403] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.178s	user 0.028s	sys 0.057s
I20260501 13:58:28.484369  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:28.485996  8227 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.486438  8227 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:58:28.487308  7718 leader_election.cc:343] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.498122  7869 raft_consensus.cc:359] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.499119  7869 raft_consensus.cc:385] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.499395  7869 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.500214  7869 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.503683  7872 tablet_bootstrap.cc:654] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:28.507395  8232 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260501 13:58:28.511178  7574 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:28.512585  8130 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.514642  8130 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.516366  7962 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:28.518162  8204 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:28.489480  8227 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.536191  8203 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:28.540582  8203 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:28.542589  7868 tablet_bootstrap.cc:654] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.507560  7869 ts_tablet_manager.cc:1434] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260501 13:58:28.545105  7869 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:28.557292  7869 tablet_bootstrap.cc:654] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.560959  8130 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.598007  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:28.598739  7672 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:28.601696  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:28.589105  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:28.604964  7869 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:28.605650  7869 ts_tablet_manager.cc:1403] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.014s
I20260501 13:58:28.610057  8130 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:58:28.629654  7869 raft_consensus.cc:359] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.630650  7869 raft_consensus.cc:385] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.631343  7869 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.640148  8170 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.640862  8170 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.632357  7869 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.644605  8170 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.624166  8130 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:58:28.647495  7872 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
W20260501 13:58:28.647902  8237 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260501 13:58:28.648150  7872 ts_tablet_manager.cc:1403] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.015s
I20260501 13:58:28.647490  8130 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:28.624738  8203 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.663154  8203 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.665192  8203 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.669562  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:28.697485  7872 raft_consensus.cc:359] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.695104  8229 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.704070  7872 raft_consensus.cc:385] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.704416  7872 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.704356  8229 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.705258  7872 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.706589  8229 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:28.707952  7872 ts_tablet_manager.cc:1434] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260501 13:58:28.710682  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:28.711333  7754 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:28.712636  7747 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.712735  7576 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 13:58:28.712155  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 56971.8us
I20260501 13:58:28.723793  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:28.724797  7824 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:28.727946  7868 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:28.728457  7868 ts_tablet_manager.cc:1403] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.272s	user 0.034s	sys 0.070s
I20260501 13:58:28.728919  7869 ts_tablet_manager.cc:1434] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.123s	user 0.018s	sys 0.000s
I20260501 13:58:28.730041  7869 tablet_bootstrap.cc:492] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:28.731212  7868 raft_consensus.cc:359] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.731953  7868 raft_consensus.cc:385] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.732216  7868 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.732975  7868 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.735170  7868 ts_tablet_manager.cc:1434] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260501 13:58:28.734951  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:28.737859  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:28.738611  7678 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
W20260501 13:58:28.739773  7643 leader_election.cc:343] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
W20260501 13:58:28.740574  7792 leader_election.cc:343] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.742260  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:28.743793  8197 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:28.744220  8197 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:28.744539  8197 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.744573  8130 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.745767  7753 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:58:28.746620  8130 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.748482  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:28.749876  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:28.753572  8229 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:28.755256  8045 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:28.755615  8045 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:28.756413  8045 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.757053  8197 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.757598  8045 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:28.758018  7872 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:28.760507  7868 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
W20260501 13:58:28.761363  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:28.770015  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:28.772357  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.758949  8197 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.773258  7868 tablet_bootstrap.cc:654] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.773363  8224 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:28.773774  8224 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:28.774073  8224 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:28.774837  7643 leader_election.cc:343] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.778040  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:28.779282  7827 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.781311  7935 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260501 13:58:28.787420  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:28.788972  7672 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:28.793798  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:28.779982  8170 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:28.806195  8170 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:58:28.822021  7643 leader_election.cc:343] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.824793  8170 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.827997  8229 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.828583  8229 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.830443  8229 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:28.846218  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:28.847142  7675 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 1: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:58:28.860596  7869 tablet_bootstrap.cc:654] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.863853  8206 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.864435  8206 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.866212  8206 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.872054  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:28.873771  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:28.877828  7872 tablet_bootstrap.cc:654] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:28.880673  7643 leader_election.cc:343] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.878283  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:28.887580  7643 leader_election.cc:343] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.888101  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.888779  8203 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:28.894040  7792 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:28.895171  7935 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.893193  8224 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.903910  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:28.904584  7675 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.911268  7869 tablet_bootstrap.cc:492] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:28.912317  7869 ts_tablet_manager.cc:1403] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.007s
I20260501 13:58:28.913695  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:28.917369  7827 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
W20260501 13:58:28.918234  7792 leader_election.cc:343] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.903245  8224 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:28.919516  7675 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:28.923889  7672 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:28.883006  8170 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.918691  7935 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:28.928715  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:28.928933  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.928731  8170 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.929517  8118 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.930091  8118 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:28.930120  8227 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:28.930598  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:28.931094  8227 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:28.931252  7753 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:28.930935  8118 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.931949  8227 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.938809  7868 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:28.939420  7868 ts_tablet_manager.cc:1403] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.019s
I20260501 13:58:28.941834  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:28.942427  7868 raft_consensus.cc:359] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.943158  7868 raft_consensus.cc:385] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.943418  7868 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
W20260501 13:58:28.943775  7643 leader_election.cc:343] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:28.944365  7753 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:28.929008  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:28.947140  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:28.946465  8224 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.947974  8203 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:28.948434  8224 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:28.948498  8203 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:28.949671  8203 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.949842  8224 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.944505  7868 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.941848  7869 raft_consensus.cc:359] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.966231  7869 raft_consensus.cc:385] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:28.965875  7868 ts_tablet_manager.cc:1434] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260501 13:58:28.967375  7868 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:28.969936  7575 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:28.971240  7576 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:28.980345  7869 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:28.981192  7869 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.983628  7869 ts_tablet_manager.cc:1434] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.000s
I20260501 13:58:28.984686  7869 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:28.988843  7574 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:28.992540  7868 tablet_bootstrap.cc:654] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.994415  8203 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:28.994839  7869 tablet_bootstrap.cc:654] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:28.994988  8203 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:28.997149  8203 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:28.997592  7872 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:28.998119  7872 ts_tablet_manager.cc:1403] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.008s
I20260501 13:58:28.998319  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:28.999763  7643 leader_election.cc:343] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.000613  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.002175  7643 leader_election.cc:343] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.002628  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.003952  7872 raft_consensus.cc:359] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.005012  7872 raft_consensus.cc:385] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.005327  7872 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.006268  7872 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.005409  8206 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.013984  8227 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:29.029997  7574 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:29.038638  7869 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:29.039309  7869 ts_tablet_manager.cc:1403] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.037s
I20260501 13:58:29.042107  7869 raft_consensus.cc:359] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.043447  7869 raft_consensus.cc:385] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.043726  7869 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.045225  7869 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.045392  8225 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:29.047915  7869 ts_tablet_manager.cc:1434] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260501 13:58:29.049140  7869 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:29.057734  7869 tablet_bootstrap.cc:654] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.070034  7872 ts_tablet_manager.cc:1434] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260501 13:58:29.071277  7872 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.087920  7869 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:29.088524  7869 ts_tablet_manager.cc:1403] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.006s
I20260501 13:58:29.090790  7869 raft_consensus.cc:359] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.091487  7869 raft_consensus.cc:385] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.091775  7869 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.092334  7869 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.094260  7869 ts_tablet_manager.cc:1434] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260501 13:58:29.098081  7869 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Bootstrap starting.
I20260501 13:58:29.106464  7869 tablet_bootstrap.cc:654] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.108575  7868 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.109081  7868 ts_tablet_manager.cc:1403] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.142s	user 0.006s	sys 0.009s
I20260501 13:58:29.112996  7868 raft_consensus.cc:359] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.117661  7868 raft_consensus.cc:385] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.116853  7872 tablet_bootstrap.cc:654] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.117995  7868 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.118697  7868 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.125415  7868 ts_tablet_manager.cc:1434] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260501 13:58:29.126989  7868 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.129256  7869 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: No bootstrap required, opened a new log
I20260501 13:58:29.129757  7869 ts_tablet_manager.cc:1403] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.003s
I20260501 13:58:29.132436  7869 raft_consensus.cc:359] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.133124  7869 raft_consensus.cc:385] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.133407  7869 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.134023  7869 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.144016  7869 ts_tablet_manager.cc:1434] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260501 13:58:29.146551  7868 tablet_bootstrap.cc:654] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.154017  7872 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.154507  7872 ts_tablet_manager.cc:1403] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.019s
I20260501 13:58:29.154565  7868 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.155071  7868 ts_tablet_manager.cc:1403] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.009s
I20260501 13:58:29.157209  7872 raft_consensus.cc:359] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.157588  7868 raft_consensus.cc:359] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.157974  7872 raft_consensus.cc:385] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.159847  7868 raft_consensus.cc:385] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.160151  7868 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.160775  7868 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.159588  7872 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.163480  7868 ts_tablet_manager.cc:1434] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 13:58:29.163542  7872 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.164584  7868 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.166028  7872 ts_tablet_manager.cc:1434] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260501 13:58:29.171636  7868 tablet_bootstrap.cc:654] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.174870  8045 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.175355  8045 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.177989  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.178635  7672 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:29.179489  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.180737  7792 leader_election.cc:343] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.181238  8045 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.182669  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.183888  8224 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:29.184244  8224 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:29.184562  8224 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.192874  8230 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.193369  8230 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.194628  7872 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.194998  8224 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.196851  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.197077  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.198057  7672 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:29.195361  8230 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.200100  8045 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.200589  8045 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.200980  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.201303  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:29.202107  8230 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.202440  8045 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:29.203753  7792 leader_election.cc:343] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.205294  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.206871  7792 leader_election.cc:343] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.207515  8224 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.209446  8118 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.209892  8118 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.210896  7872 tablet_bootstrap.cc:654] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.211700  8118 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.217494  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:29.218339  7672 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.219107  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.220482  7868 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.220607  7675 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:29.220978  7868 ts_tablet_manager.cc:1403] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.057s	user 0.036s	sys 0.008s
I20260501 13:58:29.223328  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.223892  7868 raft_consensus.cc:359] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.224395  8045 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:29.224550  7868 raft_consensus.cc:385] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.224819  8045 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:29.225293  8045 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.224383  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.227092  7643 leader_election.cc:343] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.227171  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.224850  7868 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.236114  8230 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.234290  7672 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:29.234681  7872 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.236125  7868 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.234675  8045 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.237564  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.238325  7827 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:29.237310  7872 ts_tablet_manager.cc:1403] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.017s
I20260501 13:58:29.239184  7868 ts_tablet_manager.cc:1434] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260501 13:58:29.241012  7868 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.241451  7643 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.242144  8118 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.240789  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:58:29.243605  7792 leader_election.cc:343] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.244347  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:29.238967  8045 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.245322  8045 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:29.245780  8045 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:29.246948  7868 tablet_bootstrap.cc:654] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.246591  8045 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.250291  7872 raft_consensus.cc:359] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.250972  7872 raft_consensus.cc:385] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.251235  7872 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.251878  7872 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.255236  7872 ts_tablet_manager.cc:1434] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260501 13:58:29.258833  7872 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.259305  8118 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.268913  7872 tablet_bootstrap.cc:654] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.270181  8118 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.270701  8118 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.274271  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.275396  7643 leader_election.cc:343] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.275529  8118 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.277415  7672 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:29.277590  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:29.280400  7643 leader_election.cc:343] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.280819  7643 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.281857  7868 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.282109  8118 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.282400  7868 ts_tablet_manager.cc:1403] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.016s
I20260501 13:58:29.284710  7575 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:29.286463  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.286604  7868 raft_consensus.cc:359] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.287338  7868 raft_consensus.cc:385] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.287617  7868 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.288409  8224 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:29.288254  7868 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.289077  8224 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:29.290222  8224 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.293540  7868 ts_tablet_manager.cc:1434] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260501 13:58:29.294574  7868 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.301004  7872 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.301539  7872 ts_tablet_manager.cc:1403] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.015s
I20260501 13:58:29.302340  7868 tablet_bootstrap.cc:654] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.304205  7872 raft_consensus.cc:359] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.304751  7872 raft_consensus.cc:385] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.305039  7872 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.305805  7872 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.307091  7868 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.307534  7868 ts_tablet_manager.cc:1403] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260501 13:58:29.308038  7872 ts_tablet_manager.cc:1434] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260501 13:58:29.310815  7872 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.310843  7868 raft_consensus.cc:359] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.311625  7868 raft_consensus.cc:385] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.311921  7868 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.312623  7868 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.315163  7868 ts_tablet_manager.cc:1434] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 13:58:29.316133  7868 tablet_bootstrap.cc:492] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.319589  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:29.326050  7868 tablet_bootstrap.cc:654] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.326925  7872 tablet_bootstrap.cc:654] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.339563  7868 tablet_bootstrap.cc:492] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.340111  7868 ts_tablet_manager.cc:1403] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.012s
I20260501 13:58:29.339725  7872 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.340770  7872 ts_tablet_manager.cc:1403] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.010s
I20260501 13:58:29.342969  7868 raft_consensus.cc:359] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.343652  7868 raft_consensus.cc:385] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.343997  7868 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.343984  7872 raft_consensus.cc:359] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.344942  7872 raft_consensus.cc:385] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.345270  7872 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.344798  7868 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.346067  7872 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.347322  7868 ts_tablet_manager.cc:1434] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 13:58:29.348196  7872 ts_tablet_manager.cc:1434] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 13:58:29.348261  7868 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.350108  7872 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.357050  7872 tablet_bootstrap.cc:654] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.360204  7827 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:29.360445  8130 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.360563  7868 tablet_bootstrap.cc:654] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.360939  8130 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.362844  8130 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.369968  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.374069  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.375078  7827 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:58:29.376156  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.377075  8230 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.376981  8130 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:29.384562  8230 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.385558  8118 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.432590  8118 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.434825  8118 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.438710  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.441162  7643 leader_election.cc:343] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.452432  8118 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.453158  8118 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.453975  8203 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:29.454299  8229 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.454944  8229 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.455760  8118 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.458679  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.459864  7643 leader_election.cc:343] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.461387  8229 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.462855  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.472101  7672 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:29.472512  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.468568  8204 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.473681  8204 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.475056  8204 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.463774  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:29.476539  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:29.478067  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.481940  7672 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:29.482591  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:29.485785  8204 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:29.486222  8204 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:29.486610  8204 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.488883  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.497506  8118 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:29.498791  8204 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:29.485489  7792 leader_election.cc:343] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.502054  8204 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:58:29.502179  7792 leader_election.cc:343] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.503013  8204 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:29.503136  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.506944  8229 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:29.507323  8229 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:29.507645  8229 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
W20260501 13:58:29.516888  7643 leader_election.cc:343] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.517395  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.518090  8118 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.519960  7672 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:29.521564  8203 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:29.522351  8225 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:29.522687  7868 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.523331  7868 ts_tablet_manager.cc:1403] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.175s	user 0.035s	sys 0.083s
I20260501 13:58:29.525098  8194 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.525583  8194 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.527361  8194 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.528718  7868 raft_consensus.cc:359] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.529588  7868 raft_consensus.cc:385] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.529899  7868 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
W20260501 13:58:29.530773  7643 leader_election.cc:343] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.530656  7868 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.531277  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.537648  8229 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.538604  8203 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.532720  7868 ts_tablet_manager.cc:1434] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260501 13:58:29.554739  8225 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.584501  8203 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.585430  8229 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.585587  8203 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.588799  8203 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.580183  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:29.590235  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:29.581869  7625 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 13:58:29.584487  8225 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.585114  7868 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.557072  8206 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.592473  7827 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.599052  7868 tablet_bootstrap.cc:654] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.605093  8206 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.607419  8206 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.592931  8225 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:29.615258  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 51746.1us
I20260501 13:58:29.617465  7872 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.629269  7872 ts_tablet_manager.cc:1403] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.279s	user 0.045s	sys 0.032s
I20260501 13:58:29.628129  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:29.629948  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.632773  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:29.632900  7872 raft_consensus.cc:359] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.634156  7872 raft_consensus.cc:385] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.634609  7872 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.617190  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:29.617616  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:58:29.638460  7792 leader_election.cc:343] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.640548  8194 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.641106  8194 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.643203  8194 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.646193  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.647187  7824 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 0.
I20260501 13:58:29.648030  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.648833  7677 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:58:29.649125  7643 leader_election.cc:343] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.646126  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:29.649766  7676 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.635561  7872 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.650796  7754 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.651973  8225 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.652726  8225 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.660084  8225 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:29.660454  7643 leader_election.cc:343] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.661990  8225 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.662523  8225 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.665369  8225 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.662886  7754 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:29.669157  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.669961  7872 ts_tablet_manager.cc:1434] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260501 13:58:29.670003  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.670317  8230 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.671190  7872 tablet_bootstrap.cc:492] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.678890  7872 tablet_bootstrap.cc:654] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.680037  8274 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:29.680349  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.682868  8230 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.661286  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:29.687510  7672 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.688895  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.689783  7675 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:29.692176  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:29.693279  8045 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:29.693727  8045 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:29.694222  7676 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:29.694568  8045 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.697009  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.697491  7872 tablet_bootstrap.cc:492] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.697978  7872 ts_tablet_manager.cc:1403] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260501 13:58:29.693729  8204 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260501 13:58:29.699538  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:29.701445  7718 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.702605  7672 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:29.703941  8225 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.704200  7872 raft_consensus.cc:359] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.704897  7872 raft_consensus.cc:385] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.705181  7872 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.705889  7872 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.707034  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.707418  7872 ts_tablet_manager.cc:1434] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260501 13:58:29.708331  7872 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.710065  7868 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.710549  7868 ts_tablet_manager.cc:1403] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.126s	user 0.041s	sys 0.015s
I20260501 13:58:29.710481  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:29.712044  8278 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:29.712534  8278 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:29.712936  8278 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.713672  7868 raft_consensus.cc:359] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.714421  7868 raft_consensus.cc:385] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.714740  7868 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.715418  7868 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.717214  7872 tablet_bootstrap.cc:654] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.717947  7868 ts_tablet_manager.cc:1434] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260501 13:58:29.719431  7643 leader_election.cc:343] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.732292  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.733407  8274 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.736517  8204 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.719445  7868 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.769361  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:29.770716  8230 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.772214  8278 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.774124  7872 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.777102  7872 ts_tablet_manager.cc:1403] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.038s
I20260501 13:58:29.778393  8230 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:29.785261  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.774240  8278 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:29.786840  7872 raft_consensus.cc:359] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.796268  7872 raft_consensus.cc:385] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.796624  7872 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.781564  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:29.797333  7872 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.797742  7672 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:29.787997  8224 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:29.798511  8224 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:29.803031  8224 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.806222  7868 tablet_bootstrap.cc:654] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.810225  7574 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:29.814571  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:29.815245  7828 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.816120  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:29.816644  7872 ts_tablet_manager.cc:1434] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260501 13:58:29.817754  7872 tablet_bootstrap.cc:492] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.823712  7828 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:29.827100  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:29.827734  8274 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:29.828253  8274 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:29.829466  7872 tablet_bootstrap.cc:654] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:29.829324  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:29.829115  8274 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.829970  7752 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.833402  7868 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.833973  7868 ts_tablet_manager.cc:1403] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.002s
I20260501 13:58:29.836983  7749 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.836911  7868 raft_consensus.cc:359] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.850155  7868 raft_consensus.cc:385] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.850593  7868 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.851284  7868 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.853675  7868 ts_tablet_manager.cc:1434] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260501 13:58:29.854763  7868 tablet_bootstrap.cc:492] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Bootstrap starting.
I20260501 13:58:29.868479  7868 tablet_bootstrap.cc:654] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Neither blocks nor log segments found. Creating new log.
W20260501 13:58:29.871115  7792 leader_election.cc:343] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:29.875295  8045 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:29.902447  8224 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260501 13:58:29.920516  7752 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:58:29.923970  8204 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:29.947103  8204 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.949241  8204 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:29.939522  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:29.950407  8204 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:29.951026  8204 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:29.951455  8204 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:29.970088  7872 tablet_bootstrap.cc:492] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:29.970719  7872 ts_tablet_manager.cc:1403] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.153s	user 0.051s	sys 0.063s
I20260501 13:58:29.973663  7868 tablet_bootstrap.cc:492] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: No bootstrap required, opened a new log
I20260501 13:58:29.973557  7872 raft_consensus.cc:359] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.974200  7868 ts_tablet_manager.cc:1403] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Time spent bootstrapping tablet: real 0.120s	user 0.051s	sys 0.047s
I20260501 13:58:29.974296  7872 raft_consensus.cc:385] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.974635  7872 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.975450  7872 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.977782  7868 raft_consensus.cc:359] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.978538  7868 raft_consensus.cc:385] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:29.978950  7868 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Initialized, Role: FOLLOWER
I20260501 13:58:29.978614  7872 ts_tablet_manager.cc:1434] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 13:58:29.979611  7868 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:29.980963  7872 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:29.982112  7868 ts_tablet_manager.cc:1434] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 13:58:29.985960  7574 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:29.993655  7872 tablet_bootstrap.cc:654] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:30.003676  7872 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:30.004602  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:30.005049  7872 ts_tablet_manager.cc:1403] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.005s
I20260501 13:58:30.007388  8204 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.008103  7872 raft_consensus.cc:359] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.008975  7872 raft_consensus.cc:385] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:30.009269  7872 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:30.009640  8204 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:30.010161  7872 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.012712  7872 ts_tablet_manager.cc:1434] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 13:58:30.013827  7872 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
W20260501 13:58:30.017650  7792 leader_election.cc:343] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:30.020833  7872 tablet_bootstrap.cc:654] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:30.027344  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:30.027576  7872 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:30.027071  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:30.028366  7872 ts_tablet_manager.cc:1403] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260501 13:58:30.028807  8230 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:30.029306  8230 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.030797  7872 raft_consensus.cc:359] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.031011  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:30.031337  8230 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:30.031550  7872 raft_consensus.cc:385] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:30.031759  7672 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:30.031911  7872 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:30.032003  7750 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.032737  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:30.032847  7872 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.033362  7828 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:30.034384  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:30.035216  7872 ts_tablet_manager.cc:1434] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260501 13:58:30.036521  7872 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:30.039994  8130 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:30.040441  8130 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:30.040858  8130 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.042063  7750 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.043211  7872 tablet_bootstrap.cc:654] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:30.043862  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:30.045740  8204 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:30.047039  8204 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:30.047957  8204 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.057060  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:30.057912  7678 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.068214  8224 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:30.070961  8224 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.074182  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:30.075228  8224 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:30.075592  8224 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:30.075944  8224 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.079555  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:30.080405  7676 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 0.
I20260501 13:58:30.082983  8130 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.097883  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:30.098582  7827 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.098214  8224 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.100804  8045 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.107961  7827 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:30.109115  8130 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:30.118745  7872 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:30.140872  7678 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.141463  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:30.141566  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:30.121361  8224 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:30.142112  7672 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.124343  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:30.127882  8194 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:30.142966  7872 ts_tablet_manager.cc:1403] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.038s
I20260501 13:58:30.142781  8194 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:30.144322  7792 leader_election.cc:343] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:30.144739  8194 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:30.145826  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:58:30.147017  7792 leader_election.cc:343] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Illegal state: must be running to vote when last-logged opid is not known
I20260501 13:58:30.148811  7872 raft_consensus.cc:359] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.149636  8130 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:30.152498  8130 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:30.149502  7872 raft_consensus.cc:385] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:30.153753  7872 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:30.154419  7872 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.154285  8130 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.155745  7872 ts_tablet_manager.cc:1434] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260501 13:58:30.156654  7872 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Bootstrap starting.
I20260501 13:58:30.151731  7672 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:58:30.162215  8045 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:30.162680  8045 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.164710  8045 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:30.166323  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:58:30.166924  7750 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:30.175429  7872 tablet_bootstrap.cc:654] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Neither blocks nor log segments found. Creating new log.
I20260501 13:58:30.185297  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:30.186313  8045 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:30.186759  8045 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:30.187165  8045 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.194001  8230 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:30.194813  7872 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: No bootstrap required, opened a new log
I20260501 13:58:30.194541  8230 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.195323  7872 ts_tablet_manager.cc:1403] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260501 13:58:30.198271  7872 raft_consensus.cc:359] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.198922  7872 raft_consensus.cc:385] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 13:58:30.199231  7872 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Initialized, Role: FOLLOWER
I20260501 13:58:30.199970  7872 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.201435  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:30.202252  7872 ts_tablet_manager.cc:1434] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260501 13:58:30.202415  8230 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:30.207841  8045 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.209661  8045 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:30.211863  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:30.212453  7676 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.216259  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:30.217124  7750 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.218286  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:30.218492  7676 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.218936  7672 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:30.221910  7576 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:30.223632  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:30.224308  7675 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 0.
I20260501 13:58:30.225123  7750 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.226269  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:30.226797  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:30.227097  8194 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:30.227327  7675 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.227424  8130 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:58:30.227679  8194 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:30.227968  8130 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.228726  8194 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.234372  8130 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:30.235216  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:58:30.236091  7827 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:30.250689  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:30.251570  7673 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:30.254382  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:58:30.255533  7672 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 1: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:58:30.264485  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:30.266070  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:30.267127  8194 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:30.267580  8194 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:30.268790  8194 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.271574  8045 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 13:58:30.272035  8045 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:58:30.272467  8045 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.273011  7935 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.282840  8045 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:30.295027  8045 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:30.296294  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:30.297122  7750 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.307631  7750 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.309311  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:30.310177  8194 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 13:58:30.310695  8194 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:30.312463  8194 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:58:30.343560  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 83669.1us
I20260501 13:58:30.346932  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:30.349648  8227 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.355769  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:30.356416  7673 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.360628  8227 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 13:58:30.361688  8307 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.375254  7673 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.377156  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:58:30.378199  7675 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:58:30.378683  8227 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 0 FOLLOWER]: Advancing to term 1
I20260501 13:58:30.389310  8194 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:30.398581  8227 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 13:58:30.555362  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 82073us
I20260501 13:58:30.556236  8313 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.561862  8316 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.580731  8225 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:30.601871  8045 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.615032  7575 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 0 to 1, leader changed from <none> to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:30.622350  8224 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.647118  8225 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.661170  8204 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 13:58:30.694605  8204 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.701602  7576 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:30.704941  7576 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:30.706597  7576 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:58:30.729815  7935 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.755770  7935 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.770694  8194 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 13:58:30.817548  8194 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260501 13:58:31.463552  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08000edc60 after lost signal to thread 6457
W20260501 13:58:31.464679  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6540 after lost signal to thread 7611
W20260501 13:58:31.465669  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08002a98e0 after lost signal to thread 7703
W20260501 13:58:31.466661  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1160 after lost signal to thread 7778
W20260501 13:58:31.467617  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4da0 after lost signal to thread 7852
I20260501 13:58:32.435128  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 13:58:32.454792  8334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:32.456525  8335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 13:58:32.460804  8337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 13:58:32.461210  6454 server_base.cc:1061] running on GCE node
I20260501 13:58:32.463690  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 13:58:32.464056  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 13:58:32.464309  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777643912464280 us; error 0 us; skew 500 ppm
I20260501 13:58:32.465050  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 13:58:32.470774  6454 webserver.cc:492] Webserver started at http://127.6.77.132:35359/ using document root <none> and password file <none>
I20260501 13:58:32.473945  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 13:58:32.474279  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 13:58:32.474705  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 13:58:32.476646  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-3-root/instance:
uuid: "91854d93e96c4756834efe8b2ef59fce"
format_stamp: "Formatted at 2026-05-01 13:58:32 on dist-test-slave-1sft"
I20260501 13:58:32.483925  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260501 13:58:32.489012  8342 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:32.490859  6454 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260501 13:58:32.491422  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-3-root
uuid: "91854d93e96c4756834efe8b2ef59fce"
format_stamp: "Formatted at 2026-05-01 13:58:32 on dist-test-slave-1sft"
I20260501 13:58:32.492013  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 13:58:32.525866  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 13:58:32.527756  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 13:58:32.529748  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 13:58:32.532706  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 13:58:32.532920  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:32.533231  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 13:58:32.533407  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 13:58:32.728849  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.132:40155
I20260501 13:58:32.729383  8405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.132:40155 every 8 connection(s)
I20260501 13:58:32.735206  6454 auto_leader_rebalancer-test.cc:417] add a tserver: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:32.760607  8406 heartbeater.cc:344] Connected to a master server at 127.6.77.190:38503
I20260501 13:58:32.761198  8406 heartbeater.cc:461] Registering TS with master...
I20260501 13:58:32.762218  8406 heartbeater.cc:507] Master 127.6.77.190:38503 requested a full tablet report, sending...
I20260501 13:58:32.764479  7574 ts_manager.cc:194] Registered new tserver with Master: 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:58:32.765940  7574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33244
I20260501 13:58:32.952764  7827 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:32.964900  7745 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:32.966663  8333 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:32.967537  7675 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:32.971560  8333 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260501 13:58:33.002854  7792 consensus_peers.cc:597] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91eb60ac1c7a48a0b3662ef7e5327f66. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:33.007282  8204 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.019480  7675 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.030156  7751 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.048570  7827 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:58:33.072440  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7211edc2aa9543b3996e3279fffe4edc. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:33.076989  7745 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:33.081868  7574 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.084331  7675 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:33.090358  8418 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:33.093797  8333 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260501 13:58:33.130366  8333 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.142063  7745 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.149428  7675 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.189642  7574 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.269693  7673 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:33.297901  7827 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:33.298652  7750 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:33.300926  8431 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:33.301826  8313 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:33.312393  7643 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a337f1f80f84ec1b4f2ed376a8436ea. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:33.323398  8431 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.326262  7827 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.343789  7750 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.347008  7678 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:33.363268  7576 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.384542  7827 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:33.385006  7643 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1551821b4ac3438ea79dc8c95256cfde. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:33.384498  7750 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:33.387226  8431 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:33.389597  8431 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:33.401896  8313 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.404789  7827 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.405475  7750 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.428347  7576 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:33.523041  8439 ts_tablet_manager.cc:933] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:33.526173  8439 tablet_copy_client.cc:323] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:33.619773  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 7211edc2aa9543b3996e3279fffe4edc from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:33.620544  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 7211edc2aa9543b3996e3279fffe4edc from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-7211edc2aa9543b3996e3279fffe4edc
I20260501 13:58:33.629968  7838 tablet_copy_source_session.cc:215] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:33.636833  8439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7211edc2aa9543b3996e3279fffe4edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:33.637478  8443 ts_tablet_manager.cc:933] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:33.647097  8443 tablet_copy_client.cc:323] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:33.649034  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 91eb60ac1c7a48a0b3662ef7e5327f66 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:33.649658  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 91eb60ac1c7a48a0b3662ef7e5327f66 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-91eb60ac1c7a48a0b3662ef7e5327f66
I20260501 13:58:33.658831  7838 tablet_copy_source_session.cc:215] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:33.660118  8439 tablet_copy_client.cc:806] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:33.660923  8439 tablet_copy_client.cc:670] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:33.664356  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eb60ac1c7a48a0b3662ef7e5327f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:33.669458  8439 tablet_copy_client.cc:538] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:33.692706  8439 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:33.693308  8443 tablet_copy_client.cc:806] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:33.696111  8443 tablet_copy_client.cc:670] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:33.701609  8443 tablet_copy_client.cc:538] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:33.729571  8443 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:33.768808  8406 heartbeater.cc:499] Master 127.6.77.190:38503 was elected leader, sending a full tablet report...
I20260501 13:58:33.779424  8443 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:33.784893  8443 tablet_bootstrap.cc:492] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:33.785756  8443 ts_tablet_manager.cc:1403] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.006s
I20260501 13:58:33.848896  8448 ts_tablet_manager.cc:933] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:33.854851  8448 tablet_copy_client.cc:323] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:33.868824  8443 raft_consensus.cc:359] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:33.874716  8445 ts_tablet_manager.cc:933] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:33.869911  8443 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:33.877153  8443 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:33.894735  8439 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:33.897503  8439 tablet_bootstrap.cc:492] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:33.898265  8439 ts_tablet_manager.cc:1403] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.206s	user 0.032s	sys 0.047s
I20260501 13:58:33.906488  7689 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet 0a337f1f80f84ec1b4f2ed376a8436ea from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:33.907140  7689 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet 0a337f1f80f84ec1b4f2ed376a8436ea from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-0a337f1f80f84ec1b4f2ed376a8436ea
I20260501 13:58:33.895933  8445 tablet_copy_client.cc:323] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:33.907392  8439 raft_consensus.cc:359] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:33.911109  8439 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:33.912073  8439 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:33.914563  7688 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet 1551821b4ac3438ea79dc8c95256cfde from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:33.915179  7688 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet 1551821b4ac3438ea79dc8c95256cfde from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-1551821b4ac3438ea79dc8c95256cfde
I20260501 13:58:33.916697  8439 ts_tablet_manager.cc:1434] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260501 13:58:33.919737  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-7211edc2aa9543b3996e3279fffe4edc received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:33.920298  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-7211edc2aa9543b3996e3279fffe4edc on tablet 7211edc2aa9543b3996e3279fffe4edc with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:33.920755  7689 tablet_copy_source_session.cc:215] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:33.924144  8443 ts_tablet_manager.cc:1434] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.138s	user 0.020s	sys 0.009s
I20260501 13:58:33.924618  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a337f1f80f84ec1b4f2ed376a8436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:33.927289  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-91eb60ac1c7a48a0b3662ef7e5327f66 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:33.927708  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-91eb60ac1c7a48a0b3662ef7e5327f66 on tablet 91eb60ac1c7a48a0b3662ef7e5327f66 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:33.936432  7688 tablet_copy_source_session.cc:215] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:33.940619  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1551821b4ac3438ea79dc8c95256cfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:33.945444  8448 tablet_copy_client.cc:806] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:33.946134  8448 tablet_copy_client.cc:670] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:33.950502  8448 tablet_copy_client.cc:538] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:33.955885  8381 raft_consensus.cc:1217] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:33.971807  8448 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:33.992069  8445 tablet_copy_client.cc:806] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:33.993242  8445 tablet_copy_client.cc:670] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:34.003530  8448 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:34.004726  8448 tablet_bootstrap.cc:492] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:34.005482  8448 ts_tablet_manager.cc:1403] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.012s
I20260501 13:58:34.007894  8445 tablet_copy_client.cc:538] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:34.008670  8448 raft_consensus.cc:359] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:34.009771  8448 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:34.011328  8448 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:34.020514  8448 ts_tablet_manager.cc:1434] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260501 13:58:34.030097  7688 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-0a337f1f80f84ec1b4f2ed376a8436ea received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:34.030664  7688 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-0a337f1f80f84ec1b4f2ed376a8436ea on tablet 0a337f1f80f84ec1b4f2ed376a8436ea with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:34.039618  8445 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:34.078595  8445 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:34.079799  8445 tablet_bootstrap.cc:492] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:34.080655  8445 ts_tablet_manager.cc:1403] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.021s
I20260501 13:58:34.085402  8445 raft_consensus.cc:359] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:34.091286  8445 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:34.092404  8445 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:34.098021  8445 ts_tablet_manager.cc:1434] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260501 13:58:34.101794  7688 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-1551821b4ac3438ea79dc8c95256cfde received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:34.102295  7688 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-1551821b4ac3438ea79dc8c95256cfde on tablet 1551821b4ac3438ea79dc8c95256cfde with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:34.165889  8381 raft_consensus.cc:1217] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:34.189185  8381 raft_consensus.cc:1217] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:34.263681  8381 raft_consensus.cc:1217] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:34.542749  8423 raft_consensus.cc:1064] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:34.545750  8423 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:34.561666  7750 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.564817  8381 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.568645  7678 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.572042  8424 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:34.573086  8333 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:34.576655  8418 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:34.605497  8418 raft_consensus.cc:1064] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:34.605347  8424 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.608333  8418 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:34.625712  8381 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.628089  7745 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.632907  8381 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.642308  7574 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:34.647581  7676 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.664430  8423 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:34.670245  7678 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.673802  8378 raft_consensus.cc:1064] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:34.676429  8424 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:34.676798  8378 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:34.697885  7750 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.712091  8333 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260501 13:58:34.775120  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44019.7us
I20260501 13:58:34.797662  8381 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260501 13:58:34.809788  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 68820us
I20260501 13:58:34.825690  8378 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:34.829013  7750 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.830621  8473 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:34.838603  8378 raft_consensus.cc:1064] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:34.842196  8378 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:58:34.876185  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60096.8us
I20260501 13:58:34.880926  7827 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.919739  8313 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:34.935469  8467 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.950845  8465 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.965164  7678 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.965561  8381 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.969733  7750 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:34.986446  8380 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:34.990869  7825 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:35.004384  7825 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.011559  8470 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260501 13:58:35.015463  8378 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:35.028002  7750 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:35.036120  8313 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:35.048215  8379 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.052815  7752 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.081141  7825 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:35.093840  7576 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.098280  7678 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.097749  8379 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.101361  8418 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.105700  8424 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.106230  7575 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.152355  7672 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:35.159864  8381 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.158593  8419 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.163779  7752 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.163741  8470 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.165813  8313 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.166261  7672 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.173964  8470 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.186151  7752 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.188954  8381 raft_consensus.cc:2955] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.191100  8465 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.199048  8379 raft_consensus.cc:2955] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.197726  7828 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.211736  7577 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.210855  8380 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.230647  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 7211edc2aa9543b3996e3279fffe4edc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:35.231455  7575 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.241358  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 0a337f1f80f84ec1b4f2ed376a8436ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:35.253001  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 7211edc2aa9543b3996e3279fffe4edc with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:35.273937  7750 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.283131  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a337f1f80f84ec1b4f2ed376a8436ea with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:35.317916  7827 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:35.329005  8379 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.330590  8333 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.332864  7753 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.329124  7574 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.338716  8333 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:35.379518  7673 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:35.382536  8492 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:35.396286  8492 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:35.398854  8492 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:35.397789  8379 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.397897  7752 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:35.388917  8491 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:35.401769  8491 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:35.402539  8491 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:35.404920  8313 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.407244  8419 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.413199  8491 ts_tablet_manager.cc:1916] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:35.415884  8470 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:35.418990  7752 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.420743  8492 ts_tablet_manager.cc:1916] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:35.430295  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 91eb60ac1c7a48a0b3662ef7e5327f66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:35.439468  7574 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.441771  8379 raft_consensus.cc:2955] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.461874  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet 91eb60ac1c7a48a0b3662ef7e5327f66 with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:35.476975  8493 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:35.478468  8493 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:35.479422  8493 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:35.483072  8493 ts_tablet_manager.cc:1916] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:35.494822  8492 ts_tablet_manager.cc:1929] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:35.494002  8470 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.495390  8492 log.cc:1199] T 0a337f1f80f84ec1b4f2ed376a8436ea P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/0a337f1f80f84ec1b4f2ed376a8436ea
I20260501 13:58:35.497241  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 0a337f1f80f84ec1b4f2ed376a8436ea (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:35.513410  8493 ts_tablet_manager.cc:1929] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:35.514101  8493 log.cc:1199] T 91eb60ac1c7a48a0b3662ef7e5327f66 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/91eb60ac1c7a48a0b3662ef7e5327f66
I20260501 13:58:35.518132  8379 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.510982  7752 raft_consensus.cc:2955] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:35.524485  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 1551821b4ac3438ea79dc8c95256cfde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:35.526229  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet 91eb60ac1c7a48a0b3662ef7e5327f66 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:35.535189  8491 ts_tablet_manager.cc:1929] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:35.531600  7574 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:35.555866  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 1551821b4ac3438ea79dc8c95256cfde with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:35.557148  8492 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:35.557921  8491 log.cc:1199] T 7211edc2aa9543b3996e3279fffe4edc P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/7211edc2aa9543b3996e3279fffe4edc
I20260501 13:58:35.558110  8492 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:35.558933  8492 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:35.560153  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 7211edc2aa9543b3996e3279fffe4edc (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:35.563030  8492 ts_tablet_manager.cc:1916] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:35.592986  8492 ts_tablet_manager.cc:1929] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:35.593369  8492 log.cc:1199] T 1551821b4ac3438ea79dc8c95256cfde P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/1551821b4ac3438ea79dc8c95256cfde
I20260501 13:58:35.595062  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 1551821b4ac3438ea79dc8c95256cfde (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:36.653797  7828 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:36.667061  7753 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:36.667655  7678 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:36.668264  7792 consensus_peers.cc:597] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26c659157efb4e3ba3d97b7ad9d62068. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:36.669552  8497 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:36.670665  8483 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:36.680073  8483 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.683013  7753 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.710881  7678 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.718674  7574 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:36.726121  7828 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:36.756410  7753 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:36.756673  7792 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ab3422d02d5408caed8cf6c79922e21. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:36.758543  8497 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:36.760026  7678 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:36.761475  8497 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:36.815788  8483 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.821533  7752 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.826730  7673 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.848181  7575 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.905629  7752 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:36.933143  7828 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:36.933694  7676 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:36.935021  8510 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:36.936311  8471 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:36.955323  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3031b746c62f413a9da6fed211d638da. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:36.972625  8471 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.975548  7678 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:36.977622  7828 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:37.000837  7574 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:37.004848  7828 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:58:37.044322  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 539945233a6f4f6589f58e774245669e. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:37.047019  7753 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:37.048712  8467 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:37.049021  7678 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:37.050451  8483 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:37.082628  8467 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:37.085801  7752 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:37.100524  7678 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:37.119436  7575 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:37.292407  8521 ts_tablet_manager.cc:933] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:37.320708  8521 tablet_copy_client.cc:323] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:37.323096  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 26c659157efb4e3ba3d97b7ad9d62068 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:37.323761  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 26c659157efb4e3ba3d97b7ad9d62068 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-26c659157efb4e3ba3d97b7ad9d62068
I20260501 13:58:37.333801  7838 tablet_copy_source_session.cc:215] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:37.339701  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c659157efb4e3ba3d97b7ad9d62068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:37.348604  8523 ts_tablet_manager.cc:933] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:37.361399  8523 tablet_copy_client.cc:323] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:37.363323  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 0ab3422d02d5408caed8cf6c79922e21 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:37.363914  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 0ab3422d02d5408caed8cf6c79922e21 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-0ab3422d02d5408caed8cf6c79922e21
I20260501 13:58:37.373593  7838 tablet_copy_source_session.cc:215] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:37.377173  8523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3422d02d5408caed8cf6c79922e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:37.396353  8521 tablet_copy_client.cc:806] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:37.397264  8521 tablet_copy_client.cc:670] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:37.402947  8521 tablet_copy_client.cc:538] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:37.418649  8523 tablet_copy_client.cc:806] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:37.419685  8523 tablet_copy_client.cc:670] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:37.424232  8523 tablet_copy_client.cc:538] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:37.430835  8521 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:37.436023  8523 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:37.511626  8523 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:37.514420  8523 tablet_bootstrap.cc:492] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:37.516065  8523 ts_tablet_manager.cc:1403] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.080s	user 0.035s	sys 0.028s
I20260501 13:58:37.520428  8523 raft_consensus.cc:359] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.521572  8523 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:37.523747  8523 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.547947  8523 ts_tablet_manager.cc:1434] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.011s
I20260501 13:58:37.548633  8526 ts_tablet_manager.cc:933] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:37.552768  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-0ab3422d02d5408caed8cf6c79922e21 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:37.552970  8526 tablet_copy_client.cc:323] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 13:58:37.553332  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-0ab3422d02d5408caed8cf6c79922e21 on tablet 0ab3422d02d5408caed8cf6c79922e21 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:37.581717  8521 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:37.582958  8521 tablet_bootstrap.cc:492] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:37.583781  8521 ts_tablet_manager.cc:1403] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.153s	user 0.028s	sys 0.005s
I20260501 13:58:37.595839  8521 raft_consensus.cc:359] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.606403  8523 ts_tablet_manager.cc:933] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:37.609616  8523 tablet_copy_client.cc:323] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:37.610976  8521 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:37.615057  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 539945233a6f4f6589f58e774245669e from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:37.615669  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 539945233a6f4f6589f58e774245669e from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-539945233a6f4f6589f58e774245669e
I20260501 13:58:37.616377  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 3031b746c62f413a9da6fed211d638da from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 13:58:37.616993  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 3031b746c62f413a9da6fed211d638da from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-3031b746c62f413a9da6fed211d638da
I20260501 13:58:37.626662  7764 tablet_copy_source_session.cc:215] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:37.630414  7838 tablet_copy_source_session.cc:215] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:37.634456  8523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539945233a6f4f6589f58e774245669e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:37.635118  8526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3031b746c62f413a9da6fed211d638da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:37.615087  8521 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.642657  8521 ts_tablet_manager.cc:1434] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260501 13:58:37.644659  7837 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-26c659157efb4e3ba3d97b7ad9d62068 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:37.645166  7837 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-26c659157efb4e3ba3d97b7ad9d62068 on tablet 26c659157efb4e3ba3d97b7ad9d62068 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:37.664731  8523 tablet_copy_client.cc:806] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:37.665518  8523 tablet_copy_client.cc:670] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:37.666579  8526 tablet_copy_client.cc:806] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:37.667251  8526 tablet_copy_client.cc:670] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:37.669703  8523 tablet_copy_client.cc:538] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:37.677618  8526 tablet_copy_client.cc:538] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:37.681670  8523 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:37.715607  8523 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:37.716861  8523 tablet_bootstrap.cc:492] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:37.717684  8523 ts_tablet_manager.cc:1403] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.015s
I20260501 13:58:37.717890  8380 raft_consensus.cc:1217] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:37.721598  8526 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:37.721195  8523 raft_consensus.cc:359] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.722294  8523 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:37.723088  8523 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.730410  8523 ts_tablet_manager.cc:1434] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260501 13:58:37.732666  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-539945233a6f4f6589f58e774245669e received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:37.733193  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-539945233a6f4f6589f58e774245669e on tablet 539945233a6f4f6589f58e774245669e with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:37.747571  8380 raft_consensus.cc:1217] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:37.792833  8526 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:37.793850  8526 tablet_bootstrap.cc:492] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:37.794728  8526 ts_tablet_manager.cc:1403] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.014s
I20260501 13:58:37.797614  8526 raft_consensus.cc:359] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.798444  8526 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:37.799103  8526 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:37.803797  8526 ts_tablet_manager.cc:1434] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260501 13:58:37.805516  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-3031b746c62f413a9da6fed211d638da received from {username='slave'} at 127.0.0.1:42716
I20260501 13:58:37.806027  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-3031b746c62f413a9da6fed211d638da on tablet 3031b746c62f413a9da6fed211d638da with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:37.892608  8380 raft_consensus.cc:1217] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260501 13:58:38.019546  8380 raft_consensus.cc:1217] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:38.141958  8519 raft_consensus.cc:1064] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:38.145416  8519 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.158619  8380 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.160267  8483 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:38.165627  7747 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.166124  7676 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.167620  8467 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:38.169858  8467 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:38.184228  8467 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.187953  7676 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.208400  7577 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.218957  8483 raft_consensus.cc:1064] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:38.226935  8380 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.224713  8483 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.254874  7752 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.302006  7824 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.305194  7753 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.311981  8519 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260501 13:58:38.312201  7678 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.319224  7753 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:38.319340  8379 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:38.323185  8380 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.330420  8467 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:38.332185  8543 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:38.358295  8543 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:38.358330  8467 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:38.362828  8467 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.377543  8542 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.381539  7752 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.386198  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 26c659157efb4e3ba3d97b7ad9d62068 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:38.399626  7676 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.399078  7575 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:38.409258  8379 raft_consensus.cc:2955] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.410857  7747 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.424485  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet 26c659157efb4e3ba3d97b7ad9d62068 with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:38.448112  7574 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.454453  8542 raft_consensus.cc:1064] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:38.455027  8471 raft_consensus.cc:1064] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:38.457201  8542 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.458200  8471 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.469223  8380 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.472110  7752 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.473919  8520 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:38.471951  8379 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.451570  8552 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:38.480283  8552 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:38.482299  8549 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:38.486840  7678 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:38.490952  8467 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:38.493683  8377 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:38.495270  8552 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:38.495206  8510 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:38.509810  8552 ts_tablet_manager.cc:1916] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:38.534190  8552 ts_tablet_manager.cc:1929] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:38.535573  8552 log.cc:1199] T 26c659157efb4e3ba3d97b7ad9d62068 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/26c659157efb4e3ba3d97b7ad9d62068
I20260501 13:58:38.537438  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet 26c659157efb4e3ba3d97b7ad9d62068 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:38.539288  7824 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.562695  8542 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.565093  7827 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:38.567807  8553 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:38.573558  7673 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:38.581030  8556 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.586061  8377 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.589035  7752 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.601060  8380 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:38.604060  8467 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:38.611927  8467 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.613029  7577 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:38.613638  8380 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.621176  7824 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.623219  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 0ab3422d02d5408caed8cf6c79922e21 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260501 13:58:38.624953  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50565.4us
I20260501 13:58:38.642871  7828 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:38.643357  8543 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:38.650687  7745 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:38.652082  7678 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:38.652810  8377 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:38.654970  8483 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:38.655646  8543 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:38.661653  7676 raft_consensus.cc:2955] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.662456  8380 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.659433  7575 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.675225  8471 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:38.670164  7745 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.688784  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ab3422d02d5408caed8cf6c79922e21 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:38.692008  8566 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:38.693238  8566 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:38.666821  8467 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.694157  8566 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:38.690846  7573 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:38.698593  8380 raft_consensus.cc:2955] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.709569  8566 ts_tablet_manager.cc:1916] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:38.724826  7573 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.728381  7672 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:38.734900  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 539945233a6f4f6589f58e774245669e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:38.740836  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet 539945233a6f4f6589f58e774245669e with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:38.741843  8552 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:38.742901  8552 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:38.743561  8552 pending_rounds.cc:70] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 13:58:38.743876  8552 pending_rounds.cc:77] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7281229489994227712 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "539945233a6f4f6589f58e774245669e" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } } }
I20260501 13:58:38.746323  8552 raft_consensus.cc:2917] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260501 13:58:38.746742  8552 raft_consensus.cc:2889] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260501 13:58:38.748404  8566 ts_tablet_manager.cc:1929] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:38.748945  8566 log.cc:1199] T 0ab3422d02d5408caed8cf6c79922e21 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/0ab3422d02d5408caed8cf6c79922e21
I20260501 13:58:38.750707  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 0ab3422d02d5408caed8cf6c79922e21 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:38.751462  8552 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:38.758458  8552 ts_tablet_manager.cc:1916] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:38.779011  8552 ts_tablet_manager.cc:1929] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:38.779502  8552 log.cc:1199] T 539945233a6f4f6589f58e774245669e P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/539945233a6f4f6589f58e774245669e
I20260501 13:58:38.781147  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet 539945233a6f4f6589f58e774245669e (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:39.143954  7753 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:39.148808  7676 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:39.148743  8380 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:39.150168  8567 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:39.151093  8553 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:39.169734  8553 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:39.171368  8380 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:39.175915  7676 raft_consensus.cc:2955] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:39.181128  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 3031b746c62f413a9da6fed211d638da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:39.192781  7574 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:39.204332  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 3031b746c62f413a9da6fed211d638da with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:39.206081  8568 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:39.207261  8568 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:39.208050  8568 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:39.210759  8568 ts_tablet_manager.cc:1916] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:39.225878  8568 ts_tablet_manager.cc:1929] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260501 13:58:39.226279  8568 log.cc:1199] T 3031b746c62f413a9da6fed211d638da P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/3031b746c62f413a9da6fed211d638da
I20260501 13:58:39.227795  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 3031b746c62f413a9da6fed211d638da (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:40.270406  7824 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.276257  7745 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:40.276259  7678 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:40.276727  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2caa4d7579144326a3f173b9182831e8. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:40.278113  8542 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.279135  8467 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.287698  8467 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.289423  7745 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.294001  7672 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.310197  7575 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.318427  7678 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.332063  7745 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260501 13:58:40.332315  7643 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef09d109d10447e796ab96c9a6eddef0. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:40.333556  8569 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.333781  7827 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:40.340072  8569 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.347787  8564 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.351980  7747 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.353307  7827 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.362522  7824 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.373687  7573 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:40.384649  7745 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:40.384990  7792 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ec67fee0d084477a66b6f72a7e73330. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:40.386435  8575 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.386446  7678 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:40.389536  8574 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.401788  8520 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.403924  7672 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.403522  7747 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.418823  7824 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.422262  7574 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 13:58:40.432271  7792 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8489b3d6a1b74818947d84d7c795a5fb. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:40.433310  7672 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:40.433436  7747 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:40.435359  8467 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.436721  8520 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:40.449803  8520 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.461243  7747 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.467130  7672 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:40.478029  7575 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:40.663105  8589 ts_tablet_manager.cc:933] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:40.665410  8589 tablet_copy_client.cc:323] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:40.667032  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 2caa4d7579144326a3f173b9182831e8 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:40.667593  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 2caa4d7579144326a3f173b9182831e8 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-2caa4d7579144326a3f173b9182831e8
I20260501 13:58:40.675544  7838 tablet_copy_source_session.cc:215] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:40.678743  8589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2caa4d7579144326a3f173b9182831e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:40.696871  8589 tablet_copy_client.cc:806] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:40.697489  8589 tablet_copy_client.cc:670] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:40.701195  8589 tablet_copy_client.cc:538] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:40.710086  8589 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:40.732648  8589 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:40.733929  8589 tablet_bootstrap.cc:492] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:40.734855  8589 ts_tablet_manager.cc:1403] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260501 13:58:40.738163  8589 raft_consensus.cc:359] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.739338  8589 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:40.740142  8589 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.756605  8589 ts_tablet_manager.cc:1434] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.008s
I20260501 13:58:40.760370  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-2caa4d7579144326a3f173b9182831e8 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:40.760912  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-2caa4d7579144326a3f173b9182831e8 on tablet 2caa4d7579144326a3f173b9182831e8 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:40.826097  8589 ts_tablet_manager.cc:933] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:40.827936  8589 tablet_copy_client.cc:323] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:40.829559  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 5ec67fee0d084477a66b6f72a7e73330 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:40.830163  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 5ec67fee0d084477a66b6f72a7e73330 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-5ec67fee0d084477a66b6f72a7e73330
I20260501 13:58:40.837432  7838 tablet_copy_source_session.cc:215] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:40.838980  8594 ts_tablet_manager.cc:933] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:40.841022  8589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec67fee0d084477a66b6f72a7e73330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:40.841719  8594 tablet_copy_client.cc:323] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:40.845424  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 8489b3d6a1b74818947d84d7c795a5fb from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:40.845994  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 8489b3d6a1b74818947d84d7c795a5fb from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-8489b3d6a1b74818947d84d7c795a5fb
I20260501 13:58:40.853897  7838 tablet_copy_source_session.cc:215] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:40.857028  8594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8489b3d6a1b74818947d84d7c795a5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:40.859844  8589 tablet_copy_client.cc:806] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:40.860966  8589 tablet_copy_client.cc:670] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:40.868366  8589 tablet_copy_client.cc:538] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:40.879004  8594 tablet_copy_client.cc:806] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:40.880687  8594 tablet_copy_client.cc:670] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:40.881188  8596 ts_tablet_manager.cc:933] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:40.883248  8589 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:40.885169  8594 tablet_copy_client.cc:538] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:40.898729  8596 tablet_copy_client.cc:323] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:40.902467  7688 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet ef09d109d10447e796ab96c9a6eddef0 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:40.903056  7688 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet ef09d109d10447e796ab96c9a6eddef0 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-ef09d109d10447e796ab96c9a6eddef0
I20260501 13:58:40.907800  8594 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:40.911497  7688 tablet_copy_source_session.cc:215] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:40.917927  8596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef09d109d10447e796ab96c9a6eddef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:40.918470  8589 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:40.919504  8589 tablet_bootstrap.cc:492] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:40.920341  8589 ts_tablet_manager.cc:1403] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.000s
I20260501 13:58:40.926035  8589 raft_consensus.cc:359] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.927290  8589 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:40.928457  8589 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.935144  8596 tablet_copy_client.cc:806] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:40.935854  8596 tablet_copy_client.cc:670] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:40.937582  8589 ts_tablet_manager.cc:1434] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260501 13:58:40.939451  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-5ec67fee0d084477a66b6f72a7e73330 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:40.939913  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-5ec67fee0d084477a66b6f72a7e73330 on tablet 5ec67fee0d084477a66b6f72a7e73330 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:40.952060  8596 tablet_copy_client.cc:538] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:40.968087  8596 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:40.971431  8594 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:40.972572  8594 tablet_bootstrap.cc:492] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:40.973412  8594 ts_tablet_manager.cc:1403] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.066s	user 0.031s	sys 0.022s
I20260501 13:58:40.976661  8594 raft_consensus.cc:359] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.977509  8594 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:40.978120  8594 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.980398  8594 ts_tablet_manager.cc:1434] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260501 13:58:40.982856  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-8489b3d6a1b74818947d84d7c795a5fb received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:40.983300  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-8489b3d6a1b74818947d84d7c795a5fb on tablet 8489b3d6a1b74818947d84d7c795a5fb with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:40.993563  8596 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:40.994611  8596 tablet_bootstrap.cc:492] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:40.995368  8596 ts_tablet_manager.cc:1403] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260501 13:58:40.998628  8596 raft_consensus.cc:359] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:40.999472  8596 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:41.000167  8596 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:41.006521  8596 ts_tablet_manager.cc:1434] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260501 13:58:41.009153  7688 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-ef09d109d10447e796ab96c9a6eddef0 received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:41.009666  7688 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-ef09d109d10447e796ab96c9a6eddef0 on tablet ef09d109d10447e796ab96c9a6eddef0 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:41.061228  8380 raft_consensus.cc:1217] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:41.281705  8380 raft_consensus.cc:1217] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260501 13:58:41.328562  8380 raft_consensus.cc:1217] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:41.351699  8380 raft_consensus.cc:1217] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:41.551756  8600 raft_consensus.cc:1064] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:41.554411  8600 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:41.560940  8380 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.561455  7752 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.562731  8600 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.563225  7676 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.563709  8574 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.564766  8467 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.597467  8574 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.612213  7752 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.613401  7676 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.626535  8377 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.630847  7574 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:41.669602  7827 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:41.680758  7676 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:41.680806  8377 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:41.682428  8600 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:41.683595  8574 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:41.694769  8520 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.713812  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 2caa4d7579144326a3f173b9182831e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:41.707505  7672 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.726030  8377 raft_consensus.cc:2955] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.735049  7573 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:41.759478  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 2caa4d7579144326a3f173b9182831e8 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:41.761849  8613 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:41.762949  8613 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:41.763885  8613 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:41.767622  8613 ts_tablet_manager.cc:1916] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:41.785676  8613 ts_tablet_manager.cc:1929] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:41.786060  8613 log.cc:1199] T 2caa4d7579144326a3f173b9182831e8 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/2caa4d7579144326a3f173b9182831e8
I20260501 13:58:41.787968  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 2caa4d7579144326a3f173b9182831e8 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:41.841094  8600 raft_consensus.cc:1064] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:41.844161  8600 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:41.851063  8380 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.850972  7752 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.850972  7678 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.853013  8611 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.854122  8600 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.855032  8520 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.882539  8467 raft_consensus.cc:1064] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:41.885243  8467 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:41.894706  8612 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.901813  8377 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.934427  8380 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.937477  7752 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.939216  8467 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:41.940384  8574 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:41.947269  8569 raft_consensus.cc:1064] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:41.956550  7753 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.963907  7577 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.967994  8611 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.968912  8569 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:41.969913  8380 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.984347  7577 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:41.988134  7676 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:41.990986  7676 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.000790  7745 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.011121  8467 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:42.038520  7824 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:42.044651  8380 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:42.049695  8380 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:42.054301  8600 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:42.055531  7827 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:42.065106  7752 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:42.068090  8602 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:42.072811  7678 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:42.072984  8570 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:42.070757  8520 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.076342  8570 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:42.076689  8380 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.078099  8467 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:42.068058  7676 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.095448  7828 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:42.099721  7678 raft_consensus.cc:2955] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.103372  8379 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:42.105271  7752 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:42.105223  8600 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:42.110329  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 8489b3d6a1b74818947d84d7c795a5fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:42.108285  8600 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260501 13:58:42.120457  7577 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:42.126677  8611 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.146692  8380 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.151435  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 8489b3d6a1b74818947d84d7c795a5fb with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:42.154177  8569 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.156999  7750 raft_consensus.cc:2955] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.159919  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 5ec67fee0d084477a66b6f72a7e73330 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:42.155471  8613 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:42.161274  8613 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:42.162204  8613 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:42.166101  8613 ts_tablet_manager.cc:1916] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:42.172837  7575 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:42.178951  7747 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.203650  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ec67fee0d084477a66b6f72a7e73330 with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:42.203267  7574 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:42.214057  7827 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.216569  8630 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:42.219388  8613 ts_tablet_manager.cc:1929] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:42.220211  8613 log.cc:1199] T 8489b3d6a1b74818947d84d7c795a5fb P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/8489b3d6a1b74818947d84d7c795a5fb
I20260501 13:58:42.223714  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 8489b3d6a1b74818947d84d7c795a5fb (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:42.224570  8380 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.262356  7673 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:42.270273  8380 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:42.271673  8623 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:42.273108  7747 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:42.275954  8623 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:42.288105  8630 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:42.288938  8630 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:42.288407  8569 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.289733  7747 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.292975  8630 ts_tablet_manager.cc:1916] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:42.297374  8380 raft_consensus.cc:2955] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.302367  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet ef09d109d10447e796ab96c9a6eddef0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:42.311879  7576 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:42.317668  8630 ts_tablet_manager.cc:1929] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:42.318279  8630 log.cc:1199] T 5ec67fee0d084477a66b6f72a7e73330 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/5ec67fee0d084477a66b6f72a7e73330
I20260501 13:58:42.345582  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet ef09d109d10447e796ab96c9a6eddef0 with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:42.353531  8631 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:42.353653  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet 5ec67fee0d084477a66b6f72a7e73330 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:42.354780  8631 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:42.355685  8631 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:42.360760  8631 ts_tablet_manager.cc:1916] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:42.374329  8631 ts_tablet_manager.cc:1929] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260501 13:58:42.374694  8631 log.cc:1199] T ef09d109d10447e796ab96c9a6eddef0 P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/ef09d109d10447e796ab96c9a6eddef0
I20260501 13:58:42.376154  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet ef09d109d10447e796ab96c9a6eddef0 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:43.381373  7828 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:58:43.389775  7792 consensus_peers.cc:597] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d76c50227fdf4363bff9df76fdb05b2f. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:43.390169  7750 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.391507  8520 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:43.392383  7675 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.395015  8520 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:43.400906  8611 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.402894  7750 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.422864  7675 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.422914  7574 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.432143  7679 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:43.440138  7828 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.440241  7750 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.441582  8569 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:43.443451  8569 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:43.444952  7643 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9a0dc7ba0d34f5c9d9eb78874fd40bc. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:43.481560  7828 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.482326  8622 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.483040  7750 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.506188  7675 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:43.509647  7576 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 13:58:43.523933  7643 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75d27004f21449f5bfdade4d62aeba88. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:43.523964  7828 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.524242  7750 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.525790  8622 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:43.526925  8640 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:43.541299  8622 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.543011  7828 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.545964  7750 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.559924  7828 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:43.563719  7577 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260501 13:58:43.571231  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b217e36f6e5e4fc38ba6e4ad89082fc6. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:43.574316  7675 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.575958  8611 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:43.576522  7747 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:43.592018  8611 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:43.598291  8636 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.600133  7679 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.621513  7574 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:43.671095  7750 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:43.828759  8651 ts_tablet_manager.cc:933] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:43.830797  8651 tablet_copy_client.cc:323] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:43.832360  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet d76c50227fdf4363bff9df76fdb05b2f from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:43.832864  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet d76c50227fdf4363bff9df76fdb05b2f from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-d76c50227fdf4363bff9df76fdb05b2f
I20260501 13:58:43.841051  7838 tablet_copy_source_session.cc:215] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:43.844911  8651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76c50227fdf4363bff9df76fdb05b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:43.861747  8651 tablet_copy_client.cc:806] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:43.862353  8651 tablet_copy_client.cc:670] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:43.871335  8651 tablet_copy_client.cc:538] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:43.882438  8651 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:43.903257  8651 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:43.904223  8651 tablet_bootstrap.cc:492] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:43.905046  8651 ts_tablet_manager.cc:1403] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.004s
I20260501 13:58:43.907938  8651 raft_consensus.cc:359] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:43.908682  8651 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:43.909417  8651 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:43.918308  8651 ts_tablet_manager.cc:1434] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260501 13:58:43.928614  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-d76c50227fdf4363bff9df76fdb05b2f received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:43.929109  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-d76c50227fdf4363bff9df76fdb05b2f on tablet d76c50227fdf4363bff9df76fdb05b2f with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:43.952280  8651 ts_tablet_manager.cc:933] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:43.959803  8651 tablet_copy_client.cc:323] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:43.961390  7688 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet 75d27004f21449f5bfdade4d62aeba88 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:43.961967  7688 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet 75d27004f21449f5bfdade4d62aeba88 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-75d27004f21449f5bfdade4d62aeba88
I20260501 13:58:43.969769  7688 tablet_copy_source_session.cc:215] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:43.973093  8651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d27004f21449f5bfdade4d62aeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:44.001183  8651 tablet_copy_client.cc:806] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:44.001847  8651 tablet_copy_client.cc:670] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:44.005332  8651 tablet_copy_client.cc:538] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:44.013912  8651 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:44.037106  8651 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:44.038103  8651 tablet_bootstrap.cc:492] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:44.038861  8651 ts_tablet_manager.cc:1403] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260501 13:58:44.041709  8651 raft_consensus.cc:359] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:44.042532  8651 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:44.043267  8651 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:44.052065  8658 ts_tablet_manager.cc:933] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:44.053622  8651 ts_tablet_manager.cc:1434] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260501 13:58:44.054530  8658 tablet_copy_client.cc:323] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:44.056274  7688 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:44.056816  7688 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-b9a0dc7ba0d34f5c9d9eb78874fd40bc
I20260501 13:58:44.064628  7688 tablet_copy_source_session.cc:215] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:44.067764  8658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:44.069358  7688 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-75d27004f21449f5bfdade4d62aeba88 received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:44.069943  7688 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-75d27004f21449f5bfdade4d62aeba88 on tablet 75d27004f21449f5bfdade4d62aeba88 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:44.083153  8658 tablet_copy_client.cc:806] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:44.083876  8658 tablet_copy_client.cc:670] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:44.087981  8658 tablet_copy_client.cc:538] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:44.097678  8658 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:44.120934  8658 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:44.122115  8658 tablet_bootstrap.cc:492] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:44.122846  8658 ts_tablet_manager.cc:1403] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.001s
I20260501 13:58:44.126642  8658 raft_consensus.cc:359] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:44.127511  8658 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:44.128261  8658 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:44.141466  8658 ts_tablet_manager.cc:1434] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260501 13:58:44.145298  7688 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-b9a0dc7ba0d34f5c9d9eb78874fd40bc received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:44.145815  7688 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-b9a0dc7ba0d34f5c9d9eb78874fd40bc on tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:44.193799  8658 ts_tablet_manager.cc:933] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:44.196305  8658 tablet_copy_client.cc:323] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:44.198129  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet b217e36f6e5e4fc38ba6e4ad89082fc6 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:44.198700  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet b217e36f6e5e4fc38ba6e4ad89082fc6 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-b217e36f6e5e4fc38ba6e4ad89082fc6
I20260501 13:58:44.207139  7838 tablet_copy_source_session.cc:215] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:44.210354  8658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b217e36f6e5e4fc38ba6e4ad89082fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:44.282145  8658 tablet_copy_client.cc:806] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:44.282920  8658 tablet_copy_client.cc:670] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:44.287253  8658 tablet_copy_client.cc:538] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:44.287518  8380 raft_consensus.cc:1217] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:44.301116  8658 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:44.322120  8658 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:44.323330  8658 tablet_bootstrap.cc:492] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:44.324079  8658 ts_tablet_manager.cc:1403] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.015s
I20260501 13:58:44.326748  8658 raft_consensus.cc:359] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:44.327414  8658 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:44.328037  8658 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:44.330303  8658 ts_tablet_manager.cc:1434] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260501 13:58:44.333335  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-b217e36f6e5e4fc38ba6e4ad89082fc6 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:44.333771  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-b217e36f6e5e4fc38ba6e4ad89082fc6 on tablet b217e36f6e5e4fc38ba6e4ad89082fc6 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:44.342378  8380 raft_consensus.cc:1217] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:44.596199  8380 raft_consensus.cc:1217] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:44.637948  8380 raft_consensus.cc:1217] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:44.778474  8611 raft_consensus.cc:1064] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:44.782095  8611 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:44.800207  8380 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:44.800257  7752 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:44.802330  7675 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:44.804929  8636 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:44.807375  8663 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:44.808403  8636 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:44.834841  8574 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.836491  7675 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.841671  8380 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.860285  7576 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.866431  7750 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.895890  8640 raft_consensus.cc:1064] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:44.898780  8640 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:44.900753  7827 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:44.906117  8380 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:44.907553  7828 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:44.908533  7750 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:44.908447  8622 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:44.909888  8569 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:44.910604  8622 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:44.917228  8377 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:44.919234  8669 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:44.925268  7752 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:44.927565  8669 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:44.934948  8569 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.937242  8611 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.944557  7828 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.951524  8377 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.967518  7752 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.972960  7573 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.981846  7750 raft_consensus.cc:2955] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:44.998010  7576 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.010483  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet d76c50227fdf4363bff9df76fdb05b2f with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:45.010851  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet d76c50227fdf4363bff9df76fdb05b2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:45.025676  8640 raft_consensus.cc:1064] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:45.028787  8640 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:45.041649  8678 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:45.043102  8678 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:45.045990  8678 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:45.050483  8678 ts_tablet_manager.cc:1916] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:45.056924  8611 raft_consensus.cc:1064] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:45.059923  8611 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:45.070716  8377 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:45.072964  7752 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:45.074354  7827 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:45.081239  8569 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:45.085384  8377 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.089051  8640 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:45.100077  8569 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:45.101722  8678 ts_tablet_manager.cc:1929] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:45.109504  8678 log.cc:1199] T d76c50227fdf4363bff9df76fdb05b2f P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/d76c50227fdf4363bff9df76fdb05b2f
I20260501 13:58:45.120302  7679 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:45.129035  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet d76c50227fdf4363bff9df76fdb05b2f (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:45.133982  8377 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:45.136637  8640 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:45.142076  8684 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.145052  7827 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:45.152410  8640 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:45.153203  7745 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.153381  8380 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.159125  8569 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.160768  8381 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:45.162617  8668 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:45.171864  7752 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:45.173466  8611 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:45.173349  8381 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.173408  7827 raft_consensus.cc:2955] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.177837  7676 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:45.182533  8611 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:45.182871  7576 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.196125  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 75d27004f21449f5bfdade4d62aeba88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:45.193800  8636 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.199630  7752 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.207243  7577 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:45.207533  8377 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.238770  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 75d27004f21449f5bfdade4d62aeba88 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:45.241508  7824 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.244678  7676 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.266805  8690 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:45.311708  8690 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:45.314476  8690 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:45.321398  8690 ts_tablet_manager.cc:1916] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:45.299755  7573 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:58:45.354648  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 63116.4us
I20260501 13:58:45.381636  8690 ts_tablet_manager.cc:1929] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:45.382381  8690 log.cc:1199] T 75d27004f21449f5bfdade4d62aeba88 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/75d27004f21449f5bfdade4d62aeba88
I20260501 13:58:45.384474  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 75d27004f21449f5bfdade4d62aeba88 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:45.393438  7828 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:45.401278  7676 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:45.415962  8377 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:45.419610  7676 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:45.420347  8377 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:45.420928  7745 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:45.421459  8692 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:45.422513  8688 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:45.424463  8640 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:45.426846  8692 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:45.431335  8574 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.433494  8381 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.433802  8684 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.438696  7745 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.442950  8380 raft_consensus.cc:2955] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.457790  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet b217e36f6e5e4fc38ba6e4ad89082fc6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:45.460284  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:45.468744  7676 raft_consensus.cc:2955] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.469635  7576 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.486300  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:45.489925  7574 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:45.504731  8693 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:45.505911  8693 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:45.506024  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet b217e36f6e5e4fc38ba6e4ad89082fc6 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:45.507408  8693 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:45.508318  8690 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:45.509425  8690 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:45.510311  8690 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:45.513652  8693 ts_tablet_manager.cc:1916] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:45.515056  8690 ts_tablet_manager.cc:1916] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:45.536999  8690 ts_tablet_manager.cc:1929] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:45.537052  8693 ts_tablet_manager.cc:1929] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:45.537616  8690 log.cc:1199] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/b217e36f6e5e4fc38ba6e4ad89082fc6
I20260501 13:58:45.537811  8693 log.cc:1199] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/b9a0dc7ba0d34f5c9d9eb78874fd40bc
I20260501 13:58:45.539162  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet b217e36f6e5e4fc38ba6e4ad89082fc6 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:45.539979  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet b9a0dc7ba0d34f5c9d9eb78874fd40bc (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:46.572773  7827 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:46.582130  7679 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:46.582459  7745 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:46.584196  7792 consensus_peers.cc:597] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c14b33d5ea8424cb04207b894010749. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:46.584818  8636 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:46.585853  8692 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:46.594775  8692 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.598694  7745 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.602206  7679 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.612267  7752 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:46.616583  7574 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:46.636199  7827 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:46.638659  7718 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b13ab5be933469ba7c57247efb0f8e9. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:46.640288  8703 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:46.641530  7676 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:46.642786  8703 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:46.650192  8701 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.655110  7827 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.665638  7676 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.671136  7824 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:46.683218  7752 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:46.684787  7676 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:46.685331  8636 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:46.686291  7792 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 789c720014934abe950ad611625f9bc9. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:46.687186  8574 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:46.707028  8636 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.709098  7576 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.713788  7752 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.724938  7827 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:46.724793  7676 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.740221  7676 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:46.740221  7745 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:46.741858  8574 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:46.742827  8711 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:46.744005  7792 consensus_peers.cc:597] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6dc2741afba411fbd7695217702cdda. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:46.753046  7573 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:46.768153  8711 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.772847  7679 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.774317  7752 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:46.795044  7573 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:47.131857  8716 ts_tablet_manager.cc:933] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:47.140501  8716 tablet_copy_client.cc:323] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:47.142944  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet c6dc2741afba411fbd7695217702cdda from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:47.143496  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet c6dc2741afba411fbd7695217702cdda from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-c6dc2741afba411fbd7695217702cdda
I20260501 13:58:47.150980  7838 tablet_copy_source_session.cc:215] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:47.154484  8716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6dc2741afba411fbd7695217702cdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:47.173686  8716 tablet_copy_client.cc:806] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:47.174433  8716 tablet_copy_client.cc:670] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:47.178740  8716 tablet_copy_client.cc:538] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:47.185837  8718 ts_tablet_manager.cc:933] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:47.188016  8716 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:47.188448  8718 tablet_copy_client.cc:323] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:47.190294  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 3c14b33d5ea8424cb04207b894010749 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:47.190840  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 3c14b33d5ea8424cb04207b894010749 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-3c14b33d5ea8424cb04207b894010749
I20260501 13:58:47.205892  8720 ts_tablet_manager.cc:933] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:47.222084  8716 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:47.223300  8716 tablet_bootstrap.cc:492] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:47.224131  8716 ts_tablet_manager.cc:1403] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.013s
I20260501 13:58:47.227577  8716 raft_consensus.cc:359] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.228622  8716 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:47.229372  8716 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.231333  8723 ts_tablet_manager.cc:933] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:47.229997  7838 tablet_copy_source_session.cc:215] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:47.255029  8720 tablet_copy_client.cc:323] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 13:58:47.255446  8718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c14b33d5ea8424cb04207b894010749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:47.255810  8723 tablet_copy_client.cc:323] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:47.260273  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 789c720014934abe950ad611625f9bc9 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:47.260812  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 789c720014934abe950ad611625f9bc9 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-789c720014934abe950ad611625f9bc9
I20260501 13:58:47.257896  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 4b13ab5be933469ba7c57247efb0f8e9 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 13:58:47.264195  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 4b13ab5be933469ba7c57247efb0f8e9 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-4b13ab5be933469ba7c57247efb0f8e9
I20260501 13:58:47.267455  8716 ts_tablet_manager.cc:1434] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.033s
I20260501 13:58:47.275995  7837 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-c6dc2741afba411fbd7695217702cdda received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:47.276556  7837 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-c6dc2741afba411fbd7695217702cdda on tablet c6dc2741afba411fbd7695217702cdda with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:47.286259  8718 tablet_copy_client.cc:806] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:47.284248  7764 tablet_copy_source_session.cc:215] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:47.286916  8718 tablet_copy_client.cc:670] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:47.290306  8720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b13ab5be933469ba7c57247efb0f8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:47.291973  7838 tablet_copy_source_session.cc:215] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:47.295348  8723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c720014934abe950ad611625f9bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:47.306016  8718 tablet_copy_client.cc:538] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:47.312616  8720 tablet_copy_client.cc:806] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:47.313676  8720 tablet_copy_client.cc:670] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:47.318452  8720 tablet_copy_client.cc:538] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:47.328897  8720 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:47.330964  8723 tablet_copy_client.cc:806] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:47.331519  8718 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:47.331643  8723 tablet_copy_client.cc:670] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:47.335354  8723 tablet_copy_client.cc:538] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:47.362180  8723 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:47.363266  8720 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:47.375046  8720 tablet_bootstrap.cc:492] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:47.376128  8720 ts_tablet_manager.cc:1403] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.025s
I20260501 13:58:47.382134  8720 raft_consensus.cc:359] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.383008  8720 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:47.383694  8720 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.388615  8718 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:47.389616  8718 tablet_bootstrap.cc:492] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:47.390339  8718 ts_tablet_manager.cc:1403] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.015s
I20260501 13:58:47.393422  8718 raft_consensus.cc:359] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.394513  8718 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:47.395174  8720 ts_tablet_manager.cc:1434] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.006s
I20260501 13:58:47.395232  8718 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.398790  8718 ts_tablet_manager.cc:1434] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260501 13:58:47.400404  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-3c14b33d5ea8424cb04207b894010749 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:47.400822  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-3c14b33d5ea8424cb04207b894010749 on tablet 3c14b33d5ea8424cb04207b894010749 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:47.405429  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-4b13ab5be933469ba7c57247efb0f8e9 received from {username='slave'} at 127.0.0.1:42716
I20260501 13:58:47.405860  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-4b13ab5be933469ba7c57247efb0f8e9 on tablet 4b13ab5be933469ba7c57247efb0f8e9 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:47.413998  8723 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:47.414954  8723 tablet_bootstrap.cc:492] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:47.415755  8723 ts_tablet_manager.cc:1403] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.013s
I20260501 13:58:47.418975  8723 raft_consensus.cc:359] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.419901  8723 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:47.420604  8723 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:47.423249  8723 ts_tablet_manager.cc:1434] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 13:58:47.425803  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-789c720014934abe950ad611625f9bc9 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:47.426229  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-789c720014934abe950ad611625f9bc9 on tablet 789c720014934abe950ad611625f9bc9 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:47.519946  8380 raft_consensus.cc:1217] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:47.738488  8380 raft_consensus.cc:1217] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:47.771219  8380 raft_consensus.cc:1217] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:47.816534  8380 raft_consensus.cc:1217] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:47.957156  8636 raft_consensus.cc:1064] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:47.959237  8636 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:47.964742  8380 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:47.965246  7752 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:47.966030  7679 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:47.966612  8636 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:47.967641  8729 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:47.968427  8711 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:47.989675  8636 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:47.992616  7752 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:47.994180  8380 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.012970  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:48.016722  7675 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.051163  7827 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.059445  8380 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.060067  7745 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.060770  8711 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:48.061729  8737 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:48.069849  8574 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.072942  7745 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.081171  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c6dc2741afba411fbd7695217702cdda with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:48.081161  8380 raft_consensus.cc:2955] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.086177  7573 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:48.101289  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet c6dc2741afba411fbd7695217702cdda with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:48.105549  8742 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:48.106729  8742 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:48.107460  8742 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:48.112143  8742 ts_tablet_manager.cc:1916] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:48.132489  8742 ts_tablet_manager.cc:1929] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:48.133024  8742 log.cc:1199] T c6dc2741afba411fbd7695217702cdda P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/c6dc2741afba411fbd7695217702cdda
I20260501 13:58:48.134795  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet c6dc2741afba411fbd7695217702cdda (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:48.255199  8574 raft_consensus.cc:1064] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:48.257491  8574 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.264986  8380 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.265019  7745 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.266381  8574 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:48.267345  8737 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:48.266304  7679 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.270155  8711 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:48.282518  8729 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.285665  7679 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.287611  7745 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.299212  8380 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.304246  7577 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.331923  7827 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.339489  7750 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.341981  8380 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.342581  8636 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260501 13:58:48.345858  8711 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:48.348562  8732 raft_consensus.cc:1064] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:48.353215  8636 raft_consensus.cc:1064] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:48.351325  8732 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.356333  8737 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.357873  7750 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.359265  8381 raft_consensus.cc:2955] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.372853  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 3c14b33d5ea8424cb04207b894010749 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:48.371039  8636 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.393193  7576 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.399513  7824 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.400003  7679 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.401226  8731 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:48.401489  8381 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.402311  8732 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:48.403800  8731 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:48.447167  8381 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.450577  8731 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.462931  8380 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.467084  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c14b33d5ea8424cb04207b894010749 with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:48.468142  8742 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:48.469254  8742 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:48.470270  7675 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.470374  7745 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:48.467756  8747 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:48.474025  8742 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:48.473165  7675 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.477327  8636 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260501 13:58:48.479885  8711 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260501 13:58:48.486857  7576 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.490784  8742 ts_tablet_manager.cc:1916] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:48.499150  7827 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.522603  8737 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.530565  8742 ts_tablet_manager.cc:1929] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:48.531165  8742 log.cc:1199] T 3c14b33d5ea8424cb04207b894010749 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/3c14b33d5ea8424cb04207b894010749
I20260501 13:58:48.533387  7750 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.533742  7675 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.539592  7752 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.547935  8381 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.552321  8380 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.554275  8750 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:48.559482  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet 3c14b33d5ea8424cb04207b894010749 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:48.563076  8755 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.571935  7675 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.578171  8381 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.566990  7576 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.581902  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 4b13ab5be933469ba7c57247efb0f8e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:48.586203  8750 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:48.600629  7675 raft_consensus.cc:2955] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.610036  7824 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:48.611243  7574 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.624217  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b13ab5be933469ba7c57247efb0f8e9 with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:48.630581  8381 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.632366  8759 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:48.633684  8759 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:48.634541  8759 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:48.636606  7675 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:48.635648  8574 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260501 13:58:48.639101  8759 ts_tablet_manager.cc:1916] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:48.642141  8747 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:48.646925  8636 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.662671  8380 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.664746  8759 ts_tablet_manager.cc:1929] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:48.665200  8759 log.cc:1199] T 4b13ab5be933469ba7c57247efb0f8e9 P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/4b13ab5be933469ba7c57247efb0f8e9
I20260501 13:58:48.670076  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 789c720014934abe950ad611625f9bc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:48.671923  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 4b13ab5be933469ba7c57247efb0f8e9 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:48.668833  7675 raft_consensus.cc:2955] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:48.677687  7577 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:48.692534  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c720014934abe950ad611625f9bc9 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:48.697930  8760 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:48.699079  8760 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:48.699990  8760 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:48.704767  8760 ts_tablet_manager.cc:1916] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:48.721661  8760 ts_tablet_manager.cc:1929] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:48.722064  8760 log.cc:1199] T 789c720014934abe950ad611625f9bc9 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/789c720014934abe950ad611625f9bc9
I20260501 13:58:48.723565  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 789c720014934abe950ad611625f9bc9 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:49.746224  7675 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:49.758889  7825 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:49.759646  7643 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c469ec5051564ef892cf10d14e1eb6d4. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:49.761015  8754 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:49.761298  7745 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:49.765163  8696 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:49.825440  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 50206.3us
I20260501 13:58:49.840405  8763 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.843537  7745 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.846941  7827 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.868423  7679 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:49.869837  7577 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 13:58:49.877676  7643 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a1d6c31dce44935952b27fbc57a2d38. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:49.878383  7745 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:49.879099  7827 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:49.880263  8754 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:49.881315  8765 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:49.899490  8754 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.905113  7745 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.907109  7827 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.917375  7825 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:49.932715  7679 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:49.934528  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 13:58:49.936219  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d228d3d4af349679aafa8dfdebf1247. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:49.937336  8762 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:49.943216  7745 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:49.945943  8762 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:49.954095  8636 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.956434  7675 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.971756  7750 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:49.978622  7752 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:49.975322  7573 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:49.999199  7825 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:50.000710  8769 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:50.003427  7675 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:50.003284  7718 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cac472405b2a42bb98dafbac4e20584b. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:50.006004  8769 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:50.010932  8731 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:50.015164  7825 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:50.021602  7675 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:50.036204  7577 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:50.466954  8792 ts_tablet_manager.cc:933] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:50.477689  8792 tablet_copy_client.cc:323] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:50.481452  7688 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet 2a1d6c31dce44935952b27fbc57a2d38 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:50.482087  7688 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet 2a1d6c31dce44935952b27fbc57a2d38 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-2a1d6c31dce44935952b27fbc57a2d38
I20260501 13:58:50.485039  8791 ts_tablet_manager.cc:933] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:50.487633  8791 tablet_copy_client.cc:323] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:50.492885  7688 tablet_copy_source_session.cc:215] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:50.493623  7689 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet c469ec5051564ef892cf10d14e1eb6d4 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:50.494243  7689 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet c469ec5051564ef892cf10d14e1eb6d4 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-c469ec5051564ef892cf10d14e1eb6d4
I20260501 13:58:50.505709  8792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1d6c31dce44935952b27fbc57a2d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:50.517127  7689 tablet_copy_source_session.cc:215] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:50.524793  8796 ts_tablet_manager.cc:933] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:50.531019  8792 tablet_copy_client.cc:806] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:50.531865  8792 tablet_copy_client.cc:670] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:50.536003  8792 tablet_copy_client.cc:538] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:50.536088  8796 tablet_copy_client.cc:323] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:50.537719  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 4d228d3d4af349679aafa8dfdebf1247 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:50.538283  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 4d228d3d4af349679aafa8dfdebf1247 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-4d228d3d4af349679aafa8dfdebf1247
I20260501 13:58:50.543162  8791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c469ec5051564ef892cf10d14e1eb6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:50.546672  8792 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:50.546780  7838 tablet_copy_source_session.cc:215] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:50.551229  8796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d228d3d4af349679aafa8dfdebf1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:50.568154  8791 tablet_copy_client.cc:806] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:50.568931  8791 tablet_copy_client.cc:670] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:50.575557  8791 tablet_copy_client.cc:538] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:50.578671  8796 tablet_copy_client.cc:806] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:50.579339  8796 tablet_copy_client.cc:670] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:50.583240  8796 tablet_copy_client.cc:538] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:50.588145  8791 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:50.593168  8796 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:50.606161  8799 ts_tablet_manager.cc:933] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:50.610908  8799 tablet_copy_client.cc:323] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 13:58:50.612427  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet cac472405b2a42bb98dafbac4e20584b from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 13:58:50.612994  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet cac472405b2a42bb98dafbac4e20584b from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-cac472405b2a42bb98dafbac4e20584b
I20260501 13:58:50.621233  7764 tablet_copy_source_session.cc:215] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:50.630487  8799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac472405b2a42bb98dafbac4e20584b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:50.631390  8792 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:50.632431  8792 tablet_bootstrap.cc:492] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:50.633172  8792 ts_tablet_manager.cc:1403] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.087s	user 0.032s	sys 0.022s
I20260501 13:58:50.641563  8792 raft_consensus.cc:359] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.642485  8792 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:50.643234  8792 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.644877  8796 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:50.645898  8796 tablet_bootstrap.cc:492] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:50.646636  8796 ts_tablet_manager.cc:1403] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.009s
I20260501 13:58:50.649832  8796 raft_consensus.cc:359] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.650671  8796 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:50.651284  8796 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.659404  8792 ts_tablet_manager.cc:1434] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.004s
I20260501 13:58:50.666239  8791 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:50.667491  8791 tablet_bootstrap.cc:492] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:50.672461  8791 ts_tablet_manager.cc:1403] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.009s
I20260501 13:58:50.674544  8799 tablet_copy_client.cc:806] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:50.675197  8799 tablet_copy_client.cc:670] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:50.679111  8799 tablet_copy_client.cc:538] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:50.693105  7689 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-2a1d6c31dce44935952b27fbc57a2d38 received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:50.693617  7689 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-2a1d6c31dce44935952b27fbc57a2d38 on tablet 2a1d6c31dce44935952b27fbc57a2d38 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:50.697886  8799 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:50.701256  8791 raft_consensus.cc:359] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.702344  8791 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:50.709571  8791 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.721306  8796 ts_tablet_manager.cc:1434] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.074s	user 0.029s	sys 0.025s
I20260501 13:58:50.723796  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-4d228d3d4af349679aafa8dfdebf1247 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:50.724308  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-4d228d3d4af349679aafa8dfdebf1247 on tablet 4d228d3d4af349679aafa8dfdebf1247 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:50.730259  8791 ts_tablet_manager.cc:1434] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260501 13:58:50.733105  7689 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-c469ec5051564ef892cf10d14e1eb6d4 received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:50.733654  7689 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-c469ec5051564ef892cf10d14e1eb6d4 on tablet c469ec5051564ef892cf10d14e1eb6d4 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:50.760625  8799 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:50.761534  8799 tablet_bootstrap.cc:492] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:50.762230  8799 ts_tablet_manager.cc:1403] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.011s
I20260501 13:58:50.766340  8799 raft_consensus.cc:359] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.767170  8799 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:50.767787  8799 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:50.773625  8799 ts_tablet_manager.cc:1434] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260501 13:58:50.775082  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-cac472405b2a42bb98dafbac4e20584b received from {username='slave'} at 127.0.0.1:42716
I20260501 13:58:50.775465  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-cac472405b2a42bb98dafbac4e20584b on tablet cac472405b2a42bb98dafbac4e20584b with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:50.859114  8381 raft_consensus.cc:1217] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:50.904265  8381 raft_consensus.cc:1217] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:51.068939  8381 raft_consensus.cc:1217] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:51.092924  8381 raft_consensus.cc:1217] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:51.246078  8783 raft_consensus.cc:1064] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:51.248934  8783 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.256814  8381 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.259087  7827 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.259212  7745 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.260418  8696 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.261310  8765 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.262120  8783 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.285236  8783 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.298560  7827 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.315652  7573 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:51.317190  8380 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.326092  7745 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:58:51.374465  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0200 after lost signal to thread 6457
W20260501 13:58:51.375789  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800119060 after lost signal to thread 7611
W20260501 13:58:51.377214  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080013ec00 after lost signal to thread 7703
W20260501 13:58:51.378440  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080027f220 after lost signal to thread 7778
W20260501 13:58:51.379640  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08002835e0 after lost signal to thread 7852
W20260501 13:58:51.380928  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3040 after lost signal to thread 8405
I20260501 13:58:51.396689  7678 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.403049  7752 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:51.403049  8380 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:51.405221  8783 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:51.406500  8696 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:51.419358  8783 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.425547  7752 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.420461  8380 raft_consensus.cc:2955] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.445040  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.448161  8817 raft_consensus.cc:1064] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:51.451758  8817 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.453946  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 2a1d6c31dce44935952b27fbc57a2d38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:51.462388  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a1d6c31dce44935952b27fbc57a2d38 with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:51.466737  7824 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.468086  8380 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.469506  8817 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.470292  8809 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.498091  7752 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.505682  8761 raft_consensus.cc:1064] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:51.509533  8761 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.517589  8809 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:51.524816  8696 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.547312  8380 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.549924  8819 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:51.555431  8819 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:51.560635  8819 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:51.568240  7574 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:51.580873  7825 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.600772  7745 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.625917  8819 ts_tablet_manager.cc:1916] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:51.657980  8381 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.659719  7753 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.661197  8826 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.666131  8761 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.666164  7676 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.663375  7678 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.678215  8380 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:51.678505  7752 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:51.678977  8819 ts_tablet_manager.cc:1929] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:51.679508  8819 log.cc:1199] T 2a1d6c31dce44935952b27fbc57a2d38 P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/2a1d6c31dce44935952b27fbc57a2d38
I20260501 13:58:51.680078  8765 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:51.681143  8783 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:51.684067  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 2a1d6c31dce44935952b27fbc57a2d38 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:51.685027  8824 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260501 13:58:51.701532  8809 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.720551  7745 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.733178  8377 raft_consensus.cc:2955] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.739872  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c469ec5051564ef892cf10d14e1eb6d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:51.748792  8769 raft_consensus.cc:1064] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:51.762533  7576 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.791561  8769 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.804767  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet c469ec5051564ef892cf10d14e1eb6d4 with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:51.805948  8819 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:51.807114  8819 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:51.807909  8819 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:51.812384  8819 ts_tablet_manager.cc:1916] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:51.820236  8824 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.845456  7577 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:51.848733  7678 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.850524  8381 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.853157  7753 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.873967  7827 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:51.890408  8381 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:51.893376  7678 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:51.905495  8825 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:51.910739  8824 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:51.915481  8819 ts_tablet_manager.cc:1929] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:51.916939  8377 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.916129  8819 log.cc:1199] T c469ec5051564ef892cf10d14e1eb6d4 P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/c469ec5051564ef892cf10d14e1eb6d4
I20260501 13:58:51.918331  8761 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.920300  7676 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.921861  8807 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:51.922642  7675 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.926230  8829 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:51.931367  7824 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:51.935868  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet c469ec5051564ef892cf10d14e1eb6d4 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:51.940369  8807 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:51.953611  8381 raft_consensus.cc:2955] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.966766  7577 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:51.998440  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 4d228d3d4af349679aafa8dfdebf1247 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:51.999673  8829 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.004550  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d228d3d4af349679aafa8dfdebf1247 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:52.013401  7675 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.018502  8381 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.047516  7824 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.062935  8836 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:52.086275  8836 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:52.087267  8836 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:52.087157  7574 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.091331  8836 ts_tablet_manager.cc:1916] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:52.113523  8836 ts_tablet_manager.cc:1929] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:52.114006  8836 log.cc:1199] T 4d228d3d4af349679aafa8dfdebf1247 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/4d228d3d4af349679aafa8dfdebf1247
I20260501 13:58:52.121129  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 4d228d3d4af349679aafa8dfdebf1247 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:52.129477  7752 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:52.241573  7827 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:52.241937  8376 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:52.243716  8829 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:52.245393  8807 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:52.256127  8769 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.270071  7827 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.272538  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet cac472405b2a42bb98dafbac4e20584b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:52.281306  8376 raft_consensus.cc:2955] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:52.285938  7577 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:52.300310  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet cac472405b2a42bb98dafbac4e20584b with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:52.308898  8837 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:52.310037  8837 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:52.315768  8837 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:52.321244  8837 ts_tablet_manager.cc:1916] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:52.348754  8837 ts_tablet_manager.cc:1929] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:52.349220  8837 log.cc:1199] T cac472405b2a42bb98dafbac4e20584b P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/cac472405b2a42bb98dafbac4e20584b
I20260501 13:58:52.351040  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet cac472405b2a42bb98dafbac4e20584b (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:52.872162  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:52.930177  7676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:58:52.930963  7676 raft_consensus.cc:606] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:52.933712  7676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:58:52.934237  7676 raft_consensus.cc:606] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:52.948794  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:52.949491  7827 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:52.952275  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:52.953002  7827 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:52.958398  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee17e865655f4db7affb37902439a8be"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:52.959700  7827 raft_consensus.cc:606] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:52.961844  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:58:52.963877  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:52.965109  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:53.067304  8765 raft_consensus.cc:993] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:53.068761  8783 raft_consensus.cc:1081] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:53.070945  8381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51750
I20260501 13:58:53.071559  8381 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:53.071923  8381 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.079139  8381 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:53.081555  8381 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:53.084422  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:53.085184  7751 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.088454  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:53.090071  7676 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:53.090406  7676 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:53.091260  7676 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:53.092653  7676 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.092823  7751 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:53.094229  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:58:53.096449  8843 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:53.097566  8843 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:53.098492  8843 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:53.100090  7676 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:53.108558  7574 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:53.249616  8838 raft_consensus.cc:993] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:53.250170  8838 raft_consensus.cc:1081] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:53.251698  7751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:58:53.252331  7751 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:53.252696  7751 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.259375  7751 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.261687  7751 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:53.262993  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:53.263653  7827 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:53.263926  7827 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:53.264645  7827 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.265712  7827 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.267385  8761 raft_consensus.cc:993] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:53.267999  8761 raft_consensus.cc:1081] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:53.269526  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:53.270103  7675 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.270431  7752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee17e865655f4db7affb37902439a8be"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:58:53.270939  7752 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:53.271265  7752 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.277861  7675 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:53.279620  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:53.280776  8829 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:53.281286  8829 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:53.282140  8829 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.298089  7827 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:53.300325  7752 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.303856  7752 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:53.314774  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:53.315007  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:53.315647  7676 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.318284  7574 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:53.315646  7827 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:53.325218  7827 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:53.326094  7827 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.327461  7827 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.338392  7827 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:53.339404  7676 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:53.339845  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:53.344076  8829 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:53.344569  8829 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:53.345460  8829 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.366212  7574 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:53.393323  8783 raft_consensus.cc:993] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:53.393920  8842 raft_consensus.cc:1081] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:53.395696  8381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51750
I20260501 13:58:53.396277  8381 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:53.396577  8381 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.402443  8789 raft_consensus.cc:993] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:53.402995  8761 raft_consensus.cc:1081] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:53.404623  7752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:58:53.405182  7752 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:53.405500  7752 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.418270  7752 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.426177  7827 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:53.425865  8381 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:53.430830  8381 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:53.430528  7752 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:53.432086  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:53.432653  7825 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:53.432837  7825 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:53.433657  7825 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.434617  7825 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.436687  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:53.437279  7751 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.442008  7825 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:53.443339  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:53.444264  8807 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:53.444768  8807 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:53.445590  8807 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:53.448416  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:53.449036  7675 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:53.449388  7675 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:53.450218  7675 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:53.458819  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:53.459561  7676 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.465484  7675 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:53.473436  7675 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:53.478188  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:53.479032  8843 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:53.479532  8843 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:53.480726  8843 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:53.493142  7676 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:53.493989  7751 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:53.494306  7574 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:53.504522  7751 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:53.515347  8761 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:53.517289  7676 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:53.520190  7792 consensus_peers.cc:597] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1ee722489b34f13bc6b2cc16825e5c9. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:53.523074  8838 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:53.525969  7574 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:53.534101  8838 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.548539  7751 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.582921  7676 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:53.584049  7574 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.597831  7675 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.599587  8843 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:53.606925  7825 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:53.636797  7752 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:53.638105  7676 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:53.639845  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43c8497c73c3498ca73ca16b7f2da7cd. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:53.644783  8838 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:53.647881  8761 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:53.651481  7753 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:53.653357  8843 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:53.680541  8789 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.683456  7676 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.698122  7679 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:53.702906  7827 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:53.705493  8807 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:53.706502  7574 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:53.727587  7752 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.764964  7676 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:53.767714  8829 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:53.796619  7827 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260501 13:58:53.800513  7643 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a9517b581244993be7b40b089a96bd0. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:53.801486  8857 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:53.814888  7676 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:53.822412  7753 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:53.823338  8829 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:53.830554  8783 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:53.835628  7827 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:53.847800  8869 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260501 13:58:53.867697  8857 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.869910  7825 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.882668  7675 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:53.900933  8807 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:53.905480  7675 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:53.960680  7577 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260501 13:58:53.967614  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68321.1us
I20260501 13:58:53.970037  7753 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:53.971504  8879 ts_tablet_manager.cc:933] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:53.974300  7825 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:53.975023  7752 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:53.989259  8879 tablet_copy_client.cc:323] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:53.992278  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet f1ee722489b34f13bc6b2cc16825e5c9 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:53.993137  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet f1ee722489b34f13bc6b2cc16825e5c9 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-f1ee722489b34f13bc6b2cc16825e5c9
I20260501 13:58:54.004690  7752 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:54.005985  7838 tablet_copy_source_session.cc:215] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:54.006507  8876 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:54.007557  8843 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:54.018695  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:58:54.031457  7643 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4f9a0d66d094218a7a19cb600d50a75. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:54.034133  8879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ee722489b34f13bc6b2cc16825e5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:54.035255  8877 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:54.048967  7679 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:54.055140  8843 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:54.092916  8876 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:54.096632  7751 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 13:58:54.098166  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 67063.3us
I20260501 13:58:54.101606  7825 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:54.134452  8886 ts_tablet_manager.cc:933] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:54.123865  8829 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260501 13:58:54.268072  8879 tablet_copy_client.cc:806] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:54.268956  8879 tablet_copy_client.cc:670] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:54.248013  8886 tablet_copy_client.cc:323] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:54.300927  7824 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:54.307550  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:54.308274  7827 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:58:54.307910  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 71663us
I20260501 13:58:54.336087  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:54.336820  7828 raft_consensus.cc:606] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:54.320802  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 43c8497c73c3498ca73ca16b7f2da7cd from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:54.342756  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 43c8497c73c3498ca73ca16b7f2da7cd from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-43c8497c73c3498ca73ca16b7f2da7cd
I20260501 13:58:54.344964  8879 tablet_copy_client.cc:538] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:54.352880  8893 ts_tablet_manager.cc:933] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:54.357560  8891 raft_consensus.cc:993] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:54.358079  8891 raft_consensus.cc:1081] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:54.366791  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:54.367714  7824 raft_consensus.cc:606] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:54.371181  7576 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:54.380235  7838 tablet_copy_source_session.cc:215] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:54.385068  8879 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:54.386183  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c8497c73c3498ca73ca16b7f2da7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:54.375104  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:54.387516  7828 raft_consensus.cc:606] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:58:54.419499  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 100835us
I20260501 13:58:54.419236  8886 tablet_copy_client.cc:806] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:54.432101  8886 tablet_copy_client.cc:670] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:54.432683  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:54.433344  7828 raft_consensus.cc:606] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:54.447237  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:58:54.449388  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:54.456367  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:54.509209  8886 tablet_copy_client.cc:538] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:54.530730  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:58:54.531672  7673 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:54.532054  7673 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.553829  8886 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:54.546223  7673 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:54.563104  7673 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:54.585219  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:54.585908  7752 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.592137  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:54.606081  7828 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:54.606561  7828 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:54.637728  7752 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:54.639894  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:54.639954  7828 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:54.656097  7828 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.663448  8893 tablet_copy_client.cc:323] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:54.651372  8876 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:54.683871  8876 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:54.686201  8876 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:54.686609  8898 ts_tablet_manager.cc:933] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:58:54.722862  7689 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet 2a9517b581244993be7b40b089a96bd0 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:54.723709  7689 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet 2a9517b581244993be7b40b089a96bd0 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-2a9517b581244993be7b40b089a96bd0
I20260501 13:58:54.732893  8896 raft_consensus.cc:993] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:54.747983  8896 raft_consensus.cc:1081] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:54.825299  8898 tablet_copy_client.cc:323] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.129:36443
I20260501 13:58:54.828986  8761 raft_consensus.cc:993] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:54.833592  8761 raft_consensus.cc:1081] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:54.838503  7689 tablet_copy_source_session.cc:215] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:54.839345  7828 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:54.848325  7574 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:54.856031  7689 tablet_copy_service.cc:140] P bc1b0a0a152e46fea4bd4934ba9976ed: Received BeginTabletCopySession request for tablet c4f9a0d66d094218a7a19cb600d50a75 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:46596)
I20260501 13:58:54.857745  7689 tablet_copy_service.cc:161] P bc1b0a0a152e46fea4bd4934ba9976ed: Beginning new tablet copy session on tablet c4f9a0d66d094218a7a19cb600d50a75 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:46596: session id = 91854d93e96c4756834efe8b2ef59fce-c4f9a0d66d094218a7a19cb600d50a75
I20260501 13:58:54.860013  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9517b581244993be7b40b089a96bd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 13:58:54.864503  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 149853us
I20260501 13:58:54.873106  8879 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:54.881299  8879 tablet_bootstrap.cc:492] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:54.882133  8879 ts_tablet_manager.cc:1403] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.497s	user 0.025s	sys 0.018s
I20260501 13:58:54.887058  7753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:58:54.887658  7753 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:54.888047  7753 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.895972  7752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:58:54.896603  7752 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:54.896996  7752 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.897326  7753 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:54.904358  7753 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:54.905702  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:54.906358  7828 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:54.907591  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:54.907929  7752 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:54.911019  7828 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:54.916853  7752 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:54.914083  7828 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:54.918665  7828 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.922077  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:54.922972  7679 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.911141  8899 raft_consensus.cc:993] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:54.925055  8903 raft_consensus.cc:993] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:54.927246  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:54.927852  7825 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:54.928157  7825 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:54.928833  7825 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:54.911299  7671 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.942756  8903 raft_consensus.cc:1081] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:54.943127  8838 raft_consensus.cc:1081] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:54.947485  7825 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:54.986353  7689 tablet_copy_source_session.cc:215] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:54.993108  8879 raft_consensus.cc:359] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:54.994460  8879 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:54.994833  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f9a0d66d094218a7a19cb600d50a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:54.995466  8879 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.001191  7828 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:55.002899  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:55.003119  8886 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:55.007259  8381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51744
I20260501 13:58:55.007941  8381 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:55.008267  8381 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.009110  8377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51744
I20260501 13:58:55.009738  8377 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:55.010066  8377 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.016048  7679 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:55.028872  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:55.034475  8895 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:55.035182  8895 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:55.037885  7825 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:55.040772  8377 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.045004  8807 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:55.045601  8807 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:55.046586  8807 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:55.043104  8377 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:55.041348  8886 tablet_bootstrap.cc:492] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:55.052685  8886 ts_tablet_manager.cc:1403] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.499s	user 0.047s	sys 0.001s
I20260501 13:58:55.036276  8895 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.060635  8879 ts_tablet_manager.cc:1434] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.176s	user 0.002s	sys 0.010s
I20260501 13:58:55.061996  8381 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.069586  8381 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:55.072341  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:55.072949  7752 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.087098  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:55.088428  7751 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.083418  8886 raft_consensus.cc:359] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.098032  8886 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:55.098909  8886 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.100504  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:55.101271  7828 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:55.102260  7828 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:55.107362  7828 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.101387  7671 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:55.110657  7676 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:58:55.112819  8886 ts_tablet_manager.cc:1434] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260501 13:58:55.110647  7828 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.116600  7576 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:55.103056  7751 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:55.104341  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-f1ee722489b34f13bc6b2cc16825e5c9 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:55.109004  8893 tablet_copy_client.cc:806] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:55.119131  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-f1ee722489b34f13bc6b2cc16825e5c9 on tablet f1ee722489b34f13bc6b2cc16825e5c9 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:55.122639  8893 tablet_copy_client.cc:670] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:55.134105  8898 tablet_copy_client.cc:806] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:55.134828  8898 tablet_copy_client.cc:670] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:55.135692  7828 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:55.142947  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-43c8497c73c3498ca73ca16b7f2da7cd received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:55.143359  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-43c8497c73c3498ca73ca16b7f2da7cd on tablet 43c8497c73c3498ca73ca16b7f2da7cd with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:55.085376  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:55.146871  7825 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:55.150225  7825 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:55.151942  7825 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.153276  7825 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.157239  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:58:55.102378  7752 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:55.160923  7825 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:55.171285  7574 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:55.186939  8909 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:55.187674  8909 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:55.189056  8909 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.197263  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:55.199096  8843 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:55.210224  8381 raft_consensus.cc:1217] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:55.212595  7574 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:55.219271  8893 tablet_copy_client.cc:538] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:55.219641  8898 tablet_copy_client.cc:538] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:55.223575  8843 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:55.224958  8843 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.259018  8893 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:55.261402  8898 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:55.274147  7576 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:55.288726  7752 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:55.309005  8783 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:55.314478  8898 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:55.315625  8898 tablet_bootstrap.cc:492] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:55.316419  8898 ts_tablet_manager.cc:1403] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.016s
I20260501 13:58:55.324124  7828 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:55.325735  8783 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:55.336740  8893 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:55.337741  8893 tablet_bootstrap.cc:492] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:55.338563  8893 ts_tablet_manager.cc:1403] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.006s
I20260501 13:58:55.345041  8893 raft_consensus.cc:359] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.346498  8893 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:55.343091  8898 raft_consensus.cc:359] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.347860  8898 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:55.347942  8893 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.355127  8893 ts_tablet_manager.cc:1434] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260501 13:58:55.349591  8898 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:55.357334  7689 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-2a9517b581244993be7b40b089a96bd0 received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:55.357781  7689 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-2a9517b581244993be7b40b089a96bd0 on tablet 2a9517b581244993be7b40b089a96bd0 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:55.358140  8898 ts_tablet_manager.cc:1434] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.005s
I20260501 13:58:55.364687  7689 tablet_copy_service.cc:342] P bc1b0a0a152e46fea4bd4934ba9976ed: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-c4f9a0d66d094218a7a19cb600d50a75 received from {username='slave'} at 127.0.0.1:46596
I20260501 13:58:55.365170  7689 tablet_copy_service.cc:434] P bc1b0a0a152e46fea4bd4934ba9976ed: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-c4f9a0d66d094218a7a19cb600d50a75 on tablet c4f9a0d66d094218a7a19cb600d50a75 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:55.492895  7825 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:55.494362  8807 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:55.509560  8381 raft_consensus.cc:1217] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:55.541463  8381 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Advancing to term 2
I20260501 13:58:55.542614  7671 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:55.544801  8807 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:55.608420  7824 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:55.612376  8895 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:55.616254  8381 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:58:55.620981  7752 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:55.621155  8807 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:55.622738  8843 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:55.627066  7671 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:55.631171  8807 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:55.633519  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:55.693434  7824 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:55.700495  8843 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:55.709161  8807 raft_consensus.cc:1064] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:55.724718  7751 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:55.726863  8843 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:55.728749  8807 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.751729  8903 raft_consensus.cc:1064] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:55.754647  8903 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.760334  8381 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:55.761920  8895 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:55.773718  7825 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:55.775132  8895 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:55.776945  7825 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:55.778599  8843 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:55.782639  8883 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:55.785071  7670 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:58:55.804291  8869 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:55.809641  8381 raft_consensus.cc:1217] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:55.819221  7670 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:55.826037  7825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:55.838771  7825 raft_consensus.cc:606] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:55.843734  8381 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:55.844307  7825 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:55.845536  8896 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:55.852787  8377 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:55.865053  8899 raft_consensus.cc:993] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:55.865710  8899 raft_consensus.cc:1081] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:55.868286  8376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51744
I20260501 13:58:55.868913  8376 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:55.869295  8376 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:55.883149  7676 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:55.898833  7753 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:55.900422  7577 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:55.898756  8761 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260501 13:58:55.893784  8376 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:55.919176  8896 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260501 13:58:55.978543  8933 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260501 13:58:56.042562  8376 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:56.044504  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:56.045459  7827 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:56.045742  7827 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:58:56.116415  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 80691.4us
W20260501 13:58:56.115643  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 168883us
I20260501 13:58:56.127166  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:58:56.128857  7745 raft_consensus.cc:606] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:56.145144  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:56.146584  7676 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:58:56.173034  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 213781us
I20260501 13:58:56.175280  8946 raft_consensus.cc:1064] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
W20260501 13:58:56.204950  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 59665.4us
I20260501 13:58:56.208871  8946 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.202795  7827 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.225107  7745 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.228709  7827 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.252626  7676 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:56.253849  7679 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
W20260501 13:58:56.263224  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:58:56.269506  7678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:58:56.270300  7678 raft_consensus.cc:606] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:56.280146  7827 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:56.282529  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:56.293480  8843 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:56.294165  8843 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:56.299525  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:56.303226  7827 raft_consensus.cc:606] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:56.313107  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:56.313948  7827 raft_consensus.cc:606] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:56.316154  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:58:56.321415  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:56.322794  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:56.297988  8843 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.336457  7827 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:56.337085  8381 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:56.354118  8807 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:56.362421  8807 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:56.393491  8952 raft_consensus.cc:993] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:56.394126  8952 raft_consensus.cc:1081] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:56.415550  8883 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.419441  8939 raft_consensus.cc:993] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:56.422750  8939 raft_consensus.cc:1081] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:56.427316  8896 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.435756  7753 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:56.443347  7676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:58:56.444021  7676 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:56.444375  7676 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.444669  7824 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:56.446810  7574 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:56.454308  7827 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.456807  8376 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:56.476078  8376 raft_consensus.cc:2955] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.481298  8954 raft_consensus.cc:1064] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:58:56.481848  8783 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260501 13:58:56.487679  8954 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.492928  8381 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.497268  7676 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.474130  7752 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.505239  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet f1ee722489b34f13bc6b2cc16825e5c9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:56.494858  7574 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 4 to 5, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.512099  7745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60268
I20260501 13:58:56.512723  7745 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:56.513113  7745 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.516799  7576 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:58:56.511560  8958 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260501 13:58:56.521543  7745 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.499243  7676 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:56.541500  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:56.542265  7824 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.546067  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ee722489b34f13bc6b2cc16825e5c9 with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38224
I20260501 13:58:56.550179  8896 raft_consensus.cc:993] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:56.550748  8896 raft_consensus.cc:1081] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:56.561072  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:56.561870  7751 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:56.562176  7751 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:56.562371  8962 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:58:56.563210  7751 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.564549  7751 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.568333  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:56.568997  7828 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.568748  7827 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.573499  8946 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:56.563671  8962 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:56.589488  7828 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:56.592710  7824 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:58:56.594597  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 57343us
I20260501 13:58:56.523717  7745 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:56.602171  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:56.602790  8962 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:56.607306  8954 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:56.612038  8952 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:56.612886  8952 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:56.613925  8952 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.617372  8381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51744
I20260501 13:58:56.621325  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:56.621953  7676 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:56.622282  7676 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:56.623054  7676 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.623739  7670 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:58:56.617964  8381 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:56.624439  7676 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.624838  8381 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.627209  7751 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:56.630934  8376 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:56.635753  7676 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:56.640381  8377 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:56.641733  7751 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:56.641932  7828 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:58:56.643752  7752 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:58:56.625682  8962 ts_tablet_manager.cc:1916] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:56.654100  8939 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:56.661767  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:56.663559  8939 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:56.664474  8939 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:56.662524  7675 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.665532  8939 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.686169  8954 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:58:56.692513  8946 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.695572  8955 raft_consensus.cc:993] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:56.696156  8955 raft_consensus.cc:1081] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:56.697654  7670 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:56.707293  8381 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.709326  8381 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:56.719579  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:56.721128  7752 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.724710  8945 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:56.716759  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:56.728103  7824 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:56.732681  7824 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:56.733652  7824 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.734700  7824 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.730366  8946 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:56.735723  8962 ts_tablet_manager.cc:1929] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260501 13:58:56.737185  8962 log.cc:1199] T f1ee722489b34f13bc6b2cc16825e5c9 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/f1ee722489b34f13bc6b2cc16825e5c9
I20260501 13:58:56.736665  7574 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:56.739626  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet f1ee722489b34f13bc6b2cc16825e5c9 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:56.743067  7824 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:56.751518  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:56.752781  8944 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:56.753882  7827 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.760102  7825 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:56.762986  8843 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:56.771163  8377 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.793910  7752 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:56.791440  7751 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:56.809684  7675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:58:56.810334  7675 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:56.810672  7675 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.810850  7673 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:56.812772  8944 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:56.814062  8944 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:56.821748  7675 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.823524  7675 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:58:56.857810  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 133392us
I20260501 13:58:56.863772  8969 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:56.867697  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:56.868355  7745 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.871639  7577 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 2, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:56.912622  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:56.913452  7823 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:56.913823  7823 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:56.914726  7823 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:56.917140  7574 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:56.922330  7745 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
W20260501 13:58:56.922623  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:58:56.923619  7823 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:56.945624  8896 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:56.973212  7823 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
W20260501 13:58:56.984537  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 43662us
I20260501 13:58:56.986128  7745 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:58:57.020112  8945 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.020094  8901 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.029753  7574 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.083545  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 43c8497c73c3498ca73ca16b7f2da7cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:57.103767  7679 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.117946  7573 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:57.123145  8377 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.128477  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:57.133340  8946 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:57.133978  8946 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:58:57.151695  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:58:57.151117  8946 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:57.154838  7576 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.161682  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 43c8497c73c3498ca73ca16b7f2da7cd with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:57.168305  7824 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:57.172768  8953 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:57.177937  8979 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:57.179637  8979 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:57.183094  8979 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:57.193099  8979 ts_tablet_manager.cc:1916] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:57.194905  7573 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 13:58:57.206041  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 181608us
I20260501 13:58:57.213454  8979 ts_tablet_manager.cc:1929] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:57.213040  8377 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.214171  8979 log.cc:1199] T 43c8497c73c3498ca73ca16b7f2da7cd P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/43c8497c73c3498ca73ca16b7f2da7cd
I20260501 13:58:57.218847  7671 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:57.223027  7751 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:57.224802  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 43c8497c73c3498ca73ca16b7f2da7cd (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:57.249434  8381 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:57.249958  7828 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:57.251546  8944 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:57.252401  7752 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.273495  8967 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:58:57.277848  8953 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:57.290932  8967 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:57.317144  8967 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.333500  7670 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.342207  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c4f9a0d66d094218a7a19cb600d50a75 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:57.346323  8377 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.363416  7745 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:57.364607  8376 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:57.366820  7826 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:58:57.368567  7825 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:57.368422  7823 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.393687  7752 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:57.405467  8843 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:57.406849  8946 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:57.400780  7574 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:57.391433  8939 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260501 13:58:57.425856  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet c4f9a0d66d094218a7a19cb600d50a75 with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60254
I20260501 13:58:57.426903  8979 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 13:58:57.428138  8979 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:57.429001  8979 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:57.432832  8979 ts_tablet_manager.cc:1916] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260501 13:58:57.434201  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 104111us
I20260501 13:58:57.494925  8979 ts_tablet_manager.cc:1929] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:57.498625  8979 log.cc:1199] T c4f9a0d66d094218a7a19cb600d50a75 P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/c4f9a0d66d094218a7a19cb600d50a75
I20260501 13:58:57.502166  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet c4f9a0d66d094218a7a19cb600d50a75 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
W20260501 13:58:57.503844  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 112086us
I20260501 13:58:57.508186  8939 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:57.509373  8901 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:58:57.524847  7823 raft_consensus.cc:2955] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.547202  7671 raft_consensus.cc:2955] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.570286  8967 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.580667  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 2a9517b581244993be7b40b089a96bd0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:58:57.603884  7574 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 1 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:57.604977  8377 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.608863  7751 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:57.612524  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:57.617770  7751 raft_consensus.cc:2955] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:58:57.626554  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a9517b581244993be7b40b089a96bd0 with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50946
I20260501 13:58:57.699533  8992 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:58:57.699532  8946 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:57.701594  8992 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 13:58:57.702499  8992 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 13:58:57.706624  8992 ts_tablet_manager.cc:1916] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:58:57.708325  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:57.709017  7823 raft_consensus.cc:606] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:57.711875  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47951612b03c496aa487574a115ca380"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:57.712459  7823 raft_consensus.cc:606] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:57.715076  7671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:58:57.715693  7671 raft_consensus.cc:606] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:57.718750  7671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:58:57.719429  7671 raft_consensus.cc:606] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:57.722424  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:58:57.722947  7752 raft_consensus.cc:606] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:57.724267  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:58:57.726718  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:57.727613  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:57.734587  8992 ts_tablet_manager.cc:1929] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260501 13:58:57.735280  8992 log.cc:1199] T 2a9517b581244993be7b40b089a96bd0 P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/2a9517b581244993be7b40b089a96bd0
I20260501 13:58:57.737262  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 2a9517b581244993be7b40b089a96bd0 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:58:57.750615  7823 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:57.760182  8993 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:57.788404  8986 raft_consensus.cc:993] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:57.788996  8883 raft_consensus.cc:1081] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:57.790788  8377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51762
I20260501 13:58:57.791400  8377 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:57.791744  8377 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.801237  8377 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.818013  8377 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:57.820447  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:57.821031  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:57.821751  7823 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.821226  7751 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:57.828001  7751 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:57.829092  7751 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.830370  7751 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.839044  7751 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:57.843261  7823 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:57.845135  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:57.845988  8843 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:57.846509  8843 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:57.847463  8843 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.881822  7574 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:57.895347  8938 raft_consensus.cc:993] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:57.895884  8938 raft_consensus.cc:1081] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:57.897305  8377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51744
I20260501 13:58:57.897864  8377 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:57.898198  8377 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.905889  8377 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.910068  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:57.910712  7827 raft_consensus.cc:3055] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:57.911013  7827 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:57.911872  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:57.911999  7827 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.912616  7670 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.913391  7827 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.915959  8377 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:57.920545  7827 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:57.921725  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:57.922571  8843 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:57.923043  8843 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:57.923946  8843 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:57.956521  8939 raft_consensus.cc:993] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:57.957167  8991 raft_consensus.cc:1081] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:57.960777  7576 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:58:57.963089  7751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60268
I20260501 13:58:57.963943  7751 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:57.964306  7751 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.971869  7751 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:57.973564  7751 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:57.975091  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:57.975167  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:57.975792  7823 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.976019  7671 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:57.976429  7671 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:57.977669  7671 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:57.978890  7671 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:57.948010  7670 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:57.984721  7823 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:57.988130  7671 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:57.989194  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:58:57.990130  8952 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:57.990660  8952 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:57.991756  8952 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:58.014853  8945 raft_consensus.cc:993] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:58.015398  8945 raft_consensus.cc:1081] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:58.018245  7670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47951612b03c496aa487574a115ca380"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:58:58.019083  7670 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:58.019603  7670 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:58.025386  8993 raft_consensus.cc:993] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: : Instructing follower 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:58.025988  8993 raft_consensus.cc:1081] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Signalling peer 91854d93e96c4756834efe8b2ef59fce to start an election
I20260501 13:58:58.027782  8377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:51750
I20260501 13:58:58.028442  8377 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:58.028807  8377 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:58.033561  7576 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:58.037701  8377 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:58.044134  8377 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:58.046077  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:58.050617  7671 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:58.051054  7671 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:58.052403  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:58.052183  7671 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:58:58.053270  7751 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:58.054032  7671 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:58.106841  7751 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:58.108680  7670 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:58.111064  7670 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:58.130628  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:58:58.132349  8969 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:58.132961  8969 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:58:58.134024  8969 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:58:58.351058  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 240903us
I20260501 13:58:58.374722  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:58.375448  7823 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:58.375769  7823 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:58.376554  7823 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:58.378041  7823 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:58.399798  7822 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:58.400025  7825 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:58.464236  7671 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:58:58.451349  9006 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260501 13:58:58.465662  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:58.466274  7751 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:58:58.475611  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 54323.2us
I20260501 13:58:58.480779  7751 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:58.485280  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:58.485487  7827 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:58.487064  8967 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:58.487627  8967 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:58.488590  8967 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:58.492493  7823 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:58.492740  7574 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:58:58.496600  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 82983.4us
I20260501 13:58:58.497895  9006 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:58.507704  7745 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:58.509585  8986 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:58.512862  7670 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:58.536015  9009 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:58.539939  7574 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:58.553364  9008 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:58:58.602473  7670 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:58.603962  8986 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:58.703761  7751 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:58.706182  9009 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:58.734453  7670 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:58:58.739869  9006 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:58:58.821539  7823 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:58:58.830080  7792 consensus_peers.cc:597] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 367eab87da314007b62b7bd0a0905d38. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:58.833717  7671 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:58.834113  7751 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:58.836162  8896 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:58.837108  8938 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:58.867652  8896 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:58.869378  7670 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:58.871274  7751 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:58.889729  7574 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:58.893517  7745 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:58.904428  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:58.934746  7823 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:58.936245  8994 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:58.952807  7827 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:58.965219  7670 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:58.969725  8953 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260501 13:58:58.981858  7747 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:58.985984  8988 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:58.987664  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a769b271cb04497eb1cb86169399ceb2. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:58.989462  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e99f3322c2477888132a818eae4971"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:58.990172  7827 raft_consensus.cc:606] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:58.991488  8883 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:58:59.015741  7671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:58:59.016484  7671 raft_consensus.cc:606] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:58:59.024482  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:58:59.025388  7751 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:59.030869  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:58:59.031503  7824 raft_consensus.cc:606] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:58:59.032652  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260501 13:58:59.034778  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:58:59.033715  9002 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.035660  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:58:59.039193  7824 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.041579  7670 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.049435  7751 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:59.075430  7576 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260501 13:58:59.120563  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f875366331345f08d2e236a76c1c71d. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:59.124608  7824 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:59.125257  9003 raft_consensus.cc:993] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:59.125862  8945 raft_consensus.cc:1081] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:59.126432  7670 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:59.126767  9002 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.128163  9010 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.131386  7670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:58:59.131968  7670 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:59.132287  7670 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.139449  9010 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.141376  7824 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.154004  7670 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.155741  7670 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:59.156488  7671 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.161652  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:59.162287  7751 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.162376  7574 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.168787  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:59.169498  7824 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:59.169826  7824 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:59.172564  7827 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:59.177542  7824 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.178884  7824 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.175889  7751 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:59.186507  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:59.193719  8946 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:59.194240  8946 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:59.195065  8946 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.200737  7824 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:58:59.219866  7751 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:59.221660  8977 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:58:59.224473  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4262547d9184416ab702339797bead6f. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:58:59.241324  7670 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260501 13:58:59.241854  7576 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:59.244400  9003 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.246151  7751 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.258924  8977 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.289279  9002 raft_consensus.cc:993] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:59.289867  9002 raft_consensus.cc:1081] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:58:59.285705  7678 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:58:59.290858  8945 raft_consensus.cc:993] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:59.291356  8945 raft_consensus.cc:1081] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:59.292790  7752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43e99f3322c2477888132a818eae4971"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:58:59.293318  7752 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:59.293642  7752 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.296042  7670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:58:59.296633  7670 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:59.296942  7670 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:59.302726  7752 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.275177  7573 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 2, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:59.305320  7752 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:59.310173  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:59.310777  7827 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:59.311064  7827 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:58:59.312955  7827 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.317370  7827 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.314901  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:59.320624  7677 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.330675  7677 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:59.331996  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:59.332899  9002 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:59.333410  9002 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:59.334261  9002 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.340488  7670 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.345201  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:58:59.367700  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8b00 after lost signal to thread 6457
W20260501 13:58:59.372819  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d91e0 after lost signal to thread 7611
W20260501 13:58:59.374280  8402 debug-util.cc:398] Leaking SignalData structure 0x7b0800144e80 after lost signal to thread 7703
W20260501 13:58:59.375687  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08003495a0 after lost signal to thread 7778
W20260501 13:58:59.377051  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002278a0 after lost signal to thread 7852
W20260501 13:58:59.378391  8402 debug-util.cc:398] Leaking SignalData structure 0x7b080011aa80 after lost signal to thread 8405
I20260501 13:58:59.369333  7574 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:59.398075  7670 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:59.406103  9043 ts_tablet_manager.cc:933] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:59.420135  9043 tablet_copy_client.cc:323] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:59.421741  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:58:59.422437  7752 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:58:59.422560  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 367eab87da314007b62b7bd0a0905d38 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:59.422803  7752 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:59.423213  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 367eab87da314007b62b7bd0a0905d38 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-367eab87da314007b62b7bd0a0905d38
I20260501 13:58:59.423527  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:59.424098  7824 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:59.423677  7752 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.425407  7752 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:58:59.431967  7838 tablet_copy_source_session.cc:215] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:59.438155  7752 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:58:59.441776  9043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367eab87da314007b62b7bd0a0905d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:59.445108  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:59.445986  8994 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:58:59.446475  8994 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:59.447319  8994 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.455121  7824 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:58:59.479776  7574 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 2 to 3, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:59.491894  9043 tablet_copy_client.cc:806] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:58:59.495002  9043 tablet_copy_client.cc:670] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:58:59.499034  9043 tablet_copy_client.cc:538] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:58:59.532948  9043 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:58:59.558442  8994 raft_consensus.cc:993] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:59.559058  8994 raft_consensus.cc:1081] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:58:59.567016  7752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60268
I20260501 13:58:59.567637  7752 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:58:59.567999  7752 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.576682  7752 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.584311  9046 ts_tablet_manager.cc:933] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:59.592603  7752 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:59.597494  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:58:59.597815  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:58:59.598181  7678 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:58:59.598507  7678 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:58:59.598507  7827 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.602424  7678 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.605607  7678 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:58:59.617187  7678 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:59.618815  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:58:59.620112  9002 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:58:59.620760  9002 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:58:59.621971  9002 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:58:59.635625  7827 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:58:59.654145  7827 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:59.655638  8988 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.650403  9046 tablet_copy_client.cc:323] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 13:58:59.658366  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet a769b271cb04497eb1cb86169399ceb2 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 13:58:59.658892  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet a769b271cb04497eb1cb86169399ceb2 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-a769b271cb04497eb1cb86169399ceb2
I20260501 13:58:59.667661  7764 tablet_copy_source_session.cc:215] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:59.671460  9046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a769b271cb04497eb1cb86169399ceb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:58:59.676967  9049 ts_tablet_manager.cc:933] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:58:59.680070  9043 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:58:59.689395  7574 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:58:59.682196  9043 tablet_bootstrap.cc:492] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:58:59.705350  9043 ts_tablet_manager.cc:1403] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.015s
I20260501 13:58:59.716174  9049 tablet_copy_client.cc:323] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 13:58:59.757861  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 4262547d9184416ab702339797bead6f from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 13:58:59.758437  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 4262547d9184416ab702339797bead6f from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-4262547d9184416ab702339797bead6f
I20260501 13:58:59.773422  7838 tablet_copy_source_session.cc:215] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:58:59.792048  9053 ts_tablet_manager.cc:933] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:58:59.801668  7677 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:59.804123  8883 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.808169  7750 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:59.810166  8988 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.810667  9043 raft_consensus.cc:359] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:59.819137  9043 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:58:59.871973  9043 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:58:59.894757  9043 ts_tablet_manager.cc:1434] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.189s	user 0.004s	sys 0.007s
I20260501 13:58:59.917609  9049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262547d9184416ab702339797bead6f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 13:58:59.948764  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 95989.5us
I20260501 13:58:59.901021  9053 tablet_copy_client.cc:323] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 13:58:59.955479  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-367eab87da314007b62b7bd0a0905d38 received from {username='slave'} at 127.0.0.1:45436
I20260501 13:58:59.956050  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-367eab87da314007b62b7bd0a0905d38 on tablet 367eab87da314007b62b7bd0a0905d38 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:58:59.960726  7820 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:58:59.961952  8377 raft_consensus.cc:1217] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:58:59.962146  7824 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:58:59.967209  9057 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:58:59.979027  9056 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:58:59.983837  9046 tablet_copy_client.cc:806] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:59:00.009016  9046 tablet_copy_client.cc:670] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
W20260501 13:59:00.014101  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48964.8us
I20260501 13:59:00.016755  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 1f875366331345f08d2e236a76c1c71d from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 13:59:00.017769  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 1f875366331345f08d2e236a76c1c71d from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-1f875366331345f08d2e236a76c1c71d
I20260501 13:59:00.040192  7764 tablet_copy_source_session.cc:215] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:59:00.038570  9046 tablet_copy_client.cc:538] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260501 13:59:00.116338  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50867.9us
W20260501 13:59:00.199015  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 66584.8us
I20260501 13:59:00.218163  9053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f875366331345f08d2e236a76c1c71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:59:00.254499  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:00.264977  9049 tablet_copy_client.cc:806] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:59:00.266155  9049 tablet_copy_client.cc:670] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
W20260501 13:59:01.040982  7792 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.003s	sys 0.014s
W20260501 13:59:01.110731  7792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.003s	sys 0.015s
W20260501 13:59:01.113092  7793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.002s
W20260501 13:59:01.112190  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.013s
W20260501 13:59:01.122449  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.003s	sys 0.013s
I20260501 13:59:01.200042  9076 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.200774  9076 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.201524  9046 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:59:01.202927  9076 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.243970  9090 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.241889  9077 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.244638  9090 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.247367  8994 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.248204  9077 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.258108  9077 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.259966  9090 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.260978  9093 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:01.408437  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.012s	sys 0.052s
W20260501 13:59:01.408912  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.012s	sys 0.052s
W20260501 13:59:01.450434  8343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.018s	sys 0.038s
W20260501 13:59:01.450950  8343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.018s	sys 0.038s
I20260501 13:59:01.261518  9093 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:01.451719  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.015s	sys 0.047s
I20260501 13:59:01.327493  9056 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:01.469887  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.016s	sys 0.047s
I20260501 13:59:01.323370  8994 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.452389  9088 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.457978  9077 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.464390  9090 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.474310  9082 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.488498  9075 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.471658  9056 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.483513  9090 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.546939  9094 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.480242  9077 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.547756  9094 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.549754  9077 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.552872  9101 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.553606  9101 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.555758  9107 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.556070  9101 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.498816  9082 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.559664  9107 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.487053  9088 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.510591  9089 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.550446  9094 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.566489  9099 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.550467  9077 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.578054  9077 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.567687  8994 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.577317  9094 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.582584  9094 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.587896  9096 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.588593  9096 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.572974  9090 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.575356  9103 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.595429  9102 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.579536  9089 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.595672  9107 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.596077  9094 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.602412  9089 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.583763  9082 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:01.564687  9075 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.594867  9086 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.592270  9091 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.610550  9088 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.613327  9056 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.604800  9093 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.605876  9103 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.593549  9099 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.615056  9086 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.618974  9093 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.627931  9088 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.609620  9102 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.626066  9056 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:01.630411  9077 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.631701  9093 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.620877  9091 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.638639  8994 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.633303  9088 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.635330  9096 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.637964  9107 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.664170  9108 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:01.665460  9111 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.639205  9104 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.637197  9056 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.649314  9096 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.666081  9111 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:01.674022  9091 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.675213  9086 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.664829  9108 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.685097  9099 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.650328  8994 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.666963  9107 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.686690  9086 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:01.693893  9093 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.678036  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 884) took 1628 ms. Trace:
I20260501 13:59:01.708369  7677 rpcz_store.cc:276] 0501 13:59:00.047580 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:00.047721 (+   141us) service_pool.cc:224] Handling call
0501 13:59:00.050366 (+  2645us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:00.055779 (+  5413us) raft_consensus.cc:1534] Early marking committed up to index 2
0501 13:59:00.187698 (+131919us) log.cc:844] Serialized 14 byte log entry
0501 13:59:01.675847 (+1488149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:01.675943 (+    96us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:01.676012 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:01.676119 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:01.676323 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4172,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":2439,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":2701,"thread_start_us":65268,"threads_started":1}
I20260501 13:59:01.689200  9096 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.713644  9103 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.697036  9075 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.680357  9104 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.733695  9111 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.734596  9111 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.735468  9111 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.738087  9111 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.743072  9102 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.744822  8994 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.749991  9108 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.718713  9086 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.769984  9096 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.771088  9104 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.759296  9110 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.775240  9116 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.773589  9113 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:01.779559  9086 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.779672  9056 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.780622  9088 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.784682  9053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:51762 (request call id 122) took 2063 ms. Trace:
I20260501 13:59:01.781428  9113 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.789618  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:01.793715  9104 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:01.793921  9086 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.794688  9086 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.782802  9112 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:01.798105  9001 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.786834  9056 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.801841  9119 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.802846  9086 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.775866  9116 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.804129  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:01.799453  9104 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.803445  9056 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:01.810081  9096 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.810762  9096 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.812618  8994 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:01.812741  9096 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.813263  8994 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.815059  8994 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.778714  9110 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.817574  9117 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:01.817613  9115 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.818533  9110 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.818324  9117 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.818360  9115 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:01.820569  8994 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:01.821360  8994 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:01.798337  9112 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.819167  9110 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.832078  9116 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.832978  9116 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.833664  9116 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.802582  9119 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.836434  9116 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.837138  9116 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.837823  9116 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.788722  9053 rpcz_store.cc:276] 0501 13:58:59.720685 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:58:59.720849 (+   164us) service_pool.cc:224] Handling call
0501 13:58:59.792480 (+ 71631us) ts_tablet_manager.cc:934] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
0501 13:59:00.048283 (+255803us) tablet_copy_client.cc:368] Tablet copy session begun
0501 13:59:01.193573 (+1145290us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:01.199569 (+  5996us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 13:59:01.768350 (+568781us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 13:59:01.783583 (+ 15233us) tablet_replica.cc:206] Creating consensus instance
0501 13:59:01.784221 (+   638us) ts_tablet_manager.cc:989] Replica registered.
0501 13:59:01.784292 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":48678,"tablet-copy.queue_time_us":53279,"thread_start_us":52269,"threads_started":2}
I20260501 13:59:01.841106  9053 tablet_copy_client.cc:806] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:59:01.840945  9120 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.841599  9113 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.841852  9104 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.806326  9107 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.805987  9108 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.798640  9001 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.808568  9086 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.841861  9053 tablet_copy_client.cc:670] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:59:01.846864  9108 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.844812  9110 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.850337  8994 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.851195  9115 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.849177  9121 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.842064  9120 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.878000  9112 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.852579  9086 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:01.871758  9116 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.880659  9056 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.887804  9108 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.890652  9001 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.892239  9119 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.879868  9121 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.889991  9110 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.896750  9117 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:01.899314  9121 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.908263  9120 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.907505  9086 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:01.910504  9117 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:01.911164  9117 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.914583  9117 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.994294  9073 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:01.995044  9073 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:01.998800  9073 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:01.999624  9073 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.000337  9073 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.003043  9073 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.005820  9073 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.006188  9123 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.006377  9073 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.006861  9123 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.009409  9124 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.010854  9073 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.012354  9124 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.011067  9125 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:02.011521  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.792s	user 0.013s	sys 0.026s
I20260501 13:59:02.013470  9073 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:02.015746  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.796s	user 0.014s	sys 0.026s
W20260501 13:59:02.013015  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.909s	user 0.017s	sys 0.028s
I20260501 13:59:02.015972  9073 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.018904  9073 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.022495  9073 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:02.016539  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.915s	user 0.018s	sys 0.029s
W20260501 13:59:02.023079  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 1.92123e+06us
I20260501 13:59:02.024114  9123 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.029543  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.029961  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.030864  7752 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:02.015010  9125 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.031984  9123 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.032605  9123 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.034497  9123 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.038995  9085 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.039032  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.040043  7752 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:02.034590  9125 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.024580  9126 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.042174  9100 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.044831  9099 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.045089  9115 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.065135  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.065996  7752 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:02.023069  9073 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:02.067257  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.041018  9085 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.082477  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.083341  7752 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:02.056540  9126 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.064555  9099 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.095719  9073 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.092212  9124 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.093994  9078 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.085070  9123 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:02.110414  7717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.890s	user 0.006s	sys 0.033s
I20260501 13:59:02.118046  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 276) took 1852 ms. Trace:
I20260501 13:59:02.118602  9126 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.118489  7576 rpcz_store.cc:276] 0501 13:59:00.264767 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:01.196116 (+931349us) service_pool.cc:224] Handling call
0501 13:59:02.117320 (+921204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2261,"reported_tablets":1}
I20260501 13:59:02.090031  9075 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.119794  9075 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.122388  9075 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.080576  9115 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.091717  9117 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.097319  9099 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.125416  9085 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:02.133003  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.913s	user 0.024s	sys 0.055s
W20260501 13:59:02.140272  7717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.921s	user 0.007s	sys 0.033s
I20260501 13:59:02.167646  9112 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:02.168485  9112 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.171196  9112 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.117542  9123 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:02.179759  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.963s	user 0.025s	sys 0.055s
I20260501 13:59:02.141741  9099 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.096832  9078 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.186800  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.187736  9112 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.090986  9100 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.192970  7751 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:02.141402  9117 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.185601  8876 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:02.203390  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.199266  9125 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.206634  8876 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.210928  9127 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.211481  9127 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.213521  9127 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.206987  9128 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.215086  9128 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.215263  9125 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.224829  9123 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.211503  8876 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.225677  9130 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.225889  8876 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.226071  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.226197  9130 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.216197  9126 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:02.227083  7752 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:02.227306  9126 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.228457  9130 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.228739  9100 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.230280  9078 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.200584  9112 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:02.230856  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.232332  9112 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.231614  8379 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:02.234993  9117 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.235692  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.236395  8377 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.229426  9115 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.229295  9126 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.226346  8876 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.238205  9128 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.195729  9099 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:02.239681  8876 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.240082  9099 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.220412  9129 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.241039  9129 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.267836  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.275344  7751 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:02.280067  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.280992  7751 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.282495  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.279667  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.277705  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.285115  7747 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
W20260501 13:59:02.285766  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 90341us
I20260501 13:59:02.287386  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.289091  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.284904  9129 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.297807  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.301038  7747 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.300314  8876 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.302971  8876 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.303997  9073 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.305028  8876 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.294610  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.305510  9073 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.295113  9127 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.307861  9127 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.319624  9115 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.321563  9115 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.330542  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.330345  8876 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.333884  8876 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.336374  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.337050  9079 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.337462  9079 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.337865  9079 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.338197  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.338829  7753 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.344776  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.345077  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.345918  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.346541  7753 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.348246  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.352957  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.353406  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.351625  9076 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.354791  9076 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.355333  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.356217  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.350481  8946 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.354040  7747 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.342144  8876 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.366101  8946 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.366531  9061 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.368896  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.371502  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:02.376024  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44677.5us
I20260501 13:59:02.376214  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.377651  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.377115  7827 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:02.378238  7824 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:02.378536  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.379364  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.379992  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.380642  7822 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:02.379530  9061 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.378610  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.381954  7828 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:02.360452  9127 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.388173  9100 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.392346  9100 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.392772  9100 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.388239  9088 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.394636  9088 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.388939  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.398465  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.395028  9088 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.375663  9115 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.425542  9073 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.425976  8946 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.445448  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.453928  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:02.454758  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 56405us
I20260501 13:59:02.454416  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:02.452697  9046 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260501 13:59:02.457872  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.460609  7675 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.461241  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.462117  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.465030  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.465734  7827 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:02.454711  9109 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.452968  9136 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.467971  9061 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.472076  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.473825  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.474471  7673 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.471414  9136 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.476347  9136 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.474346  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.474323  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.470561  9109 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.484161  9109 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.484278  9137 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.470834  9073 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.484974  9137 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.485944  9073 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.466739  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.486511  9073 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.486883  7677 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.488266  9137 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.488850  9137 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.489187  9137 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.490419  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.490540  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.486496  9076 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.492774  9137 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.493036  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.494736  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.495546  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.496158  7673 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.497762  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.498368  7828 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:02.498821  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.502859  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.507854  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.508746  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.510537  9046 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:59:02.511940  9046 tablet_bootstrap.cc:492] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:59:02.512950  9046 ts_tablet_manager.cc:1403] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 1.312s	user 0.059s	sys 0.038s
I20260501 13:59:02.513950  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.514580  7673 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.505244  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.531375  7677 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.504904  9009 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.526870  9136 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.503711  7820 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:02.533599  9009 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.541873  9009 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.536298  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.539542  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.534741  9088 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.567981  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:02.568645  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.569970  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 260) took 2492 ms. Trace:
I20260501 13:59:02.570516  7574 rpcz_store.cc:276] 0501 13:59:00.052097 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:00.052294 (+   197us) service_pool.cc:224] Handling call
0501 13:59:02.544135 (+2491841us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8092,"reported_tablets":1}
I20260501 13:59:02.578540  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.579312  7748 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.579571  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.581054  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.583140  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.585054  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.583757  8381 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.584483  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.587101  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.587327  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.586520  7753 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:02.590428  8896 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.592399  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.593004  7825 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:02.592424  8896 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.600303  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.603101  7819 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:02.603192  9136 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.605660  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.612210  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.589682  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.613159  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:02.614542  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.615224  8377 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:02.616186  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.616326  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.616902  8377 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:02.617597  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.617753  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:02.618294  7753 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.620046  8371 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:02.623613  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:02.600376  8896 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.626943  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.628687  9060 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.629096  9060 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.628530  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.629994  7825 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:02.629448  9060 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.623514  9106 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.634119  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.637387  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.623368  9123 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.647203  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.648747  9062 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.651095  9062 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.651197  7677 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.647872  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.640498  9061 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.651558  9062 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.632503  9098 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:02.659221  9088 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.659866  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.657102  9061 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.668314  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.689898  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.638285  9125 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.636270  9106 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.693039  9106 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.649215  9123 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.676806  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.679170  9109 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.681015  9137 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.653064  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.654263  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.685791  9100 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.686873  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.688156  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.689142  7824 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:02.670895  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:02.694497  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 71108.5us
I20260501 13:59:02.691064  9061 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.694183  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:02.696427  9123 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.705044  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.706315  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.707077  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.708483  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.711273  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.698271  9085 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.705749  9125 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:02.714641  9127 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.718052  9127 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.718456  9127 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.710868  9128 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.721711  9128 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.713496  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.708173  9124 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.714278  9137 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.715963  8372 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:02.716310  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.010s	sys 0.019s
I20260501 13:59:02.715966  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:02.714356  9121 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.732935  9121 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.733397  9121 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.734272  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.723126  7670 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.722250  9128 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:02.725996  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.725046  9124 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.705696  9095 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260501 13:59:02.730993  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.010s	sys 0.019s
I20260501 13:59:02.722609  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.732174  8374 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:02.729199  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.744055  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.745455  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.745715  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.747689  7670 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.748119  7676 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:02.751053  9120 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:02.751518  9120 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.752694  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:02.741178  9124 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.759755  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:02.723434  9085 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.743655  9095 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.763468  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.746551  9098 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:02.751920  9120 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:02.767083  9064 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:02.759395  9101 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:02.773101  7753 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:02.774574  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.781242  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.781626  7828 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:02.777459  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.728689  9073 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.782178  7676 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:02.762868  9009 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.759014  9086 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.790705  9009 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.764137  9095 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.781288  9101 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:02.801357  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.798163  9101 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:02.803786  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44105.9us
I20260501 13:59:02.805114  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:02.799346  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:02.779943  9064 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:02.808852  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.809551  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:02.793664  9100 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.795149  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:02.806239  9088 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:02.810124  7753 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.780166  9098 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.810940  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.792965  7822 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:02.818670  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:02.814566  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.819880  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:02.793504  9086 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.808578  9064 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.823163  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:02.790781  9046 raft_consensus.cc:359] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:02.826762  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:02.810204  9109 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:02.825228  8896 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.832486  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.840155  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.840895  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.842190  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.842504  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.843171  7675 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:02.835633  9066 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:02.843628  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.834672  9060 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.826002  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:02.838195  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.838425  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.833444  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.835844  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:02.827921  9088 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:02.838783  8896 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.832065  9046 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:59:02.844007  9010 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:02.869880  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.871062  9049 tablet_copy_client.cc:538] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:59:02.872126  7753 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:02.872887  9086 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:02.877259  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:02.877913  7827 raft_consensus.cc:606] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:02.864668  7677 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
W20260501 13:59:02.909420  7775 debug-util.cc:398] Leaking SignalData structure 0x7b08001651a0 after lost signal to thread 6457
I20260501 13:59:02.913622  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:02.918576  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 70500.3us
W20260501 13:59:02.919375  7775 debug-util.cc:398] Leaking SignalData structure 0x7b0800164880 after lost signal to thread 7611
I20260501 13:59:02.918705  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.888805  7823 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:02.921417  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:02.923277  7827 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:02.929888  9085 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:02.936193  7775 debug-util.cc:398] Leaking SignalData structure 0x7b080033bd60 after lost signal to thread 7703
I20260501 13:59:02.936616  9010 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 13:59:02.937544  7775 debug-util.cc:398] Leaking SignalData structure 0x7b08002f68e0 after lost signal to thread 7778
I20260501 13:59:02.912253  7677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:37076
W20260501 13:59:02.938868  7775 debug-util.cc:398] Leaking SignalData structure 0x7b080026df40 after lost signal to thread 7852
I20260501 13:59:02.938915  7677 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:02.946491  7753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "91854d93e96c4756834efe8b2ef59fce"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:02.949141  7753 raft_consensus.cc:606] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Received request to transfer leadership to TS 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:02.944078  9121 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.958282  9121 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:02.922195  8344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.515s (SENT) [suppressed 6 similar messages]
I20260501 13:59:02.962956  7825 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:02.910153  9146 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:02.975606  7753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b540df5a794f06ab617858163d4297"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:02.976322  7753 raft_consensus.cc:606] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:02.960240  9073 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:02.990869  9124 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.943794  9062 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.966974  9127 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:02.994403  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:02.998787  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.001119  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260501 13:59:03.001415  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 68338.4us
I20260501 13:59:03.002578  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:03.003232  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:03.007774  9086 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:03.008805  9097 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:03.009160  9097 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.009653  9106 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.010073  9097 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.011310  9097 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:02.979182  9088 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:02.924930  9046 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:03.000983  9140 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:02.997054  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.016927  7750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 1927) took 1002 ms. Trace:
I20260501 13:59:03.017541  9046 ts_tablet_manager.cc:1434] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.504s	user 0.008s	sys 0.006s
I20260501 13:59:03.013011  9123 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.035866  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.026221  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.037556  7753 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.028481  7750 rpcz_store.cc:276] 0501 13:59:02.014255 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:02.131149 (+116894us) service_pool.cc:224] Handling call
0501 13:59:02.131623 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:02.193903 (+ 62280us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:02.193939 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:02.193986 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:02.194015 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:03.016680 (+822665us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b54000af354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:03.016724 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:03.016843 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142706944}
I20260501 13:59:03.030908  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.013264  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.034536  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:03.046073  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 125784us
I20260501 13:59:03.049953  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:03.050617  8371 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.034996  9053 tablet_copy_client.cc:538] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:59:03.029671  9128 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.055531  9128 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:03.016263  9079 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.678s	user 0.022s	sys 0.003s
I20260501 13:59:03.058161  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.031394  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.056280  9079 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.011734  9106 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.032855  9127 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:03.022089  9140 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.024082  9100 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260501 13:59:03.023239  9062 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.030982  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:03.030804  9046 ts_tablet_manager.cc:1467] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Tablet startup took 517ms
I20260501 13:59:03.033394  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.033052  9060 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.066118  7748 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.061720  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:03.035290  7775 debug-util.cc:398] Leaking SignalData structure 0x7b08003256c0 after lost signal to thread 8405
I20260501 13:59:03.067217  7676 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:03.061997  9079 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.024222  9098 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:03.065189  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.060659  7753 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:03.070299  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.073311  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.062357  8376 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.081045  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.064764  9006 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.083962  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.069955  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:03.067281  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.064875  9140 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:03.076339  9127 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:03.063395  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:03.093719  9006 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.094106  8375 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:03.094771  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.094951  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.100517  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.100847  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.102646  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.102927  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.103415  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.101887  9101 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.107549  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:03.107549  8381 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.108714  9127 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:03.108760  9124 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:03.102738  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.072505  9123 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:03.115075  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:03.065927  9046 ts_tablet_manager.cc:1469] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Trace:
0501 13:58:59.516797 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:58:59.516944 (+   147us) service_pool.cc:224] Handling call
0501 13:58:59.584779 (+ 67835us) ts_tablet_manager.cc:934] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
0501 13:58:59.670072 (+ 85293us) tablet_copy_client.cc:368] Tablet copy session begun
0501 13:58:59.763979 (+ 93907us) tablet_metadata.cc:665] Metadata flushed
0501 13:58:59.764132 (+   153us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 13:58:59.982875 (+218743us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 13:58:59.983219 (+   344us) tablet_replica.cc:206] Creating consensus instance
0501 13:58:59.983568 (+   349us) ts_tablet_manager.cc:989] Replica registered.
0501 13:58:59.983630 (+    62us) inbound_call.cc:177] Queueing success response
0501 13:59:01.201087 (+1217457us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0501 13:59:02.513341 (+1312254us) ts_tablet_manager.cc:1435] Starting tablet replica
0501 13:59:02.659836 (+146495us) tablet_replica.cc:261] Starting instrumentation
0501 13:59:02.660453 (+   617us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":9527,"mutex_wait_us":9593,"raft.queue_time_us":117,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"tablet-copy.queue_time_us":52073,"tablet-download-pool.queue_time_us":308,"tablet-download-pool.run_cpu_time_us":1209,"tablet-download-pool.run_wall_time_us":20322,"thread_start_us":96706,"threads_started":2}
I20260501 13:59:03.065394  9062 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:03.116397  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.116644  9062 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.109714  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.116840  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:03.117667  7821 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:03.109166  9127 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:03.118135  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.070230  9061 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.117576  9144 raft_consensus.cc:1064] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:59:03.120157  7820 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:03.118157  9127 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.011809  9095 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.111263  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.111999  7753 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.117581  9062 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.111864  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:03.113677  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.126679  9006 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:03.113909  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.127359  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:03.110937  9049 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:59:03.114497  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:03.129914  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.131999  7747 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.133460  7823 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:03.133781  9144 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.132511  9098 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:03.136408  9098 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.138438  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.140899  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.141495  7753 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.144098  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.137219  9098 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.076515  9120 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.147266  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.131659  7574 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:03.151221  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.154353  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-a769b271cb04497eb1cb86169399ceb2 received from {username='slave'} at 127.0.0.1:42716
I20260501 13:59:03.154826  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-a769b271cb04497eb1cb86169399ceb2 on tablet a769b271cb04497eb1cb86169399ceb2 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:03.155360  9120 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.156553  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.157287  9061 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.132763  9006 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:03.158553  9006 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.159416  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.164158  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.164706  7750 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:03.164932  9053 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:59:03.125151  9095 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.172252  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.176630  9064 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.177887  7828 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:03.131045  9062 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.185393  7751 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:03.192359  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.175580  7746 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.193430  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.197045  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.199527  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.199988  7752 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:03.210479  7747 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:03.211508  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.208252  9101 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:03.213011  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:03.185873  9125 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260501 13:59:03.208580  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:03.213744  9142 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.228367  7750 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:03.229429  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:03.230512  7753 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:03.232798  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:03.215306  8371 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:03.233456  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.234970  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.235813  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.228379  9060 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:03.241654  7748 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:03.241959  9060 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.242864  9060 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.228932  9061 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260501 13:59:03.244009  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:03.244786  9120 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:03.245154  9120 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.246891  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.247336  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:03.245532  9061 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:03.237607  9095 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:03.237792  9079 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:03.261987  9079 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:03.262458  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.262933  9079 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.263585  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.264567  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.253188  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.265489  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.265990  7753 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.266665  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.267588  7675 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:03.268265  7750 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.268707  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.269308  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.272189  7753 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.258342  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.258522  9061 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.259095  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.260303  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:03.261214  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:03.293642  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.250804  9146 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
W20260501 13:59:03.295899  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:03.300014  7827 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.303994  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.303282  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.286828  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:03.308472  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.309744  7825 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.312086  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.313961  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.302590  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.315455  7819 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.317607  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.318217  7827 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:03.305394  9146 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.319438  7750 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.320258  9146 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.321769  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.322494  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.323562  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.324237  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.325416  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.327121  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.292791  9095 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:03.323648  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.328704  8381 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.328478  9095 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.337663  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.338416  7751 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.299310  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.345021  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.348034  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:03.302886  9003 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:03.350266  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:03.352947  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 64381.3us
I20260501 13:59:03.356770  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.358107  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.358016  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.360347  7753 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.361907  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.362893  8381 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:59:03.364336  7751 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:59:03.346539  9064 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:03.368602  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.353080  9003 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.371348  9003 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:03.373025  9127 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.375893  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.381390  9073 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:03.387163  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.390807  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.393108  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.365219  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.383236  9100 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260501 13:59:03.365775  9061 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.396212  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:03.396214  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.396764  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.398144  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.398347  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.405952  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.422122  9155 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.422530  9124 raft_consensus.cc:993] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower ca8dd10afb304b4c96cfcec7e2309947 to start an election
I20260501 13:59:03.420044  9066 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.423027  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:03.424701  7823 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.427335  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:03.375805  9127 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:03.434890  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.442646  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:03.444079  9092 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.444514  9092 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.444873  9092 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.446058  9165 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:03.451858  7747 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.454071  9120 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.458168  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.458673  9120 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.459197  9111 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:03.459992  9111 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.460369  9111 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.460536  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:03.461752  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.467403  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.469234  9155 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.486976  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.497043  7826 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:03.482014  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.499660  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.399120  9073 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:03.423048  9124 raft_consensus.cc:1081] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Signalling peer ca8dd10afb304b4c96cfcec7e2309947 to start an election
I20260501 13:59:03.496685  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.508220  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.510330  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.512848  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.515296  7827 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.496225  9100 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.502825  9085 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.517318  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:03.523952  7824 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.504635  9139 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.503193  9098 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260501 13:59:03.532318  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 79945.5us
I20260501 13:59:03.527376  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:03.534158  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:03.512436  9142 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.514930  9079 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.535365  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.516705  9066 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.527124  9010 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.614567  9111 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:03.602423  9138 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.603245  7822 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.605315  9092 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.527629  9006 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.538990  9140 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260501 13:59:03.609099  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 73818.5us
I20260501 13:59:03.633536  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.635025  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.518162  9095 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.539113  7820 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.528017  9085 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:03.641247  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 123552us
I20260501 13:59:03.536175  9098 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:03.522389  9100 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.646183  9100 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.648849  9111 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.650007  9098 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.596983  9146 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:03.630299  9006 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.652540  9006 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.641644  9095 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.653218  9095 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.529927  7819 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:03.638835  9092 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.656091  7825 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.656252  9106 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.656665  9106 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.657032  9106 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.640992  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.623710  9003 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.658437  9003 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.658840  9003 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.658978  8376 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:03.645056  9085 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.659057  9146 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.644693  9062 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:03.661628  9146 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.661867  9062 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.672152  9062 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.669703  7792 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.676527  9092 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:03.676923  9092 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.677260  9092 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.677922  9003 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:03.680423  9003 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:03.592900  9073 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:03.681807  9073 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.684177  7820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9b540df5a794f06ab617858163d4297"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:50954
I20260501 13:59:03.684906  7820 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:03.685379  7820 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:03.689026  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:03.693455  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:03.701370  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.703065  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:03.662128  9146 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.713673  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:03.718554  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:03.693770  9003 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:03.770394  7748 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:03.705431  8375 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:03.706660  9111 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:03.777454  7819 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:03.780797  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 246223us
I20260501 13:59:03.818171  7754 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:03.793020  9111 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:03.835337  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:03.904162  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 63152.1us
I20260501 13:59:03.824735  9111 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:03.837260  8376 raft_consensus.cc:1217] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:59:03.842658  9139 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:03.838732  9154 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
W20260501 13:59:03.962724  9170 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260501 13:59:03.906816  9166 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260501 13:59:03.940851  7748 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260501 13:59:03.964830  9169 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260501 13:59:03.951090  9139 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:03.992233  9178 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:03.993791  9092 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:03.933018  9088 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260501 13:59:03.970819  7819 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:04.042793  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 137510us
I20260501 13:59:03.955977  9098 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.057812  7824 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:04.045183  9163 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260501 13:59:03.999593  9178 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:04.061736  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 108505us
I20260501 13:59:04.089517  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:04.011302  9062 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.098869  9179 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260501 13:59:04.106319  9092 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.064543  9138 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260501 13:59:04.109704  9062 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.113940  7747 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:04.114598  7822 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:04.114876  9146 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.116396  7826 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.111423  9062 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260501 13:59:04.135596  9139 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.052129  9106 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.156255  7750 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:04.096297  9144 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:04.128551  9095 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.158154  7825 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.159272  9095 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.168056  7826 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.168807  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:04.148121  9100 consensus_meta.cc:287] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260501 13:59:04.184389  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.198114  8374 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:04.176040  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.090396  9006 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.196064  7819 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.175917  9100 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.194171  9138 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260501 13:59:04.229182  9006 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.231120  7750 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:04.232513  8377 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.245569  9140 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:04.246042  9140 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:04.246914  9140 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.199481  9178 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.248617  9140 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.200248  9086 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260501 13:59:04.200428  9144 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
W20260501 13:59:04.248842  9079 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.007s
I20260501 13:59:04.264181  7828 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:04.263447  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 328256us
W20260501 13:59:04.275714  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 458988us
W20260501 13:59:04.277223  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44740.7us
I20260501 13:59:04.234190  9106 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.278867  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.291458  7825 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:04.300932  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:04.278007  9079 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:04.263391  9078 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260501 13:59:04.305581  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:04.304307  9098 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:04.311715  9100 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.294013  9174 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260501 13:59:04.316449  7751 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:04.289064  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.318202  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:04.320554  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.309729  9158 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:04.294351  9165 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260501 13:59:04.290129  9154 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260501 13:59:04.290311  9073 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260501 13:59:04.378448  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 73407.8us
I20260501 13:59:04.298290  9138 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260501 13:59:04.345398  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54928.2us
I20260501 13:59:04.353211  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.317965  9146 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.308830  9123 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260501 13:59:04.281046  9167 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260501 13:59:04.353104  7820 consensus_meta.cc:287] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.007s
I20260501 13:59:04.344465  9187 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260501 13:59:03.688854  9125 consensus_queue.cc:1175] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca8dd10afb304b4c96cfcec7e2309947" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260501 13:59:04.289975  9155 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260501 13:59:04.330839  9133 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260501 13:59:04.332947  9098 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260501 13:59:04.376915  9158 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:04.421406  9085 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.002s
I20260501 13:59:04.416296  7820 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.422732  9174 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260501 13:59:04.447928  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:04.449044  9158 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:04.449306  7753 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:04.459774  9195 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:04.460224  9180 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:04.460896  9180 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.460364  9144 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:04.464232  9180 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:04.468312  9194 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260501 13:59:04.435416  9085 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.460294  9195 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:04.445595  9128 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260501 13:59:04.473760  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:04.479156  9186 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260501 13:59:04.461462  9174 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260501 13:59:04.480783  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 894) took 1039 ms. Trace:
I20260501 13:59:04.481197  7828 rpcz_store.cc:276] 0501 13:59:03.441830 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:03.456036 (+ 14206us) service_pool.cc:224] Handling call
0501 13:59:03.456553 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:04.274821 (+818268us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:04.480506 (+205685us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54003c8054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:04.480715 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856769792}
I20260501 13:59:04.481683  9085 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.483353  7822 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.475361  7823 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:04.493078  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.475927  9168 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:04.503659  9168 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:04.483377  9195 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.503996  9198 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:04.504441  9198 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:04.476130  7820 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.478073  8379 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:04.495437  8377 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:04.516187  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:04.504810  9195 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:04.533700  9053 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.222s	user 0.003s	sys 0.001s
I20260501 13:59:04.521056  9078 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:04.544219  7746 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:04.543944  9053 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 13:59:04.511840  9198 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.554695  9140 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260501 13:59:04.504765  9168 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.557030  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:04.557852  7752 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:04.558214  7752 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:04.540944  9078 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:04.559121  7752 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.562003  7752 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:04.564882  9086 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:04.561609  9078 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.576529  9178 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.571810  9086 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.579551  9196 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:04.571152  9168 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.573722  9198 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.591043  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:04.591742  7747 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:04.586908  9053 tablet_bootstrap.cc:492] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:59:04.586709  9100 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:04.609822  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:04.610495  9100 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.587641  9196 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:04.619684  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 239123us
I20260501 13:59:04.630630  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:04.633754  9123 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:04.634209  9123 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:04.635315  9123 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.636956  9123 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.622015  9053 ts_tablet_manager.cc:1403] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 1.457s	user 0.037s	sys 0.010s
W20260501 13:59:04.625257  9111 consensus_meta.cc:287] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.009s
I20260501 13:59:04.632893  9049 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260501 13:59:04.657943  8344 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.515s (SENT)
I20260501 13:59:04.658509  9133 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:04.683533  9154 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:04.685580  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:04.703775  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45884.4us
I20260501 13:59:04.693261  9133 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:04.701344  9142 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:04.701212  9200 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
W20260501 13:59:04.714754  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 313075us
I20260501 13:59:04.693660  9111 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.707266  9207 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:04.746768  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 158423us
I20260501 13:59:04.709730  9100 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:04.707734  9009 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:04.699330  9154 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.769299  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:04.770190  7754 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:04.771302  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:04.772874  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:04.746521  9142 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.772063  7747 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:04.777895  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:04.787681  7752 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:04.745592  9049 tablet_bootstrap.cc:492] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:59:04.743330  9200 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:04.704293  9167 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260501 13:59:04.807834  7827 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:04.697662  9196 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.762200  9086 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:04.745855  9181 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:04.769325  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:04.790278  9165 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:04.809616  9098 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:04.806892  7820 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:04.815985  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:04.837494  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:04.863186  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 47292.9us
W20260501 13:59:04.868088  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:04.868383  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:04.869266  8379 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:04.864187  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:04.871182  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:04.834576  9049 ts_tablet_manager.cc:1403] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 1.743s	user 0.023s	sys 0.035s
I20260501 13:59:04.825273  9165 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:04.809674  9207 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:04.825376  8373 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:04.871104  9196 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.883369  9085 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:04.886127  9060 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260501 13:59:04.923838  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.599s (SENT)
I20260501 13:59:04.898245  9211 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:04.887034  9098 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:04.828558  9073 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260501 13:59:04.895939  9154 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:04.903388  9165 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:04.912083  9061 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:04.826009  9181 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:04.937814  9085 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:04.944429  9211 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:04.940909  9060 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:04.813308  9133 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:04.966845  9213 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260501 13:59:04.933849  9140 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260501 13:59:04.955924  9226 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260501 13:59:04.974809  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 103745us
I20260501 13:59:04.996658  9111 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:04.962177  9085 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:04.980437  9220 consensus_queue.cc:1175] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "91854d93e96c4756834efe8b2ef59fce" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20260501 13:59:04.980690  9207 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:04.930617  9200 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.036859  9200 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:04.962390  9061 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:04.966028  9060 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:04.991179  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:04.971642  8375 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:04.981148  9142 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:04.998574  9181 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:04.966874  9211 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:04.929775  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 56409.6us
I20260501 13:59:05.019711  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:05.020727  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:05.010211  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:05.021554  9053 raft_consensus.cc:359] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:05.026870  9227 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260501 13:59:04.993206  9098 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.073228  9085 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.074371  7826 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:05.082780  9085 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:05.092288  9078 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.003s
I20260501 13:59:05.092908  9078 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.048151  9211 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.094254  7822 raft_consensus.cc:2368] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3.
I20260501 13:59:05.096274  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:05.096773  7825 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:05.097246  7820 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:05.048069  9123 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:05.098278  9123 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.098191  7828 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:05.098698  9123 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.049115  9207 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:59:05.049412  9215 consensus_queue.cc:1059] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260501 13:59:05.055112  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.056670  9061 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:05.112229  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 481676us
I20260501 13:59:05.113027  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:05.062484  9165 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.114259  9215 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.114666  9215 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.116043  9165 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:05.093207  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.660s (SENT)
I20260501 13:59:05.116796  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:05.107012  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.112726  9123 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.046103  9053 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 13:59:05.128624  9053 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:05.130016  9123 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:05.132781  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.116429  9215 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.072683  9049 raft_consensus.cc:359] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:05.046294  9144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.015s
I20260501 13:59:05.120889  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:05.118366  9079 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260501 13:59:05.123039  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.123745  9207 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260501 13:59:05.153021  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.126318  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:05.126410  9078 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:05.138321  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 906) took 1317 ms. Trace:
I20260501 13:59:05.138832  9049 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
W20260501 13:59:05.242200  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 97253.4us
I20260501 13:59:05.141448  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:05.099023  9060 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:05.228389  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.243870  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 102467us
W20260501 13:59:05.146015  9144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.007s	sys 0.016s
I20260501 13:59:05.136180  9165 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260501 13:59:05.286545  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.278306  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260501 13:59:05.287243  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.123245  9168 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
W20260501 13:59:05.241714  9178 consensus_meta.cc:287] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.005s
I20260501 13:59:05.286568  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:05.279102  9215 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.282159  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:05.190562  9231 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:05.311164  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.264005  9210 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:05.305397  9170 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260501 13:59:05.301884  7820 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:05.301229  9165 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:05.293699  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:05.316876  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:05.319119  8376 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.324049  7819 raft_consensus.cc:2368] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
W20260501 13:59:05.324402  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 104101us
I20260501 13:59:05.327294  9182 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:05.329511  9060 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:05.330605  9053 ts_tablet_manager.cc:1434] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.674s	user 0.008s	sys 0.001s
W20260501 13:59:05.331800  9053 ts_tablet_manager.cc:1467] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Tablet startup took 676ms
I20260501 13:59:05.331537  9182 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:05.333002  8344 leader_election.cc:336] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.608s (SENT)
I20260501 13:59:05.333325  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.313838  9211 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:05.335433  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:05.339253  9182 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:05.339975  9231 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.343732  9158 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:05.344141  9158 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.345208  9158 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.346521  9158 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:05.282152  9049 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:05.350461  9125 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:05.350870  9125 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.351769  9125 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:05.333564  9165 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:05.357255  8376 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:05.356570  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:05.332239  9053 ts_tablet_manager.cc:1469] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Trace:
0501 13:58:59.720685 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:58:59.720849 (+   164us) service_pool.cc:224] Handling call
0501 13:58:59.792480 (+ 71631us) ts_tablet_manager.cc:934] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
0501 13:59:00.048283 (+255803us) tablet_copy_client.cc:368] Tablet copy session begun
0501 13:59:01.193573 (+1145290us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:01.199569 (+  5996us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 13:59:01.768350 (+568781us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 13:59:01.783583 (+ 15233us) tablet_replica.cc:206] Creating consensus instance
0501 13:59:01.784221 (+   638us) ts_tablet_manager.cc:989] Replica registered.
0501 13:59:01.784292 (+    71us) inbound_call.cc:177] Queueing success response
0501 13:59:03.164560 (+1380268us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0501 13:59:04.656758 (+1492198us) ts_tablet_manager.cc:1435] Starting tablet replica
0501 13:59:04.976922 (+320164us) tablet_replica.cc:261] Starting instrumentation
0501 13:59:05.019664 (+ 42742us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":48678,"mutex_wait_us":31911,"raft.queue_time_us":63239,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":19125,"tablet-copy.queue_time_us":53279,"tablet-download-pool.queue_time_us":3397,"tablet-download-pool.run_cpu_time_us":5596,"tablet-download-pool.run_wall_time_us":1181411,"thread_start_us":52269,"threads_started":2}
I20260501 13:59:05.360328  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.361795  9200 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.326622  9178 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260501 13:59:05.369947  9178 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:05.370427  9178 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:05.371413  9178 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.372789  9178 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:05.337266  9196 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:05.356221  9123 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:05.244992  7823 rpcz_store.cc:276] 0501 13:59:03.820831 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:03.824463 (+  3632us) service_pool.cc:224] Handling call
0501 13:59:03.906033 (+ 81570us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:04.505651 (+599618us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:05.138017 (+632366us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400297a54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:05.138234 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261851904}
I20260501 13:59:05.347867  9231 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260501 13:59:05.360028  9167 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:05.376500  9167 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:05.376902  9167 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:05.378724  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.384023  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.399713  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65488.1us
I20260501 13:59:05.377112  9073 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:05.407910  7823 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:05.406497  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.410866  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:05.413859  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.413774  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 54022.9us
I20260501 13:59:05.414971  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.416741  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.407121  9181 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.418331  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.410738  9088 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:05.420969  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.416038  9231 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.425339  8344 leader_election.cc:400] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:05.425807  8344 leader_election.cc:403] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:05.423101  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.413506  9215 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.413446  9123 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260501 13:59:05.432909  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:05.420074  9196 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:05.448192  9196 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:05.448640  9196 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.449532  9142 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.413414  9073 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.446755  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:05.420682  9200 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:05.456481  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:05.457132  7753 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.457923  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:05.458746  7745 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.424263  9211 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:05.467410  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:05.468914  7751 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.425058  9088 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.490010  9197 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.490528  9197 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.492379  9197 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.468468  9049 ts_tablet_manager.cc:1434] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.571s	user 0.010s	sys 0.003s
W20260501 13:59:05.496534  9049 ts_tablet_manager.cc:1467] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Tablet startup took 601ms
I20260501 13:59:05.497345  9073 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:05.468312  9231 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.466324  9200 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:05.501963  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 905) took 1682 ms. Trace:
I20260501 13:59:05.468983  9085 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:05.499735  9197 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.485126  9088 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:05.504535  7827 rpcz_store.cc:276] 0501 13:59:03.819742 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:03.819877 (+   135us) service_pool.cc:224] Handling call
0501 13:59:03.820114 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:04.815021 (+994907us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:05.487648 (+672627us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b540025f654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:05.501896 (+ 14248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269692672}
W20260501 13:59:05.519037  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 51695.6us
I20260501 13:59:05.510578  7753 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:05.509536  9200 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.526036  9111 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:05.526690  9111 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:05.533057  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:05.533746  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.508740  9085 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.533420  7745 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:05.481417  9211 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:05.543011  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.553519  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:05.554725  7745 raft_consensus.cc:2368] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
W20260501 13:59:05.496855  9049 ts_tablet_manager.cc:1469] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Trace:
0501 13:58:59.646507 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:58:59.646671 (+   164us) service_pool.cc:224] Handling call
0501 13:58:59.680450 (+ 33779us) ts_tablet_manager.cc:934] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
0501 13:58:59.780169 (+ 99719us) tablet_copy_client.cc:368] Tablet copy session begun
0501 13:59:00.001173 (+221004us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:00.001321 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 13:59:00.263933 (+262612us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 13:59:00.264327 (+   394us) tablet_replica.cc:206] Creating consensus instance
0501 13:59:00.264672 (+   345us) ts_tablet_manager.cc:989] Replica registered.
0501 13:59:00.264749 (+    77us) inbound_call.cc:177] Queueing success response
0501 13:59:01.744431 (+1479682us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18002fe3c0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2f7475e88 00007fb2f7643422 00007fb2ff667423 00007fb2ff666c5d 00007fb2ff702a98 00007fb2ff73460e 00007fb2ff71969d
0501 13:59:03.090940 (+1346509us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0501 13:59:04.900211 (+1809271us) ts_tablet_manager.cc:1435] Starting tablet replica
0501 13:59:04.966936 (+ 66725us) tablet_replica.cc:261] Starting instrumentation
0501 13:59:04.970746 (+  3810us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":1508,"mutex_wait_us":39226,"raft.queue_time_us":37835,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":3644800,"tablet-copy.queue_time_us":29726,"tablet-download-pool.queue_time_us":6153,"tablet-download-pool.run_cpu_time_us":4216,"tablet-download-pool.run_wall_time_us":2586118,"thread_start_us":63961,"threads_started":2}
I20260501 13:59:05.494810  8374 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:05.564071  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 141025us
I20260501 13:59:05.565014  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.553485  9211 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:05.566520  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.528273  9073 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260501 13:59:05.560882  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:05.573167  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 152885us
I20260501 13:59:05.573451  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.575273  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.576800  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:05.577773  7745 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:05.566926  9239 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:05.579169  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:05.579154  9196 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.610286  9196 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:05.610988  9196 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:05.611912  9196 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:05.612241  9196 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.613001  9241 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:05.613672  9241 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:05.568264  9111 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.573220  9231 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.614115  9241 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:05.629748  8381 raft_consensus.cc:1217] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260501 13:59:05.630865  7751 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:05.632227  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-1f875366331345f08d2e236a76c1c71d received from {username='slave'} at 127.0.0.1:42716
W20260501 13:59:05.633246  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.618662  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.577543  7819 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:05.621201  9155 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.624979  8372 raft_consensus.cc:1217] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260501 13:59:05.640708  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.581372  9239 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:05.643472  9231 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:05.643607  9239 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.643985  9231 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:05.632718  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-1f875366331345f08d2e236a76c1c71d on tablet 1f875366331345f08d2e236a76c1c71d with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:05.638675  9155 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.637495  9128 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:05.653486  9128 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.653827  9155 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.655104  9155 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.633071  9166 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.664260  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:05.644490  9231 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.655644  9128 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:05.684954  8381 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:05.685920  7819 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:05.667495  9166 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:05.692198  9187 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:05.692502  9215 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.692800  9187 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:05.693101  9215 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:05.694049  9187 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.694303  9215 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.691601  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:05.696081  7827 raft_consensus.cc:606] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:05.718799  9207 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:05.731182  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:05.731534  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.733371  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.738415  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:05.739313  7745 raft_consensus.cc:606] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:05.740406  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:05.745688  8344 leader_election.cc:400] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:05.745946  9246 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260501 13:59:05.716607  9085 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:05.746234  9088 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.757552  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:05.760329  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.728206  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:05.769047  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.747741  9142 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:05.689589  9245 consensus_queue.cc:1059] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260501 13:59:05.690840  9167 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:05.842886  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 82653.9us
I20260501 13:59:05.702111  9060 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260501 13:59:05.837474  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.839883  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 80209.5us
I20260501 13:59:05.726297  9166 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.846187  9166 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.849166  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:05.849835  7750 raft_consensus.cc:606] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.850133  7750 raft_consensus.cc:614] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:05.836571  9247 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:05.848680  9224 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
W20260501 13:59:05.873981  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.876487  9236 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.509s	user 0.004s	sys 0.000s
I20260501 13:59:05.878087  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:05.858179  9133 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:05.901393  7750 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:05.871089  9210 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
W20260501 13:59:05.904430  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 232953us
I20260501 13:59:05.872851  9247 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:05.886919  9224 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:05.900686  9165 consensus_meta.cc:287] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.001s
I20260501 13:59:05.905313  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:05.913841  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.917052  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.918285  7827 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:05.920810  9158 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260501 13:59:05.903383  9178 consensus_meta.cc:287] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.006s
I20260501 13:59:05.901049  9144 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:05.899611  9197 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:05.924039  9245 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:05.936232  9251 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:05.937342  9178 raft_consensus.cc:3055] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:05.903944  9210 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:05.902480  7677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:37076
I20260501 13:59:05.908478  9247 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:05.941231  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:05.952589  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.941388  9197 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.949299  9178 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:05.940990  9195 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:05.962888  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 57721.2us
I20260501 13:59:05.958514  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:05.964051  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.964326  7827 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:05.954619  9258 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:05.965405  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:05.962096  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 57073.5us
I20260501 13:59:05.959487  9088 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:05.967556  9224 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.972890  9224 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:05.974380  9211 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.978340  9211 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:05.979506  9203 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:05.980144  9203 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:05.980625  9203 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:05.959491  9231 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:05.956861  9197 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:05.925854  9165 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:06.059768  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.143324  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.050113  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 86137.8us
W20260501 13:59:06.143885  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.033553  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 63529.1us
W20260501 13:59:06.144543  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.144655  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:06.058367  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.145949  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.960561  9174 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:05.958477  9144 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:06.154350  8381 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:05.957902  9178 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.954273  9245 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:05.992452  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.155269  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:05.959563  9242 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:06.166479  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.141532  9243 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:06.156688  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:06.146308  9158 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:05.958457  7677 raft_consensus.cc:606] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:05.984334  9154 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:05.958843  9195 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.054283  9167 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.053536  9211 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:05.984226  8371 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:06.052866  9061 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:06.045377  9066 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:05.966043  9258 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:05.985075  9060 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.203s
W20260501 13:59:06.225894  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.185194  9242 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:06.186703  7677 raft_consensus.cc:614] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:06.235323  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68888.6us
I20260501 13:59:06.184973  9154 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:06.173729  9257 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:06.249367  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:05.958300  9210 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:06.280386  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.252136  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.229496  9178 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:06.240243  9241 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.004s
I20260501 13:59:06.251245  7643 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.251562  9211 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260501 13:59:06.328686  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.189167  9158 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.251688  9257 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:05.967072  9251 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.228904  9261 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260501 13:59:06.312736  9239 consensus_meta.cc:287] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.007s
W20260501 13:59:06.342905  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.253885  9188 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:06.232388  9061 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.357962  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260501 13:59:06.358609  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 202050us
W20260501 13:59:06.343963  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 92809.2us
I20260501 13:59:06.363651  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.364886  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.297145  9262 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:06.366640  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.367969  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.368556  7745 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:06.230800  9243 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.349484  9167 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.251659  9242 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.345264  9257 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.361001  9211 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:06.366582  9253 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.369992  9174 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.372951  9261 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.376719  9245 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.254153  9144 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.380043  9188 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:06.352995  9241 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:06.391649  9231 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.389123  9165 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:06.410445  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.396858  9167 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.412277  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:06.390305  7822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 913) took 1370 ms (client timeout 1706 ms). Trace:
I20260501 13:59:06.367695  9154 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.353735  9239 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:06.410467  9200 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.887s	user 0.004s	sys 0.010s
I20260501 13:59:06.395272  9060 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260501 13:59:06.409161  9195 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.394748  9211 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.426134  9258 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:06.436024  9259 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.203s	user 0.001s	sys 0.002s
W20260501 13:59:06.416184  7822 rpcz_store.cc:269] 0501 13:59:05.013533 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:05.017837 (+  4304us) service_pool.cc:224] Handling call
0501 13:59:06.372973 (+1355136us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54002607d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:06.380402 (+  7429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115810560}
I20260501 13:59:06.413718  9174 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:06.417986  9253 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:06.439163  9061 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:06.440968  9196 consensus_meta.cc:287] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.005s
I20260501 13:59:06.372856  9262 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.475144  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 663) took 1053 ms. Trace:
I20260501 13:59:06.475041  9196 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.443454  9158 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.445068  9251 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:06.421722  9200 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.475689  8376 rpcz_store.cc:276] 0501 13:59:05.417861 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:05.419018 (+  1157us) service_pool.cc:224] Handling call
0501 13:59:06.449082 (+1030064us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606a3e 000000000035a3c9 00007fb2ff63e8e0 00007fb2ff707784 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:06.449222 (+   140us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:06.449420 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:06.449449 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:06.449494 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:06.449532 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:06.449598 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:06.453289 (+  3691us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15797504}
I20260501 13:59:06.480762  9196 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:06.482472  9155 consensus_meta.cc:287] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.827s	user 0.007s	sys 0.008s
I20260501 13:59:06.419960  9197 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260501 13:59:06.488883  9239 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:06.489437  8375 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260501 13:59:06.490547  9211 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:06.493590  9241 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.483520  9242 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:06.494230  9166 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.004s
I20260501 13:59:06.471041  9188 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.491906  9243 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.501634  9200 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:06.505774  9203 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.005s
I20260501 13:59:06.416162  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.555341  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 665) took 1136 ms. Trace:
W20260501 13:59:06.542021  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.559557  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 106259us
W20260501 13:59:06.546440  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.545468  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.638s (SENT)
I20260501 13:59:06.565310  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:06.565337  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 149038us
I20260501 13:59:06.567090  9155 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.567183  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.508044  9203 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.568853  9215 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:06.569573  7718 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.676s (SENT)
I20260501 13:59:06.557787  9242 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:06.560341  8374 rpcz_store.cc:276] 0501 13:59:05.418485 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:05.419007 (+   522us) service_pool.cc:224] Handling call
0501 13:59:05.480674 (+ 61667us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:05.494655 (+ 13981us) raft_consensus.cc:1534] Early marking committed up to index 3
0501 13:59:05.876227 (+381572us) log.cc:844] Serialized 14 byte log entry
0501 13:59:05.970720 (+ 94493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:06.002373 (+ 31653us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:06.010311 (+  7938us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:06.554558 (+544247us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b540075f8d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:06.554639 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:06.555008 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148,"raft.queue_time_us":1227,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"spinlock_wait_cycles":31400192,"thread_start_us":88047,"threads_started":1,"wal-append.queue_time_us":292407}
I20260501 13:59:06.570252  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.572408  9203 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.574503  9166 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.574649  9155 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.576732  9060 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:06.550819  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:06.586418  7819 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:06.596408  9241 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.496286  8375 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:06.611074  9125 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:06.598590  9257 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.611902  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:06.612923  7751 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:06.623170  9203 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:06.624291  9203 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:06.625205  9133 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.012s
I20260501 13:59:06.627576  9203 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:06.631124  7718 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.687s (SENT)
I20260501 13:59:06.631959  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.633317  9203 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:06.634618  9247 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.668s	user 0.003s	sys 0.014s
I20260501 13:59:06.636561  9201 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:06.647392  8372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.007s	sys 0.016s
I20260501 13:59:06.647488  9133 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:06.647441  9166 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260501 13:59:06.635229  9247 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.637168  9201 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:06.656037  7747 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:06.652383  9133 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.656225  9166 consensus_queue.cc:1243] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260501 13:59:06.660632  9257 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:06.662015  9256 consensus_queue.cc:1059] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:06.666664  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.667053  9256 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:06.664683  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.667641  9256 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:06.669322  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:06.671056  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51744 (request call id 664) took 1252 ms. Trace:
I20260501 13:59:06.671630  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:06.672748  7676 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
W20260501 13:59:06.673413  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.674705  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.675562  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:06.676910  9133 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.677652  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:06.680501  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 204720us
I20260501 13:59:06.680513  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:60254 (request call id 475) took 1138 ms. Trace:
I20260501 13:59:06.681083  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.681375  7753 rpcz_store.cc:276] 0501 13:59:05.537995 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:05.538136 (+   141us) service_pool.cc:224] Handling call
0501 13:59:06.675918 (+1137782us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540012bbd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb2ff6b911e 00007fb2f8c35437 00007fb2f8c353c2 00007fb2f8c352f1 00007fb2f8c3526c 00007fb2f8c34522 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:06.676642 (+   724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471840128}
W20260501 13:59:06.688478  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.690202  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.691231  9247 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.684907  9256 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.695909  9256 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:06.702741  9262 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.702880  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:06.671479  8375 rpcz_store.cc:276] 0501 13:59:05.418189 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:05.418863 (+   674us) service_pool.cc:224] Handling call
0501 13:59:06.670544 (+1251681us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400151154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:06.670778 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893686272}
I20260501 13:59:06.658675  9006 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:06.704615  9006 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.707270  9006 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.708396  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:06.709383  7676 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:06.710399  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.713436  9254 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:06.713987  9254 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:06.713704  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.716562  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.696065  9210 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:06.718894  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.720096  7671 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:06.723539  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.717151  9254 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.729332  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.732270  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 169) took 3628 ms. Trace:
I20260501 13:59:06.732800  7574 rpcz_store.cc:276] 0501 13:59:03.089967 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:03.090121 (+   154us) service_pool.cc:224] Handling call
0501 13:59:06.714875 (+3624754us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:03.245433 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:03.292616 (+ 47183us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:03.295966 (+  3350us) write_op.cc:435] Acquired schema lock
0501 13:59:03.298185 (+  2219us) tablet.cc:662] Decoding operations
0501 13:59:03.362758 (+ 64573us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:03.365669 (+  2911us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:03.375892 (+ 10223us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:03.376131 (+   239us) tablet.cc:701] Row locks acquired
0501 13:59:03.376153 (+    22us) write_op.cc:260] PREPARE: finished
0501 13:59:03.376309 (+   156us) write_op.cc:270] Start()
0501 13:59:03.376431 (+   122us) write_op.cc:276] Timestamp: P: 1777643943376266 usec, L: 0
0501 13:59:03.376455 (+    24us) op_driver.cc:348] REPLICATION: starting
0501 13:59:03.381289 (+  4834us) log.cc:844] Serialized 533 byte log entry
0501 13:59:04.431152 (+1049863us) op_driver.cc:464] REPLICATION: finished
0501 13:59:04.745763 (+314611us) write_op.cc:301] APPLY: starting
0501 13:59:04.762918 (+ 17155us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:04.789638 (+ 26720us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:04.870079 (+ 80441us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:04.901839 (+ 31760us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:04.937658 (+ 35819us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:04.945712 (+  8054us) write_op.cc:312] APPLY: finished
0501 13:59:04.957853 (+ 12141us) log.cc:844] Serialized 23 byte log entry
0501 13:59:04.967592 (+  9739us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:04.972121 (+  4529us) write_op.cc:454] Released schema lock
0501 13:59:04.977443 (+  5322us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:04.999280 (+ 21837us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:05.000473 (+  1193us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30253,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":272152,"apply.run_cpu_time_us":3352,"apply.run_wall_time_us":261090,"num_ops":1,"prepare.queue_time_us":78293,"prepare.run_cpu_time_us":36250,"prepare.run_wall_time_us":285417,"raft.queue_time_us":197709,"raft.run_cpu_time_us":18898,"raft.run_wall_time_us":271261,"replication_time_us":1041572,"thread_start_us":497186,"threads_started":4,"wal-append.queue_time_us":310095,"wal-append.run_cpu_time_us":17243,"wal-append.run_wall_time_us":2303823}]]}
I20260501 13:59:06.737927  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:06.738989  7822 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:06.740357  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:06.741348  7826 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:06.742749  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:06.743551  7823 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:06.748533  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.748664  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:06.748992  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.751781  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:06.752620  7819 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:06.753376  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.755157  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:06.756287  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 261) took 2511 ms. Trace:
I20260501 13:59:06.744091  7672 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:06.756062  9187 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:06.758970  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.756750  7573 rpcz_store.cc:276] 0501 13:59:04.245249 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:04.245402 (+   153us) service_pool.cc:224] Handling call
0501 13:59:06.756088 (+2510686us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434480,"reported_tablets":6}
W20260501 13:59:06.760236  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.756131  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:06.765012  9201 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:06.778600  9154 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:06.762979  7718 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.532s (SENT)
I20260501 13:59:06.785544  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.787128  9200 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:06.787624  9200 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:06.788846  9200 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.790524  9200 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:06.794957  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:06.801061  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.797865  7576 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 3 to 4, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 4 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:06.800850  7823 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:06.802327  7675 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
W20260501 13:59:06.805740  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.808712  7676 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
W20260501 13:59:06.834025  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.828675  7679 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:06.801957  7672 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260501 13:59:06.827402  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 43499us
W20260501 13:59:06.832664  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 72808.7us
W20260501 13:59:06.838970  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.801741  7670 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:06.832208  9201 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:06.804922  9254 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:06.844539  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.845446  7672 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.807060  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:06.820050  9275 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260501 13:59:06.849473  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.804064  7576 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:06.852413  7718 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.551s (SENT)
I20260501 13:59:06.853680  7672 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.857029  7671 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:06.858631  7671 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:06.859769  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.860666  7678 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:06.860003  7753 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.859608  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.861682  7671 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:06.860773  7672 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:06.860579  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:06.863222  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.865748  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.866641  7670 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.872159  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:06.875455  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.879180  9201 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:06.882246  7753 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:06.885200  7678 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:06.881021  9256 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:06.886226  9256 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.888943  9256 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:06.889726  9125 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:06.890424  9125 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.893994  9125 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:06.896512  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.896867  7676 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.900113  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 2 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:06.901921  7576 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 2 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:06.905885  7676 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:06.903515  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.911727  7671 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
W20260501 13:59:06.912638  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 62859.3us
W20260501 13:59:06.913440  7718 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.647s (SENT)
I20260501 13:59:06.913815  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.914963  7672 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.876843  7819 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:06.917730  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.918534  7676 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.917829  7576 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 2 to 3, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:06.913918  9154 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:06.923928  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:06.928375  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.929098  7672 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.914438  7674 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:06.931492  9066 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:06.925951  9201 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:06.938668  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.940438  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:06.937491  9066 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:06.934036  7576 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 2 to 3, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:06.934067  9210 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:06.948993  9101 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:06.952344  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.949633  7576 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 2 to 3, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:06.953545  7679 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:06.953649  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.955224  7678 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.958284  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:06.942677  9154 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:06.961529  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:06.951772  9101 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:06.968911  7671 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.969687  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:06.972302  9247 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:06.972846  9247 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:06.973202  9247 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:06.964404  9215 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:06.977007  9215 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:06.977396  9215 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.979017  7576 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:06.982375  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.982561  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:06.980741  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:06.987531  7672 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:06.984318  7676 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:06.988557  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.989509  7670 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:06.968868  9101 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:06.991925  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.990314  7672 raft_consensus.cc:2376] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:06.994419  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:06.996872  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:06.960886  9210 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:06.992152  7576 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 2, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:07.002668  7679 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.004133  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.004875  7676 raft_consensus.cc:2376] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:07.004078  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.006129  7670 raft_consensus.cc:2376] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2. Re-sending same reply.
W20260501 13:59:07.015764  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 51329.1us
I20260501 13:59:07.003391  9201 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260501 13:59:07.016615  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.013341  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-4262547d9184416ab702339797bead6f received from {username='slave'} at 127.0.0.1:45436
I20260501 13:59:07.010818  9154 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.021986  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:06.996904  9066 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.024924  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:07.024829  7792 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.579s (SENT)
I20260501 13:59:07.028515  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.030686  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.031236  7670 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 1.
I20260501 13:59:07.030233  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-4262547d9184416ab702339797bead6f on tablet 4262547d9184416ab702339797bead6f with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:07.032086  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.035224  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:07.035848  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.037552  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.038246  7670 raft_consensus.cc:2376] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2. Re-sending same reply.
I20260501 13:59:07.039381  9009 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.040591  7675 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:07.043952  9095 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.031705  7677 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:07.048108  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.048718  7670 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:07.052919  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.054039  7678 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:07.055860  7673 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:07.057730  7671 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:07.062776  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.063278  7671 raft_consensus.cc:2376] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2. Re-sending same reply.
I20260501 13:59:07.066912  9123 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:07.067467  9123 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.067310  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.068034  9254 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:07.068562  9123 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.068840  9254 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.069924  7678 raft_consensus.cc:2376] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:07.071178  9254 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:07.076234  7792 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.663s (SENT)
I20260501 13:59:07.058935  9125 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:07.060493  9201 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:07.084036  9201 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.084614  9201 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.086745  7679 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:07.080539  9125 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.091065  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.091740  7676 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.093547  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.096392  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.097079  7670 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.097890  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.092324  9210 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:07.101764  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.098098  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.102974  7673 raft_consensus.cc:2376] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2. Re-sending same reply.
I20260501 13:59:07.105888  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.095288  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.106374  9254 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:07.108243  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.110589  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:07.113862  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.660s (SENT)
W20260501 13:59:07.117549  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.118372  9254 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.112739  7677 raft_consensus.cc:2376] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:07.120754  7673 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:07.121093  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.111919  9154 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:07.129405  9277 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260501 13:59:07.122627  9254 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:07.130347  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54211.6us
I20260501 13:59:07.102753  9125 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.128037  7819 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:07.122758  9154 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:07.149142  7671 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:07.150955  9154 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.139240  9133 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:07.155953  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:07.156306  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.725s (SENT)
I20260501 13:59:07.148311  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.157346  7677 raft_consensus.cc:2376] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2. Re-sending same reply.
I20260501 13:59:07.158286  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.159514  9095 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:07.159960  9095 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:07.160313  9095 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:07.164179  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54383.5us
I20260501 13:59:07.165997  7673 raft_consensus.cc:2376] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
W20260501 13:59:07.170325  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.174207  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.175076  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.176806  7677 raft_consensus.cc:2376] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:07.180069  9254 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:07.181048  9254 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.183123  9254 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:07.186978  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.187182  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.187985  9101 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.190056  9101 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:07.195101  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.194856  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:07.197000  7718 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.836s (SENT)
I20260501 13:59:07.199782  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.165762  9247 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.202150  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.202759  7673 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.201121  7820 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.198684  9215 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:07.214257  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.219918  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.208781  9133 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:07.224341  9133 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.227005  9133 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:07.227459  9278 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260501 13:59:07.228847  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.209051  9125 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.241583  9215 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.245124  9247 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.213721  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.246670  7677 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:07.250789  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.258169  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.258951  7677 raft_consensus.cc:2376] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
W20260501 13:59:07.262100  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65141.5us
W20260501 13:59:07.262846  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.853s (SENT)
I20260501 13:59:07.264429  7820 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:07.265898  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.266618  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.266719  7827 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:07.259200  9095 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.268615  9101 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:07.269951  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.270721  7673 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.270742  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.270716  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.272527  7678 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:07.272574  9201 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.271730  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.274185  7670 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:07.274554  9201 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.275159  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:07.275605  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.276162  7677 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.276466  9101 raft_consensus.cc:697] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:07.278270  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.278005  9101 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.279055  7675 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.279774  7671 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:07.282701  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.285095  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.286010  7820 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
W20260501 13:59:07.288857  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.290208  7675 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:07.287076  9095 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:07.291568  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.292230  7827 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:07.292444  7718 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.878s (SENT)
I20260501 13:59:07.292943  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.294287  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.295496  9247 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.296149  9247 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.296248  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.296929  7819 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.297204  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.298185  9201 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:07.298592  9201 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.298942  9201 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.304427  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.307156  7671 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.310788  9247 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:07.311254  9247 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.312330  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.323387  7827 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
W20260501 13:59:07.325700  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 113011us
I20260501 13:59:07.325881  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.326484  7827 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:07.327219  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.983s (SENT)
I20260501 13:59:07.329421  7675 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:07.330475  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.331130  7679 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:07.332110  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.332203  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.332950  7676 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:07.333869  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.334553  7672 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.338120  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.338387  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.338824  7678 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:07.338979  7676 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.316375  9247 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.340716  9133 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:07.341120  9133 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.341454  9133 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.343869  7819 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
W20260501 13:59:07.344399  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.344964  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.345609  7673 raft_consensus.cc:2376] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2. Re-sending same reply.
I20260501 13:59:07.346776  7671 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:07.350670  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.351336  7677 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.354049  7746 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.355144  7750 raft_consensus.cc:1217] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
W20260501 13:59:07.354070  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.356621  7746 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.355680  7750 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260501 13:59:07.359637  7750 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 3. Ops: []
I20260501 13:59:07.346714  7672 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:07.363078  7750 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.337405  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.364219  7670 raft_consensus.cc:2376] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3. Re-sending same reply.
W20260501 13:59:07.364715  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.365303  9201 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:07.371639  7750 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.373476  9133 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.374497  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.375679  9133 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.375623  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.376915  7750 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.376816  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:07.377826  8375 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 3. Ops: []
I20260501 13:59:07.379194  7676 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:07.380337  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.381871  7823 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.384382  7823 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.385443  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:07.387611  7823 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.388195  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.390725  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.390626  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.367776  9201 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.363490  9247 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:07.394448  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.394914  7820 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:07.400168  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.400667  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 72418.9us
W20260501 13:59:07.404844  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.404939  7718 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.183s (SENT)
I20260501 13:59:07.405484  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.407617  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.408198  7823 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.411355  7746 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:07.411892  9133 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.411948  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:07.411295  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.413532  7748 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.414542  8373 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:07.417593  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.402634  9201 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:07.424351  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.420961  7823 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.425006  7827 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.427120  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.427799  7826 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.427910  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:07.428795  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.433296  7827 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
W20260501 13:59:07.424031  7792 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.552s (SENT)
I20260501 13:59:07.426092  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.437129  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.437671  9201 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.438982  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:07.440055  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.440404  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.442420  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.443611  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:07.434613  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.424795  9247 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.464193  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.458561  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.459139  9133 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:07.460497  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.461395  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.461663  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.461740  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.462812  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.467455  7753 raft_consensus.cc:2368] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3.
I20260501 13:59:07.463156  7754 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:07.464910  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.018s (SENT)
I20260501 13:59:07.465145  7752 raft_consensus.cc:2368] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.465425  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.467235  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.468622  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.469565  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.463742  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.467988  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.472038  7823 raft_consensus.cc:2368] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.472684  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.473516  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.474248  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:07.474283  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.475797  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.477061  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.479094  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.480337  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:07.481050  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.461395  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.481673  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.482431  7826 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:07.480990  7754 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.482710  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.483551  7672 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.475455  7745 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.487098  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:07.488157  7752 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:07.472950  9123 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:07.471081  9133 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.502271  7679 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.502331  9123 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.503717  7675 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.503806  9133 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.504263  7672 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.504496  9133 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:07.505136  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.505337  7674 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.505717  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.506466  7819 raft_consensus.cc:2368] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.506517  7671 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.509524  9243 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:07.494913  7823 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:07.496881  7673 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.507565  7676 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.478039  9247 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:07.512818  9247 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.513931  9247 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.517063  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.517978  9139 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:07.519531  9139 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.505071  9133 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.476466  9154 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:07.499562  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.500735  7670 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:07.500910  9201 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.501652  9125 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:07.501746  7678 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.471705  9101 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:07.503484  9123 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.471222  9215 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:07.497459  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:07.537335  7746 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.541038  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.557767  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.551501  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.558585  7670 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:07.559123  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 84912.1us
I20260501 13:59:07.554266  7573 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:07.561856  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 137897us
I20260501 13:59:07.567247  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.568329  9061 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.555663  9101 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.570868  7827 raft_consensus.cc:2368] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3.
I20260501 13:59:07.572925  7573 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:07.582031  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.582667  7826 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.555518  9125 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.600351  9125 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.569806  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.604430  7745 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:07.605051  7819 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.606120  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 293) took 2117 ms. Trace:
I20260501 13:59:07.606977  9006 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:07.589313  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.596366  9201 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:07.596953  8372 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:07.597352  9101 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.597604  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.597937  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.598371  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:07.598575  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.650s (SENT)
I20260501 13:59:07.633829  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.587683  9133 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.609941  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:07.611641  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.635563  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.615163  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:07.619608  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.636454  7678 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:07.632045  7828 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.638818  7670 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:07.644485  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.645781  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.647681  7670 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:07.648700  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.587734  7677 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:07.651681  7676 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:07.641618  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.939s (SENT)
I20260501 13:59:07.643721  7820 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
W20260501 13:59:07.651129  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52622.3us
I20260501 13:59:07.606510  7576 rpcz_store.cc:276] 0501 13:59:05.488691 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:05.488878 (+   187us) service_pool.cc:224] Handling call
0501 13:59:07.606059 (+2117181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:07.268192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:07.294066 (+ 25874us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:07.294118 (+    52us) write_op.cc:435] Acquired schema lock
0501 13:59:07.294136 (+    18us) tablet.cc:662] Decoding operations
0501 13:59:07.296077 (+  1941us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:07.296173 (+    96us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:07.296213 (+    40us) tablet.cc:685] Acquiring locks for 9 operations
0501 13:59:07.297090 (+   877us) tablet.cc:701] Row locks acquired
0501 13:59:07.297110 (+    20us) write_op.cc:260] PREPARE: finished
0501 13:59:07.297279 (+   169us) write_op.cc:270] Start()
0501 13:59:07.297445 (+   166us) write_op.cc:276] Timestamp: P: 1777643947297213 usec, L: 0
0501 13:59:07.297494 (+    49us) op_driver.cc:348] REPLICATION: starting
0501 13:59:07.298160 (+   666us) log.cc:844] Serialized 3657 byte log entry
0501 13:59:07.351752 (+ 53592us) op_driver.cc:464] REPLICATION: finished
0501 13:59:07.444118 (+ 92366us) write_op.cc:301] APPLY: starting
0501 13:59:07.444263 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:07.444592 (+   329us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:07.448100 (+  3508us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:07.505285 (+ 57185us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:07.505635 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0501 13:59:07.505700 (+    65us) write_op.cc:312] APPLY: finished
0501 13:59:07.506094 (+   394us) log.cc:844] Serialized 71 byte log entry
0501 13:59:07.506295 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:07.506452 (+   157us) write_op.cc:454] Released schema lock
0501 13:59:07.506521 (+    69us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:07.506904 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:07.506931 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":555578,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":83187,"apply.run_cpu_time_us":4543,"apply.run_wall_time_us":62804,"num_ops":9,"prepare.queue_time_us":111990,"prepare.run_cpu_time_us":11781,"prepare.run_wall_time_us":50292,"raft.queue_time_us":29680,"raft.run_cpu_time_us":6950,"raft.run_wall_time_us":44505,"replication_time_us":54085,"thread_start_us":124387,"threads_started":4,"wal-append.queue_time_us":20245}]]}
I20260501 13:59:07.613691  7748 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:07.652048  7823 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.652676  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.637712  9215 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:07.655460  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.656859  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.662431  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.663307  7676 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:07.650094  9260 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:07.664736  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.666762  7670 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:07.668855  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.657647  9154 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.670373  9154 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:07.668529  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.681078  7670 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:59:07.685303  7792 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.750s (SENT)
I20260501 13:59:07.649281  9201 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.684909  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.688717  7678 raft_consensus.cc:2368] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3.
W20260501 13:59:07.684819  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.687000  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.695616  9201 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.697654  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.698387  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.699111  7677 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.700976  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.701649  7678 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:07.702371  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.702549  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.703032  7673 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.703606  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.703860  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.704226  7671 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.705101  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.705866  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.706576  7674 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:59:07.706578  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.707574  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.708216  7675 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.709039  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.709635  7679 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:07.709389  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 67820.4us
I20260501 13:59:07.713174  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.704167  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.704373  7673 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.689049  9247 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:07.723070  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.723618  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55014.4us
I20260501 13:59:07.723760  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.724483  7678 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:07.726024  9061 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.727243  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:07.728259  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.728075  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.728978  7827 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:07.729321  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.729628  9296 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:07.730033  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.730350  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.747331  7671 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:07.730048  9296 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.748338  9296 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.732812  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.749004  7674 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.734172  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:07.755872  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.728013  7677 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.759328  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.737440  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:07.760264  7827 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.759676  9215 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.760569  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.738092  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.761776  7678 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.728044  7672 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:07.764782  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.756215  7828 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.740080  9247 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:07.741366  9243 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:07.766026  9247 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.766414  9247 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.741978  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:07.728178  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.748603  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.769016  7671 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.745529  7675 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:07.732558  7822 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:07.769483  7672 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.776782  7673 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:07.743455  7679 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.771718  7670 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.786868  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.787801  7673 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
W20260501 13:59:07.795949  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.796878  7826 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.793130  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.800284  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:07.801122  7676 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.803484  7673 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:07.797078  9295 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260501 13:59:07.804517  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.805215  7674 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.805881  7643 leader_election.cc:400] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.806331  7643 leader_election.cc:403] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260501 13:59:07.807602  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.808821  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:07.814791  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 90420.6us
I20260501 13:59:07.816339  7672 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:07.797609  9243 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:07.821223  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:07.823028  7676 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:07.812598  9154 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:07.825765  7678 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:07.813354  9295 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260501 13:59:07.826357  7792 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.783s (SENT)
I20260501 13:59:07.831279  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:07.820649  9125 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:07.832813  7675 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:07.828747  9154 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.835246  9154 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:07.843348  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 101441us
I20260501 13:59:07.832118  9243 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:07.846879  7822 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:07.847136  9243 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:07.831911  9295 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.829391  9254 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.864054  9295 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.838809  9201 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260501 13:59:07.860991  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.840981  9125 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:07.874040  9125 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:07.833956  9123 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.877835  7677 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:07.881022  7671 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260501 13:59:07.884280  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 84138.9us
W20260501 13:59:07.892084  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65786.5us
W20260501 13:59:07.893133  7792 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.784s (SENT)
I20260501 13:59:07.893612  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.884075  9101 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260501 13:59:07.903327  9095 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:07.903692  7792 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.816s (SENT)
I20260501 13:59:07.904384  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:07.905576  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.916275  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.924165  9254 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:07.925415  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:07.925551  9254 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:59:07.926668  7643 leader_election.cc:400] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.927083  7643 leader_election.cc:403] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260501 13:59:07.918103  9061 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.938576  9312 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
W20260501 13:59:07.952349  7792 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.850s (SENT)
I20260501 13:59:07.953302  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.950938  7574 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:07.955394  7574 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:07.957257  7574 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:07.961079  7792 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.855s (SENT)
I20260501 13:59:07.961673  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:07.949782  9296 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.966831  9296 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:07.967918  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.968372  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:07.968756  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:07.969278  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.970009  7828 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.953151  9312 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:07.976107  9313 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:07.976660  9313 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:07.977025  9313 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.974040  9260 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:07.949522  9247 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.957594  9295 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:07.972808  9095 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:07.982908  9295 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:07.972306  9254 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:07.989820  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:07.992471  9312 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.001848  7827 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:07.994264  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:08.000998  7820 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:07.993196  9247 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:08.019469  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.025082  7828 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
W20260501 13:59:08.035630  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:08.012621  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.146s (SENT) [suppressed 48 similar messages]
W20260501 13:59:08.112807  9317 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260501 13:59:08.147795  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.004452  7819 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:08.111443  9320 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
W20260501 13:59:08.165966  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 239550us
I20260501 13:59:08.163866  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:08.168606  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 156026us
W20260501 13:59:08.170504  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 143698us
I20260501 13:59:08.178169  9305 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:08.166165  9320 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:08.193373  9320 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.194803  9320 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:08.194875  8372 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Advancing to term 3
I20260501 13:59:08.175586  9313 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.203990  9313 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.205303  7827 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:08.207626  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:08.175320  9125 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:08.183049  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:08.235776  7643 leader_election.cc:400] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:08.236359  7643 leader_election.cc:403] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260501 13:59:08.255409  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.223575  9295 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:08.237263  9125 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:08.190799  9154 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.266870  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:08.272109  7643 leader_election.cc:400] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3.
I20260501 13:59:08.272456  7643 leader_election.cc:403] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260501 13:59:08.273595  9254 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3.
I20260501 13:59:08.266988  9295 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:08.274796  9295 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.275522  9313 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:08.275990  9313 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:08.276350  9313 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:08.272135  9125 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.263269  9123 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.280234  9123 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.282317  9123 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.293920  7827 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.294094  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.296137  8372 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:08.296345  9154 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:08.297837  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.283739  9215 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.299018  9215 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.300688  9009 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.301051  9215 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.301260  9009 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.261611  9325 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
W20260501 13:59:08.305261  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.305454  9312 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:08.322991  7822 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.327713  9313 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:08.329231  9315 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
I20260501 13:59:08.329788  9009 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.330456  9325 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:08.330960  9325 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.341367  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.344247  9325 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:08.346935  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:08.347559  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 81011.8us
W20260501 13:59:08.351681  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65974.2us
I20260501 13:59:08.329975  9313 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.356011  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:08.356685  7823 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:08.357132  7574 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:59:08.361531  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 88394.6us
I20260501 13:59:08.361105  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:08.362727  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.363758  9332 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:08.365054  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.364956  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.366014  9332 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.366222  9313 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:08.366847  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:08.367880  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.363459  7574 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 3, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:08.373064  7828 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:08.367789  9325 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:08.372023  9243 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.374284  9243 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.375948  9009 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.376425  9243 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.376492  9009 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.377143  9260 raft_consensus.cc:1064] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:59:08.378891  9009 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.380941  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.381218  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.385792  9325 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.385648  9247 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:59:08.385932  9320 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.386809  7819 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:08.386487  9320 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.386421  9325 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:08.390662  9296 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260501 13:59:08.394558  9325 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.395320  7826 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260501 13:59:08.397173  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 47945.1us
I20260501 13:59:08.408027  7823 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:08.411715  8376 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Advancing to term 3
I20260501 13:59:08.424368  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.403501  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.427312  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.390738  9125 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260501 13:59:08.367774  9332 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.441103  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:08.435173  9243 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:08.442267  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:08.427845  9254 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.438797  9325 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.379639  9260 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.411969  9296 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260501 13:59:08.447428  7826 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260501 13:59:08.453469  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.453689  9325 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.458946  9325 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.459493  9325 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:08.466009  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.448081  9313 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260501 13:59:08.443948  9154 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260501 13:59:08.485370  9215 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:08.464864  9340 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:08.452764  9254 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:08.512447  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 114177us
I20260501 13:59:08.487710  9325 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.516567  9325 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.494966  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789c720014934abe950ad611625f9bc9"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:08.513864  9320 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.516990  9296 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:08.540690  9332 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.541286  9299 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.542517  9101 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.530045  9339 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260501 13:59:08.546166  9254 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.548122  7643 leader_election.cc:400] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:08.548666  8376 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260501 13:59:08.550220  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.534597  7827 raft_consensus.cc:606] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:08.571460  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46134us
W20260501 13:59:08.573477  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.574339  8372 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:08.576900  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:08.577662  7827 raft_consensus.cc:606] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:08.530586  9066 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.517119  9340 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.586138  8372 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:59:08.585001  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:08.612851  8376 raft_consensus.cc:2376] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:08.598215  9296 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:08.594309  9305 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:08.618448  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 70486us
I20260501 13:59:08.622418  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:08.585002  7792 connection.cc:254] RPC call timeout handler was delayed by -1.1442694690000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260501 13:59:08.624202  7792 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.583s (SENT)
I20260501 13:59:08.624516  9297 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.624642  7792 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:08.624898  9345 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:08.628454  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.594179  9215 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:08.636927  9254 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:08.599290  9066 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:08.637728  9286 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260501 13:59:08.639348  9066 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:08.639840  7749 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:08.625157  9297 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.642447  9297 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.641887  9215 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.645386  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:08.650220  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.650449  9342 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:08.650924  9342 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:08.580233  9299 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.653540  9299 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.655736  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.625595  9345 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:08.655985  9347 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
I20260501 13:59:08.658435  9345 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.664218  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.666044  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.579767  9101 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.686129  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:08.690968  9340 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.651803  9342 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.697896  9342 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:08.632238  9330 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:08.708689  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 84533.2us
I20260501 13:59:08.712751  9312 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:08.625998  9305 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.716843  7751 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:08.717701  9305 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:08.729970  9341 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260501 13:59:08.732079  9312 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:08.732625  9254 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:08.733423  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:08.735433  9296 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:08.737586  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 51613.7us
I20260501 13:59:08.758163  7643 leader_election.cc:400] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3.
W20260501 13:59:08.742225  7792 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.868s (SENT)
W20260501 13:59:08.758373  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 316199us
I20260501 13:59:08.722955  9340 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:08.747371  7752 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260501 13:59:08.756692  7827 raft_consensus.cc:606] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:08.744163  9101 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:08.759699  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:08.755048  9353 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:08.765079  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.779177  7643 leader_election.cc:400] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4.
I20260501 13:59:08.780006  9303 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260501 13:59:08.760293  9295 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:08.780246  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:08.760066  9312 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.788045  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:08.790234  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:08.809958  9356 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260501 13:59:08.789601  9340 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:08.789908  9342 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:08.822888  9312 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.789631  9305 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260501 13:59:08.820094  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.892s (SENT)
W20260501 13:59:08.827193  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 62960.8us
I20260501 13:59:08.831284  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:08.834420  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.836589  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:08.841820  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:08.851285  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 61162.6us
I20260501 13:59:08.833864  9254 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:08.851346  7823 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.784987  9353 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.790319  9295 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.837255  9342 raft_consensus.cc:2764] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260501 13:59:08.835314  9312 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:08.839120  9215 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:08.841049  9356 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:08.843061  9358 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260501 13:59:08.848418  9332 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:08.844548  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.850941  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:08.855579  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.860420  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:08.864454  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.914s (SENT)
I20260501 13:59:08.857554  9320 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:08.862867  9254 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.873184  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:08.842049  9340 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:08.872861  7824 raft_consensus.cc:606] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:08.872480  9356 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.868748  9215 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.885753  9215 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.872352  9154 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:08.886607  9154 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.887082  9295 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.888136  9353 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.888597  9154 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.883661  9351 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:08.888927  7819 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.880774  9061 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:08.892072  9340 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:08.892454  9356 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.894095  9340 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.894213  9332 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:08.894797  9332 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:08.895855  9254 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:08.895741  9332 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:08.900343  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.903522  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:08.904268  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48818.9us
I20260501 13:59:08.905026  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.903545  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.913638  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.914794  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:08.915375  7752 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:08.916693  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.922775  7826 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:08.923756  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.926757  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.927604  7751 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:08.935025  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:08.937665  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 73264.7us
I20260501 13:59:08.937569  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.941371  7750 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:08.937063  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.948490  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.950941  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.953413  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.957315  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.957509  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:08.958258  8376 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:08.966226  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:08.965397  7573 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:08.970717  7573 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:08.967219  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:08.974366  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.926435  9340 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:08.972831  7573 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:08.904286  7819 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:08.978915  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.979966  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:08.982583  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:08.982960  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:08.983196  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:08.983217  7670 raft_consensus.cc:2376] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4. Re-sending same reply.
I20260501 13:59:08.983858  7675 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:08.984248  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:08.987524  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.988981  7679 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:08.956395  9327 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.990099  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:08.992013  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:08.992507  7679 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:08.992775  7670 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.993815  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:08.994395  7673 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:08.994951  7679 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:08.995653  7677 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.996755  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.976775  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:08.999064  7676 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:08.948194  9351 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260501 13:59:08.976775  9356 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.973050  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.976655  9295 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.993556  9312 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.020412  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:09.020849  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:08.976969  9297 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.021555  8379 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:09.021652  9297 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.023677  9297 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.024168  9297 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.005474  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.030139  7673 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:08.997689  7573 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:08.994083  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:09.032827  8374 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:09.033840  9295 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.033975  7573 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:09.035992  7822 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:09.036489  9297 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:08.987092  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:09.037784  7749 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.038887  9342 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.038388  7573 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:09.039407  9342 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.040277  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:09.040104  7573 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:09.040956  8381 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:09.041518  9342 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:09.041757  7573 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:09.043799  7573 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:09.045264  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:08.977591  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:08.989430  9320 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.020655  9312 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.032151  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:08.977223  9125 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.988323  9345 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:09.011941  7792 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.155s (SENT)
I20260501 13:59:09.012938  7677 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:09.053342  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:09.054471  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65904.9us
I20260501 13:59:09.055361  9312 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.056085  9320 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.057554  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.059188  8372 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
W20260501 13:59:09.047482  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:09.019830  7675 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:09.070465  7677 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:09.005894  9361 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:08.987387  9325 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.081620  9337 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:09.082056  9325 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.082396  9260 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:09.049609  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.084187  7674 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:09.084300  7673 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:09.053366  7827 raft_consensus.cc:606] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:08.998512  9313 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.085276  9313 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.085841  9361 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.087169  9313 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:08.994024  9254 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.087873  9254 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.088538  9337 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:09.088982  9337 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:09.089956  9254 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.089867  9337 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.091305  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.093506  7752 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:09.094094  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:08.993767  9340 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:09.001590  9327 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.096014  9340 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.097029  9327 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.014360  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.097712  7749 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
W20260501 13:59:09.097980  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 83706.6us
I20260501 13:59:09.098441  9353 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:09.098806  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.058113  7821 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.072388  9247 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:09.099925  9260 raft_consensus.cc:993] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:09.100487  9247 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:09.100871  9247 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:09.101311  9260 raft_consensus.cc:1081] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:09.060331  9125 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.050604  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.045858  9356 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.076398  9345 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:09.068194  9330 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260501 13:59:09.078373  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.122085  7676 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:09.104167  9101 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:09.079739  9320 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.094313  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:09.139386  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:09.045737  7573 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:09.073556  9295 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:09.091293  9337 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:09.107496  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:09.098846  9353 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:09.079013  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:09.141865  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:09.146248  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.146932  7676 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:09.088581  9361 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.152529  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:09.155493  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:09.164324  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.163722  7673 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:09.116731  9095 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260501 13:59:09.168424  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.132402  9101 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:09.166105  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 87162.6us
I20260501 13:59:09.168510  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.118813  9009 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260501 13:59:09.136616  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.101755  9247 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.163671  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.184751  7672 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:09.165596  9325 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.171020  7673 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:09.173805  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:09.174435  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.168154  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:09.175105  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.129582  9061 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260501 13:59:09.175882  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.196692  7676 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:09.176465  7677 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:09.197695  7677 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:09.152422  9353 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:09.176555  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55843.3us
I20260501 13:59:09.178261  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.179533  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:09.169195  7679 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:09.171723  7670 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:09.183681  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:09.262588  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 83115.7us
I20260501 13:59:09.185920  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.263738  7672 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:09.186678  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:09.174563  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:09.264658  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.173102  9101 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.190333  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:09.164973  7675 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:09.171348  9295 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:09.194275  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.196040  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.276115  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:09.276345  7673 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:09.216106  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.211033  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.276999  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:09.217394  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.195569  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:09.218207  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:09.162101  9260 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260501 13:59:09.219666  7677 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.244786  9125 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.247180  7821 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:09.252597  9247 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:09.296234  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 79721.6us
I20260501 13:59:09.216804  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.187742  7674 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:09.265272  7752 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:09.263123  7750 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:09.264598  7754 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:09.274351  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.275604  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:09.280931  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 98168.5us
I20260501 13:59:09.300351  7679 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:09.283842  9295 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:09.201479  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.283417  7672 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:09.277299  7676 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:09.305280  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.289740  7677 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.288381  7825 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
W20260501 13:59:09.294214  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53481us
I20260501 13:59:09.294543  7670 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:09.253788  9215 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260501 13:59:09.283390  7824 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.278067  9332 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:09.243304  8373 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:09.283015  9325 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.309283  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.310786  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.298709  8372 raft_consensus.cc:2410] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:09.321182  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.325369  9095 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:09.326007  9095 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:09.310312  9320 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.295662  9331 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:09.332144  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.335036  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.342736  7677 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260501 13:59:09.343314  7677 pending_rounds.cc:85] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 2
I20260501 13:59:09.343606  7677 pending_rounds.cc:107] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260501 13:59:09.353645  7677 raft_consensus.cc:2889] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:09.309010  9295 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:09.302637  9061 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260501 13:59:09.328788  9254 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.317108  9340 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:09.317251  9332 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:09.310581  9356 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.316754  9375 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:09.329593  9313 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:09.380980  9313 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:09.327152  9095 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.329799  9325 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.346220  9312 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.352830  9342 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:09.328378  9320 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.359126  9296 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:09.379645  9375 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.393286  9320 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:09.393621  9383 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.113s	user 0.000s	sys 0.004s
I20260501 13:59:09.390265  9296 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.394529  9296 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:09.396361  9331 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:09.401674  9375 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:09.375996  9332 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:09.372520  9254 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.367305  9154 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
W20260501 13:59:09.420360  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 113243us
I20260501 13:59:09.384466  9325 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.423156  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:09.423166  9305 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260501 13:59:09.387501  9312 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:09.448079  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 79237.4us
I20260501 13:59:09.421332  9254 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:09.449889  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 114931us
I20260501 13:59:09.455484  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.456009  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:09.457862  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:09.459539  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.445973  9375 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:09.447894  9312 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.460959  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.461578  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:09.470960  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:09.454910  9297 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260501 13:59:09.450002  9331 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260501 13:59:09.458150  9215 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260501 13:59:09.460337  9061 raft_consensus.cc:2764] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260501 13:59:09.461887  9305 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.306s
I20260501 13:59:09.493924  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:09.689865  9382 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.407s	user 0.004s	sys 0.000s
I20260501 13:59:09.772801  9380 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:09.773427  9380 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.773936  9380 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.649971  9332 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.776481  9332 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.777156  9332 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:09.461782  9342 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:09.781528  9342 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.782100  9342 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:09.784245  9342 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.543399  9389 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:09.786171  9389 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:09.787091  9389 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:09.577754  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:09.791213  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:09.784876  9332 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:09.462579  9320 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:09.469630  9340 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:09.795090  9332 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.563084  7823 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:09.584910  7824 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
W20260501 13:59:09.623029  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:09.527527  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 71633.7us
W20260501 13:59:09.803612  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 332822us
I20260501 13:59:09.807471  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.809432  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:09.810846  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:09.809743  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 315926us
I20260501 13:59:09.814697  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.820451  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.469919  9313 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.815289  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:09.816251  9320 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260501 13:59:09.543780  9385 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260501 13:59:09.824544  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 491153us
I20260501 13:59:09.830324  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:09.659910  9393 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260501 13:59:09.850842  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.852152  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:09.833935  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:09.852430  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.856297  7824 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:09.818506  9247 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.004s
I20260501 13:59:09.690178  9095 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.826438  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.854204  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:09.857537  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:09.542428  9391 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.860831  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.818939  9342 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:09.826205  9320 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:09.824024  9340 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260501 13:59:09.878242  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:09.771674  9312 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.824168  9297 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:09.894299  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.684333  9353 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:09.894076  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 78966.4us
I20260501 13:59:09.572105  9296 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.810564  9254 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.853857  9331 raft_consensus.cc:2764] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260501 13:59:09.896591  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.860289  9389 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.857214  9361 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:09.821827  9295 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.542649  9378 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.481s
I20260501 13:59:09.911517  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.902593  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.885994  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:09.849993  9351 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260501 13:59:09.890422  9299 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.928037  9299 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.928547  9299 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.861521  9391 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.932102  9391 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.899854  9154 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:09.905385  9342 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:09.941723  7754 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:09.891024  9320 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:09.908084  9343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.005s
I20260501 13:59:09.908324  9394 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:09.909122  9379 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:09.909705  9396 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260501 13:59:09.961479  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:09.892823  9340 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.962450  9331 raft_consensus.cc:2764] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260501 13:59:09.962718  9340 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.962929  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:09.965858  9356 raft_consensus.cc:1064] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:59:09.966903  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:09.913841  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:09.924362  9139 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:09.896131  9297 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.851326  9313 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.903302  7822 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:09.902249  9389 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.996173  9389 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:09.986884  9297 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.000619  7823 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:10.001245  9313 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.984050  9380 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.003615  9380 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.985819  9139 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.982586  9391 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:09.982951  9066 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:10.005002  9066 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.005491  9066 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.006042  9391 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.952062  9398 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:09.943454  9154 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.984752  9254 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:09.952610  9377 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:10.008747  9154 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.960391  9345 raft_consensus.cc:1064] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
W20260501 13:59:09.986591  9101 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.005s
I20260501 13:59:09.956507  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:10.011422  9345 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.012198  9353 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:09.949653  9379 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:10.012938  9379 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:09.947454  9394 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:09.982961  9340 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.013677  9394 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:09.969120  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55367us
I20260501 13:59:09.915804  7824 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:09.979118  9299 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.973325  9331 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:09.902380  9325 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:09.979768  9295 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.004320  9139 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.008941  9377 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:09.978055  9312 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.027204  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:10.022957  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 172180us
I20260501 13:59:09.980329  9296 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.010462  9101 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.036010  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:10.038899  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.044783  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:10.045783  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.052237  9332 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:10.024019  9340 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.065533  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.037045  9377 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.042426  9095 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:10.041951  9009 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.072309  9332 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:10.104928  9332 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.108400  9101 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.101430  9392 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260501 13:59:10.047677  9361 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260501 13:59:10.070848  9313 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.043787  9243 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:10.052961  9380 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.097501  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.070497  9312 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:10.052369  9254 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260501 13:59:10.118511  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 53072us
I20260501 13:59:10.077301  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:10.008747  9398 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:10.122895  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 81462.5us
I20260501 13:59:10.128301  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.128923  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:10.130523  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53314us
I20260501 13:59:10.131250  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:10.120826  9243 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.133550  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:10.133982  7677 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:10.134164  7671 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:10.134544  7677 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:10.135373  7677 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.137117  7672 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:10.137534  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.134073  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:10.141119  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 43799.2us
I20260501 13:59:10.142522  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.119525  9402 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:10.149053  9215 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:10.153250  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:10.115729  9356 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.153440  7749 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:10.135640  9243 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.159222  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.156805  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:10.157575  9215 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:10.170935  9215 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.146445  9396 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.168017  9351 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:10.174242  9351 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.120522  9389 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.122982  9313 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.152034  9095 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:10.126384  9380 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.175089  9345 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.174805  9351 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.189039  9320 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.190760  9389 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.191249  9009 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:10.192001  9299 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.172955  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:10.213232  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.214366  7824 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:10.195999  7826 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:10.197335  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.197962  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.156425  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.174189  9396 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:10.200875  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49859us
W20260501 13:59:10.203773  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.192430  9398 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.158262  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:10.207207  7677 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:10.192833  9125 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:10.182052  9399 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:10.232424  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.252763  7677 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260501 13:59:10.257346  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:10.206269  9402 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.213829  9325 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.224133  7748 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.261269  7677 pending_rounds.cc:85] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 2
W20260501 13:59:10.265865  9406 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260501 13:59:10.222265  9305 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.268986  9396 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.262810  9389 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.223874  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.270241  9154 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.219331  9392 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.219357  9361 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.204941  9391 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260501 13:59:10.343586  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 206103us
W20260501 13:59:10.285287  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 138162us
W20260501 13:59:10.288005  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.293036  9398 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:10.320461  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 63195.1us
I20260501 13:59:10.259497  9125 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.260125  7674 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:10.213335  9345 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.276072  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:10.376178  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.258625  9378 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260501 13:59:10.385522  9331 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:10.277122  7677 pending_rounds.cc:107] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260501 13:59:10.358157  9286 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260501 13:59:10.355494  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.356451  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.365649  9398 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.378127  9297 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.378521  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:10.359804  9361 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.379225  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:10.361827  9125 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:10.381891  9345 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.382967  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:10.263988  9399 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.389179  7677 raft_consensus.cc:2889] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:10.389832  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.353246  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.357715  9095 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260501 13:59:10.399878  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 44468.5us
W20260501 13:59:10.431336  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 78228.4us
I20260501 13:59:10.320925  9305 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:10.402349  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.419934  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:10.337477  9389 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.435871  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:10.438513  7672 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:10.375805  9061 raft_consensus.cc:2764] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260501 13:59:10.424849  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.388895  9154 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.435686  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:10.275674  9402 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.394935  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.447840  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:10.444459  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:10.445672  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.448657  7752 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.454792  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:10.457195  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 97706.9us
I20260501 13:59:10.366648  9392 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.473912  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.475029  7678 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:10.472318  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:10.458837  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:10.438246  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:10.446776  9345 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:10.409211  9139 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.474439  9313 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.501417  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:10.476962  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:10.503777  7679 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:10.504966  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:10.507161  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 71196.4us
I20260501 13:59:10.512799  7678 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:10.504870  7672 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:10.484656  9380 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:10.503540  9412 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260501 13:59:10.496047  9320 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.516860  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:10.491709  9403 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:10.520916  8372 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:10.521349  9361 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.482867  9295 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260501 13:59:10.496250  9345 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.514424  9433 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260501 13:59:10.581429  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 76877.7us
I20260501 13:59:10.537932  8374 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260501 13:59:10.525458  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 71227.9us
I20260501 13:59:10.529692  7679 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:10.520340  9139 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.550760  7752 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:10.516453  7674 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:10.511739  9332 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:10.532356  9330 raft_consensus.cc:993] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
W20260501 13:59:10.547516  9417 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260501 13:59:10.524937  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:10.738415  9066 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.004s
I20260501 13:59:10.616487  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.732513  7825 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:10.743036  7672 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:10.743422  9066 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:10.743935  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 127589us
I20260501 13:59:10.683437  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:10.745096  7670 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:59:10.734002  9215 consensus_meta.cc:287] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.005s
I20260501 13:59:10.745764  9066 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.666532  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:10.755882  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 204387us
I20260501 13:59:10.679011  9297 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.759805  7679 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:10.668793  9427 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260501 13:59:10.572014  9345 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:10.781469  9437 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:10.781760  9433 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:10.781966  9419 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260501 13:59:10.782267  9437 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.783430  9444 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.784761  9444 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:10.786886  9444 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.782336  9433 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.787564  9437 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:10.788906  9440 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:10.789738  9433 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:10.790426  9433 raft_consensus.cc:1081] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:10.746070  9332 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.793138  9332 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.749473  9389 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.796100  7674 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:10.749778  9305 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.765514  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:10.815474  8374 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:10.815198  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.772826  9356 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:10.810065  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:10.819123  8377 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:10.774078  9392 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.820680  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:10.820959  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47047.7us
I20260501 13:59:10.814453  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:10.821825  8379 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:10.823043  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:10.746086  9215 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:10.825802  9389 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:10.826438  9332 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:10.828848  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:10.838719  9398 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:10.840153  9424 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260501 13:59:10.840443  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.934120  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:10.934592  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:10.335484  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:10.845006  9399 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:10.818202  9312 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:10.817235  9402 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:10.821149  9356 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:10.855921  9345 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:10.857784  9351 consensus_meta.cc:287] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.002s
I20260501 13:59:10.868119  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.942030  7825 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.940485  9356 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.868240  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:10.947710  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 79596.6us
I20260501 13:59:10.868119  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:10.901062  9431 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.385s	user 0.004s	sys 0.000s
I20260501 13:59:10.821385  9305 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:10.917821  7828 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:10.920300  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:10.920826  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:10.921692  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:10.922554  7826 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260501 13:59:10.922632  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 339796us
W20260501 13:59:10.925375  7675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.018s	sys 0.018s
I20260501 13:59:10.928328  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:10.967885  7675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.019s	sys 0.018s
W20260501 13:59:10.930560  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 101782us
I20260501 13:59:10.929603  9389 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:10.931105  9343 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.933588  9332 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:10.959376  9402 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:10.938941  9009 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:10.971985  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:10.968207  7827 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:10.966081  7820 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:10.956171  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:10.973635  9389 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:10.976271  7824 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260501 13:59:11.156265  9395 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:11.084280  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.012162  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 263) took 2252 ms. Trace:
I20260501 13:59:11.165375  9416 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:11.171657  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:11.179760  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 95581us
I20260501 13:59:11.106122  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:10.959702  9312 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:11.184098  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.184149  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:11.180038  7752 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 1.
I20260501 13:59:11.064610  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 284) took 1781 ms. Trace:
I20260501 13:59:11.188059  7576 rpcz_store.cc:276] 0501 13:59:09.283129 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:09.283274 (+   145us) service_pool.cc:224] Handling call
0501 13:59:11.064508 (+1781234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3571,"reported_tablets":1,"spinlock_wait_cycles":24320}
W20260501 13:59:11.067351  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 322345us
I20260501 13:59:11.193042  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.199131  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.185997  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.201509  7751 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:11.178821  9395 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.067337  9398 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.213002  9415 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:11.179980  7573 rpcz_store.cc:276] 0501 13:59:08.759372 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:08.759536 (+   164us) service_pool.cc:224] Handling call
0501 13:59:08.817545 (+ 58009us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:11.012048 (+2194503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:09.462191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:09.556570 (+ 94379us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:09.556625 (+    55us) write_op.cc:435] Acquired schema lock
0501 13:59:09.556651 (+    26us) tablet.cc:662] Decoding operations
0501 13:59:09.598546 (+ 41895us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:09.598665 (+   119us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:09.598722 (+    57us) tablet.cc:685] Acquiring locks for 10 operations
0501 13:59:09.676672 (+ 77950us) tablet.cc:701] Row locks acquired
0501 13:59:09.679212 (+  2540us) write_op.cc:260] PREPARE: finished
0501 13:59:09.753356 (+ 74144us) write_op.cc:270] Start()
0501 13:59:09.760902 (+  7546us) write_op.cc:276] Timestamp: P: 1777643949736548 usec, L: 0
0501 13:59:09.764574 (+  3672us) op_driver.cc:348] REPLICATION: starting
0501 13:59:09.784555 (+ 19981us) log.cc:844] Serialized 4118 byte log entry
0501 13:59:09.983222 (+198667us) op_driver.cc:464] REPLICATION: finished
0501 13:59:10.193560 (+210338us) write_op.cc:301] APPLY: starting
0501 13:59:10.202733 (+  9173us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:10.262379 (+ 59646us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:10.262522 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:10.265932 (+  3410us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:10.266193 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0501 13:59:10.266242 (+    49us) write_op.cc:312] APPLY: finished
0501 13:59:10.266524 (+   282us) log.cc:844] Serialized 77 byte log entry
0501 13:59:10.266698 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:10.266849 (+   151us) write_op.cc:454] Released schema lock
0501 13:59:10.266901 (+    52us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:10.267263 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:10.267291 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2604,"reported_tablets":13,"spinlock_wait_cycles":68110592,"child_traces":[["op",{"apply.queue_time_us":175519,"apply.run_cpu_time_us":3525,"apply.run_wall_time_us":91647,"num_ops":10,"prepare.queue_time_us":285468,"prepare.run_cpu_time_us":6644,"prepare.run_wall_time_us":331575,"replication_time_us":218476,"thread_start_us":221321,"threads_started":2}]]}
I20260501 13:59:11.213330  9398 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.213847  9331 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:11.214184  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:11.214486  9395 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.215404  9398 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.215802  9340 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:11.216722  9254 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:11.059692  9441 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260501 13:59:11.217986  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:10.986485  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:11.218865  7676 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:11.218923  7679 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:11.014688  7825 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:11.221292  7827 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:11.219287  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:11.224045  7678 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:10.975689  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:11.113862  9394 consensus_meta.cc:287] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.100s	user 0.021s	sys 0.000s
I20260501 13:59:11.231443  7751 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:11.223023  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:11.231519  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48890.7us
I20260501 13:59:11.237912  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 295) took 2262 ms. Trace:
I20260501 13:59:11.238461  7574 rpcz_store.cc:276] 0501 13:59:08.975258 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:08.977519 (+  2261us) service_pool.cc:224] Handling call
0501 13:59:11.237818 (+2260299us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":10}
I20260501 13:59:11.240185  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.242479  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:11.247577  7677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.018s	sys 0.061s
W20260501 13:59:11.248036  7677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.018s	sys 0.061s
W20260501 13:59:11.069113  9379 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.056s	user 0.012s	sys 0.004s
I20260501 13:59:10.966120  9399 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:11.243506  9425 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:10.957059  9351 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:10.995528  9243 consensus_meta.cc:287] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.823s	user 0.014s	sys 0.000s
I20260501 13:59:11.066017  9345 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.181180  9009 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:11.256376  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:11.257225  7670 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:11.257326  7751 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:11.240869  7747 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:10.976603  9332 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:11.252785  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:11.242507  7678 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260501 13:59:11.247418  7748 consensus_meta.cc:287] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.005s
I20260501 13:59:10.974956  7821 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:11.263875  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.231479  9378 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:11.277490  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:11.251861  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "789c720014934abe950ad611625f9bc9"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:59:11.273337  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:11.279528  7673 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:11.279690  8377 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:11.280027  7673 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:11.244957  7745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:59:11.281358  7745 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:11.281731  7745 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:11.247661  7792 connection.cc:254] RPC call timeout handler was delayed by -1.027257559000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260501 13:59:11.266584  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.016s
I20260501 13:59:11.236676  9440 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:11.268802  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:10.966778  9305 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.256070  9297 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
W20260501 13:59:11.319342  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.003s	sys 0.016s
I20260501 13:59:11.329618  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:11.218099  9402 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.327618  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:11.328176  9422 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
W20260501 13:59:11.306144  7642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.016s	sys 0.013s
I20260501 13:59:11.275358  9254 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:11.330695  7670 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:11.262279  9009 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:11.249897  9425 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:11.339964  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:11.236891  9415 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260501 13:59:11.281903  9377 consensus_meta.cc:287] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 1.160s	user 0.014s	sys 0.000s
I20260501 13:59:10.974851  9343 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.326025  8379 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
W20260501 13:59:11.342880  7642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.016s	sys 0.013s
W20260501 13:59:11.283331  9330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.017s
I20260501 13:59:11.262226  9243 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:11.329382  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.031s	sys 0.037s
I20260501 13:59:11.273156  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:11.260517  9399 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:11.351550  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:11.273301  7748 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:11.353083  9215 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.422607  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:11.423504  7828 raft_consensus.cc:606] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:11.353533  9297 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:11.424795  8379 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:59:11.390390  9343 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.436975  7679 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260501 13:59:11.425063  8374 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:11.356118  7747 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260501 13:59:11.346884  7674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.003s
I20260501 13:59:11.251885  9379 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.352906  7676 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:11.384635  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:11.327629  9380 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:11.387055  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 172) took 1105 ms. Trace:
I20260501 13:59:11.387745  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:11.460510  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 72860.4us
I20260501 13:59:11.461236  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:11.388288  9377 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:11.350889  9125 consensus_meta.cc:287] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.904s	user 0.012s	sys 0.002s
I20260501 13:59:11.359388  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:11.396306  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.033s	sys 0.038s
I20260501 13:59:11.399279  8377 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:11.339310  9440 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:11.401662  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:11.479837  7670 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:11.454767  8373 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 13:59:11.346884  7671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.034s
I20260501 13:59:11.400401  9422 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:11.394133  9330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.005s	sys 0.017s
I20260501 13:59:11.484494  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.244957  9394 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.356657  9254 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:11.421485  9415 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:11.421757  9398 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.415215  7820 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:11.421944  9340 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:11.467517  9353 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:11.405750  9441 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260501 13:59:11.435423  9430 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:11.455430  8379 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:11.280751  9312 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260501 13:59:11.514406  7745 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.459978  7577 rpcz_store.cc:276] 0501 13:59:10.116273 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.116441 (+   168us) service_pool.cc:224] Handling call
0501 13:59:11.221449 (+1105008us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5}
I20260501 13:59:11.474232  8376 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:11.536072  7678 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
W20260501 13:59:11.537705  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:11.548002  9404 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.511466  7821 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260501 13:59:11.548743  7745 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.548673  9404 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.548239  9402 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.509521  9254 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.550097  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.550709  9379 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.550870  9404 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.551883  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.552465  9377 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.553225  8375 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:11.504791  9351 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.512398  9353 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:11.553164  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.554034  9305 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.554272  9353 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.554550  9297 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.555287  7745 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:11.506078  9380 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:11.556654  7745 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:11.558871  8380 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:11.480082  9299 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260501 13:59:11.429586  7748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1377) took 1283 ms (client timeout 1697 ms). Trace:
I20260501 13:59:11.355896  7749 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:11.458374  7674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.003s
I20260501 13:59:11.360549  9425 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:11.485193  7671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.019s	sys 0.035s
W20260501 13:59:11.452319  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:11.510530  7750 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:11.503280  7747 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:11.514482  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:11.577018  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 62626.7us
I20260501 13:59:11.579145  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:11.512293  9445 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260501 13:59:11.589037  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:11.566689  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1010) took 1126 ms. Trace:
I20260501 13:59:11.585919  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.484237  9450 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.503750  9432 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.533829  9451 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.572923  7673 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.591177  7670 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:11.600610  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:11.561163  9430 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:11.632189  7673 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.533499  9439 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.477602  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:11.633934  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 156829us
I20260501 13:59:11.592125  7677 rpcz_store.cc:276] 0501 13:59:10.433796 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.433903 (+   107us) service_pool.cc:224] Handling call
0501 13:59:10.434184 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:10.479409 (+ 45225us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:10.479445 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:10.497929 (+ 18484us) log.cc:844] Serialized 26 byte log entry
0501 13:59:11.248417 (+750488us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:11.273547 (+ 25130us) log.cc:844] Serialized 14 byte log entry
0501 13:59:11.273796 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:11.273873 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:11.560241 (+286368us) raft_consensus.cc:1685] finished
0501 13:59:11.560264 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:11.560388 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44819,"prepare.queue_time_us":25416,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":6494,"raft.queue_time_us":48292,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":54628,"thread_start_us":719003,"threads_started":1,"wal-append.queue_time_us":938368}
I20260501 13:59:11.511935  9340 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.557394  9380 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.594628  9402 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:11.513340  9330 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:11.510833  9415 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:11.623392  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 300546us
I20260501 13:59:11.571802  9299 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:11.504674  9448 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:11.511188  9398 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.644227  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:11.645835  9458 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260501 13:59:11.606470  7826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.039s	sys 0.095s
I20260501 13:59:11.594837  9394 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.601650  9353 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.649438  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:11.489401  9125 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:11.712908  9454 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.735477  7745 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:11.717295  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:11.723245  7670 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:11.727451  7826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.051s	sys 0.099s
I20260501 13:59:11.728075  7676 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:11.649272  9243 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
W20260501 13:59:11.642741  8371 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.023s	sys 0.050s
I20260501 13:59:11.640183  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:11.603415  9395 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:11.640940  9430 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:11.650274  9377 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:11.708014  9402 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:11.709824  9331 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:11.716455  9299 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:11.623972  9450 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.623217  9378 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.115s
I20260501 13:59:11.763042  7746 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:11.764830  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:11.567018  7748 rpcz_store.cc:269] 0501 13:59:10.139476 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.141184 (+  1708us) service_pool.cc:224] Handling call
0501 13:59:11.417918 (+1276734us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:11.769156  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:11.779479  7827 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:11.752084  8371 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.023s	sys 0.050s
I20260501 13:59:11.737222  9399 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:11.763468  9402 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:11.772624  9331 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.728709  9439 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.776297  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:11.777370  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1007) took 1640 ms. Trace:
I20260501 13:59:11.722126  9330 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:11.771929  9395 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:11.799345  7670 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:11.821784  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.805233  7675 rpcz_store.cc:276] 0501 13:59:10.136889 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.137015 (+   126us) service_pool.cc:224] Handling call
0501 13:59:10.239807 (+102792us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:10.240105 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:10.256381 (+ 16276us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:10.256433 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:10.264627 (+  8194us) log.cc:844] Serialized 26 byte log entry
0501 13:59:10.968404 (+703777us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:11.061936 (+ 93532us) log.cc:844] Serialized 14 byte log entry
0501 13:59:11.068508 (+  6572us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:11.068623 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:11.776958 (+708335us) raft_consensus.cc:1685] finished
0501 13:59:11.777094 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:11.777292 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115022,"prepare.queue_time_us":94584,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":24232,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":41580,"spinlock_wait_cycles":3558144,"thread_start_us":648097,"threads_started":1,"wal-append.queue_time_us":976612}
I20260501 13:59:11.833557  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:11.724323  9432 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:11.901911  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 301440us
I20260501 13:59:11.765853  9463 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:11.897749  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:11.899325  7670 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260501 13:59:11.784551  9377 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:11.728171  9448 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.728403  9440 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.716642  9451 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.909439  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.810038  9399 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:11.923444  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:11.789482  9404 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260501 13:59:11.930294  7675 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260501 13:59:11.901402  9379 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:11.728535  9422 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:11.788215  9394 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
I20260501 13:59:11.938131  7670 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:11.940230  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 201300us
I20260501 13:59:11.940745  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:11.941329  8377 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:11.777310  9454 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:11.933141  9452 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.364s	user 0.001s	sys 0.001s
W20260501 13:59:11.939129  7793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.032s
W20260501 13:59:11.948752  7793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.000s	sys 0.033s
I20260501 13:59:11.936520  7673 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260501 13:59:11.897930  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 76309.6us
I20260501 13:59:11.965237  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:11.965752  7677 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:11.934942  9379 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:11.967398  9379 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:11.968292  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:11.969090  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:11.972395  9474 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:11.977988  7670 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260501 13:59:11.985674  8377 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:11.991282  9454 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.003548  9454 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:11.982789  7819 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:11.991753  7675 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260501 13:59:11.992887  9461 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260501 13:59:11.994021  9477 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:11.995168  7670 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:11.996243  8374 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260501 13:59:12.020852  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:12.012660  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:12.022282  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:11.932853  9399 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:11.998886  9451 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.000136  9450 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.002086  9439 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.004844  9377 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.023803  9432 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:11.973857  9296 raft_consensus.cc:2764] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260501 13:59:12.013716  9477 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.015497  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1023) took 1049 ms. Trace:
I20260501 13:59:12.016389  7670 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 3. Ops: []
I20260501 13:59:12.018090  9425 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.018934  9254 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:11.920372  9463 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.026935  7826 rpcz_store.cc:276] 0501 13:59:10.967600 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.969138 (+  1538us) service_pool.cc:224] Handling call
0501 13:59:10.969597 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:10.970078 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:10.970122 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:11.066532 (+ 96410us) log.cc:844] Serialized 26 byte log entry
0501 13:59:11.740112 (+673580us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:11.740174 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:11.740280 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:12.015272 (+274992us) raft_consensus.cc:1685] finished
0501 13:59:12.015296 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:12.015434 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3256,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":2764,"thread_start_us":673119,"threads_started":1,"wal-append.queue_time_us":683553}
I20260501 13:59:12.007351  9340 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:12.077600  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:11.989715  9415 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.265532  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:12.234467  7751 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:12.150731  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:12.243109  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1015) took 1807 ms. Trace:
I20260501 13:59:12.026400  9395 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.011509  9468 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.074538  9125 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.233392  8374 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:12.299386  7672 rpcz_store.cc:276] 0501 13:59:10.436130 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.744462 (+308332us) service_pool.cc:224] Handling call
0501 13:59:10.744930 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:11.255184 (+510254us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:11.255215 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:11.255789 (+   574us) log.cc:844] Serialized 26 byte log entry
0501 13:59:11.631600 (+375811us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:12.106501 (+474901us) log.cc:844] Serialized 14 byte log entry
0501 13:59:12.242754 (+136253us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:12.242847 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:12.242895 (+    48us) raft_consensus.cc:1685] finished
0501 13:59:12.242908 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:12.243045 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230221,"prepare.queue_time_us":139591,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":182815,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":26394,"thread_start_us":1151283,"threads_started":3,"wal-append.queue_time_us":646123}
W20260501 13:59:12.314085  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 411159us
I20260501 13:59:12.027184  9398 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.340273  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2028) took 1078 ms. Trace:
W20260501 13:59:12.340600  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 399569us
W20260501 13:59:12.245630  9389 consensus_meta.cc:287] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.025s	user 0.012s	sys 0.001s
I20260501 13:59:12.031163  9451 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:12.131027  9432 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.274521  9472 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.351742  7678 rpcz_store.cc:276] 0501 13:59:11.253006 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.327355 (+ 74349us) service_pool.cc:224] Handling call
0501 13:59:12.330679 (+1003324us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540019bc54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:12.330887 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457130880}
W20260501 13:59:12.100739  9332 consensus_meta.cc:287] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.818s	user 0.012s	sys 0.001s
I20260501 13:59:12.347110  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:12.307893  9462 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260501 13:59:12.353421  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:12.357405  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:12.274977  9475 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.293533  9330 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.307396  9331 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.372083  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.376778  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:12.274708  9473 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.359510  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2025) took 1107 ms. Trace:
I20260501 13:59:12.372828  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:12.307060  9340 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.375957  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:12.077538  9254 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.390327  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:12.390815  9463 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.377980  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:12.385716  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:12.385936  7828 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:12.395663  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.396267  7828 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:12.387712  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:12.389532  9351 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:12.389674  9399 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:12.376454  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 353055us
I20260501 13:59:12.356287  9448 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.399394  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.401794  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:12.405519  7745 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:12.397099  7828 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.415511  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.394755  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:12.369964  9398 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.395231  7673 rpcz_store.cc:276] 0501 13:59:11.252168 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.748950 (+496782us) service_pool.cc:224] Handling call
0501 13:59:11.841958 (+ 93008us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:11.964980 (+123022us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:12.359303 (+394323us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b540005a0d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:12.359446 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212677888}
I20260501 13:59:12.331645  9379 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.423076  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:12.395722  9356 consensus_meta.cc:287] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.451s	user 0.015s	sys 0.000s
I20260501 13:59:12.425738  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 258) took 1248 ms. Trace:
I20260501 13:59:12.428959  7754 rpcz_store.cc:276] 0501 13:59:11.170708 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.172198 (+  1490us) service_pool.cc:224] Handling call
0501 13:59:11.172480 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:11.352394 (+179914us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:11.352432 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:11.352490 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:11.352522 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:12.419387 (+1066865us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400116554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:12.419434 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:12.419558 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413277440}
I20260501 13:59:12.362231  9415 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260501 13:59:12.439102  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 65833.6us
I20260501 13:59:12.346650  9395 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:12.425822  9430 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.002s
I20260501 13:59:12.406674  9478 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.403934  9330 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.375080  9389 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:12.448168  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53581.7us
I20260501 13:59:12.375666  9332 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.446769  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.420970  8371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 167) took 2006 ms. Trace:
I20260501 13:59:12.394091  9340 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:12.548671  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 95628.1us
I20260501 13:59:12.415424  9451 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260501 13:59:12.340989  9468 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.374205  9432 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.454768  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:12.519330  7747 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:12.438251  9356 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.395488  9473 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.501042  9478 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.454593  9430 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.449501  9482 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.522531  9332 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.450090  9399 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:12.454470  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.523489  7670 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 3. Ops: []
I20260501 13:59:12.451763  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:12.524472  9389 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.432279  9254 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.447059  9483 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.527182  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:12.647435  7825 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:12.435336  9398 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.449153  9448 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.598186  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:12.616600  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 67009.3us
I20260501 13:59:12.377864  9472 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:12.553027  9474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.008s	sys 0.015s
I20260501 13:59:12.622143  9356 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.622835  9430 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.391461  9475 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.501780  9330 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.558629  9351 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:12.554044  9484 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:12.626184  9380 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:12.659516  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:12.609273  9425 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.656774  9482 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.656564  9448 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.657927  9483 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:12.674367  9481 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260501 13:59:12.674664  9468 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.627210  9463 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260501 13:59:12.647156  9332 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.729435  7825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:12.754070  7825 raft_consensus.cc:606] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:12.753811  9332 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:12.677282  9487 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260501 13:59:12.761580  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 103358us
I20260501 13:59:12.677681  9379 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.680990  9398 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.682384  9340 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.683909  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:12.657331  9477 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.528599  8371 rpcz_store.cc:276] 0501 13:59:10.414497 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.416322 (+  1825us) service_pool.cc:224] Handling call
0501 13:59:10.815851 (+399529us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606a3e 000000000035a3c9 00007fb2ff63e8e0 00007fb2ff707784 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:10.816032 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:10.816267 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 3
0501 13:59:11.807684 (+991417us) log.cc:844] Serialized 14 byte log entry
0501 13:59:12.372747 (+565063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:12.375871 (+  3124us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:12.384970 (+  9099us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:12.393733 (+  8763us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:12.413719 (+ 19986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4765,"prepare.queue_time_us":8466,"prepare.run_cpu_time_us":164,"prepare.run_wall_time_us":164,"raft.queue_time_us":42820,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5496,"spinlock_wait_cycles":29308160,"thread_start_us":1351836,"threads_started":2,"wal-append.queue_time_us":512902}
I20260501 13:59:12.650138  9399 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:12.667354  9474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.008s	sys 0.016s
I20260501 13:59:12.767695  9380 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:12.773416  7745 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:12.690644  9299 consensus_meta.cc:287] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.917s	user 0.008s	sys 0.006s
W20260501 13:59:12.781432  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:12.776216  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:12.787063  7747 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:12.818416  9479 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260501 13:59:12.768669  9415 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.819075  7748 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260501 13:59:12.781389  9473 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.733677  9440 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:12.829985  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.831140  9480 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260501 13:59:12.782188  9398 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:12.829244  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.849985  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.851883  7745 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:12.853346  7745 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:12.849110  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:12.865137  7821 raft_consensus.cc:606] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:12.865810  7821 raft_consensus.cc:630] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Rejecting request to transfer leadership because tablet server bc1b0a0a152e46fea4bd4934ba9976ed is not a voter in the active config
W20260501 13:59:12.866242  9495 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 13:59:12.867885  9398 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.868453  9448 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.804595  9474 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:12.874636  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.884092  9478 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.827971  9332 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.885462  9498 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.877606  9398 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.888715  9498 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.846197  9395 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.877525  9472 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.773607  9484 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.824676  9299 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.865183  9482 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.918617  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:12.900795  9009 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 1.516s	user 0.015s	sys 0.000s
I20260501 13:59:12.920317  9009 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.921523  9439 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:12.922043  9439 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.922781  9009 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.923990  9439 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.908290  9477 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:12.931398  9477 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.932868  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:12.933810  7821 raft_consensus.cc:606] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:12.934959  9477 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.935956  9478 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.936756  9478 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.899998  9432 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.897717  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:12.832810  9415 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.941160  9432 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:12.869465  9440 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:12.890163  9351 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.946166  8379 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:12.877885  9380 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.944020  9432 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.935968  9475 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.941278  9477 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.947398  9439 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:12.952272  9299 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.952585  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:12.948140  9402 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.115s	user 0.007s	sys 0.007s
I20260501 13:59:12.962042  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:12.964897  9478 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:12.942286  9399 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.970382  9402 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.976936  9402 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:12.946745  9483 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:12.977065  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:12.983197  8380 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:12.981396  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 457081us
I20260501 13:59:12.967940  9395 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:12.966251  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:12.989238  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:12.969965  9330 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.000486  9498 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:13.001470  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.011s
I20260501 13:59:12.964474  9477 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:12.968220  9439 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.083611  8381 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:13.081940  8343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.009s	sys 0.004s
W20260501 13:59:13.087966  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:13.021026  8380 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:13.089749  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 176) took 1149 ms. Trace:
I20260501 13:59:13.091509  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:13.002516  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.000s	sys 0.011s
I20260501 13:59:13.090458  8380 rpcz_store.cc:276] 0501 13:59:11.940689 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.946362 (+  5673us) service_pool.cc:224] Handling call
0501 13:59:12.976533 (+1030171us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:13.089666 (+113133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14060800}
I20260501 13:59:13.095542  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.096182  7826 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:12.965536  9474 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:13.100955  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 514283us
I20260501 13:59:13.101754  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.102233  7826 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.002501  9483 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:13.003930  9484 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.103982  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:13.107028  7643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.638s (SENT) [suppressed 2 similar messages]
I20260501 13:59:13.007033  7822 raft_consensus.cc:606] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:13.110177  8380 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.112440  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:13.108057  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.107769  9499 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:13.105783  9483 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:13.114307  8375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 331) took 2758 ms (client timeout 1638 ms). Trace:
I20260501 13:59:13.014385  9432 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.115876  9439 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.086457  9498 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:13.080133  9440 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:13.128605  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.089381  9402 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.090797  9330 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.136554  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:13.082468  8373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 329) took 2957 ms (client timeout 1885 ms). Trace:
I20260501 13:59:13.103523  9425 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:13.106227  9312 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:13.117595  9415 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.160517  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.160658  7826 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.161290  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.138363  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:13.165256  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.149865  9483 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:13.152632  7821 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:13.179414  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.180413  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.196333  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.149931  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.201951  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.202862  7747 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:13.204005  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.189092  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.190042  9496 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:13.168673  9440 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:13.205977  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:13.210186  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.213258  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.165971  9498 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.186192  9415 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:13.224251  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.225695  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.174151  9330 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.208563  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:13.151029  8375 rpcz_store.cc:269] 0501 13:59:10.355953 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.366360 (+ 10407us) service_pool.cc:224] Handling call
0501 13:59:13.114048 (+2747688us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540060bb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.114228 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338142080}
I20260501 13:59:13.169998  9402 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.215117  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.234484  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:13.227151  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48941.8us
I20260501 13:59:13.216092  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.178715  9312 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:13.218120  9471 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:13.231770  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 124769us
I20260501 13:59:13.218783  9496 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:13.222685  9477 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.237964  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:13.170928  8373 rpcz_store.cc:269] 0501 13:59:10.125088 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.140515 (+ 15427us) service_pool.cc:224] Handling call
0501 13:59:10.259921 (+119406us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:13.082149 (+2822228us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54007102d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.082355 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384975872}
I20260501 13:59:13.249943  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:13.251505  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:13.252422  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:13.255061  8380 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.236780  7822 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.229274  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.233531  9455 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:13.245934  9459 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 1.605s	user 0.007s	sys 0.020s
I20260501 13:59:13.245810  9402 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.272035  7748 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.272197  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.273243  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.273617  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.274894  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.277438  9498 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.277058  9496 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.247522  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 695) took 1911 ms. Trace:
I20260501 13:59:13.247807  9312 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.248497  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.243595  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.238258  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:13.265934  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.228271  9415 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.271793  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:13.243584  9503 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:13.280130  8381 rpcz_store.cc:276] 0501 13:59:11.336583 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.336720 (+   137us) service_pool.cc:224] Handling call
0501 13:59:13.083394 (+1746674us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:13.087124 (+  3730us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.247299 (+160175us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54007102d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.247455 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3978330880}
I20260501 13:59:13.285341  7747 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.289140  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.266909  9425 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:13.289932  9402 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:13.290624  9425 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.288019  9498 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:13.291250  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.266717  9477 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:13.299693  7754 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:13.286274  9312 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.275593  8373 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:13.307379  9415 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.307669  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 148) took 2865 ms. Trace:
I20260501 13:59:13.300844  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.301154  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.303535  9312 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.304134  9330 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.304317  9402 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:13.286427  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.275130  9455 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:13.304816  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:13.303195  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.286450  9499 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:13.320515  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2073) took 2129 ms. Trace:
I20260501 13:59:13.321130  7746 rpcz_store.cc:276] 0501 13:59:11.183273 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.183405 (+   132us) service_pool.cc:224] Handling call
0501 13:59:11.183710 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:11.778882 (+595172us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.312332 (+1533450us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54000af354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:13.312515 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331848576}
W20260501 13:59:13.326004  7823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1025) took 2034 ms (client timeout 2467 ms). Trace:
W20260501 13:59:13.326640  7823 rpcz_store.cc:269] 0501 13:59:11.284964 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.285122 (+   158us) service_pool.cc:224] Handling call
0501 13:59:13.300994 (+2015872us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:13.319072 (+ 18078us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7973760}
I20260501 13:59:13.332191  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.335386  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.309580  9498 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:13.342268  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.344486  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.346095  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.309284  9477 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.317622  9499 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.351001  9473 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:13.352090  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.352464  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.353199  9416 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:13.353375  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.354025  7823 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.354673  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:13.354895  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.355413  9416 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:13.355767  9416 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:13.356165  9416 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:13.339998  9415 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:13.340811  9402 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:13.344640  9501 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:13.357735  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.366020  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.343006  9332 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:13.367563  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:13.369439  8380 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:13.350106  9399 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:13.370970  9501 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.372073  9402 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:13.372174  9498 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.373057  9477 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.373219  9312 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.388163  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2036) took 2133 ms. Trace:
I20260501 13:59:13.388625  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.390226  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2021) took 2151 ms. Trace:
I20260501 13:59:13.380416  9402 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.397871  9402 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.377223  9332 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:13.390725  7679 rpcz_store.cc:276] 0501 13:59:11.239123 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.241037 (+  1914us) service_pool.cc:224] Handling call
0501 13:59:11.241370 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:11.437537 (+196167us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.389963 (+1952426us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540019cb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:13.390168 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438879488}
I20260501 13:59:13.398734  9332 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.399163  9499 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:13.381162  9455 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:13.400712  9332 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.375204  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:13.403180  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:13.404546  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.404940  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:13.405767  8380 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:13.360469  9330 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:13.375332  7747 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.366717  9415 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:13.365849  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.381870  9501 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 13:59:13.385951  7676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1020) took 2052 ms (client timeout 2023 ms). Trace:
I20260501 13:59:13.399677  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.360956  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.388607  7670 rpcz_store.cc:276] 0501 13:59:11.255390 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.028776 (+773386us) service_pool.cc:224] Handling call
0501 13:59:12.146759 (+117983us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:12.644778 (+498019us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.387895 (+743117us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54003601d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:13.388102 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865900416}
W20260501 13:59:13.414023  7676 rpcz_store.cc:269] 0501 13:59:11.333925 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.588708 (+254783us) service_pool.cc:224] Handling call
0501 13:59:13.385747 (+1797039us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540004ced4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.385877 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313069824}
I20260501 13:59:13.408157  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.411850  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.378082  9399 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:13.415094  7679 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:13.419394  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:13.420655  7677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1027) took 2030 ms (client timeout 2218 ms). Trace:
I20260501 13:59:13.420440  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:13.421203  7677 rpcz_store.cc:269] 0501 13:59:11.390393 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.717014 (+326621us) service_pool.cc:224] Handling call
0501 13:59:13.420479 (+1703465us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540005a5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.420595 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454095616}
I20260501 13:59:13.421402  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:13.422544  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.423249  7677 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:13.423511  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.423194  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:13.453541  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:13.425715  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.424448  7823 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:13.493202  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.477085  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.413175  9415 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:13.424726  9484 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:13.497833  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.498425  9484 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.498525  7823 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.498911  9484 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:13.499533  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.414306  9330 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.500699  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:13.501850  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.497900  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.502655  7747 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:13.503578  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.496937  7677 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:13.505443  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.506534  7676 raft_consensus.cc:2368] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:13.495592  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.508306  7670 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:13.511463  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.415666  9402 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:13.472831  9492 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:13.420351  9399 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.513381  9492 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.424786  9473 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:13.513773  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.514478  9473 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:13.514848  7677 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:13.516463  9330 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.517166  9422 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260501 13:59:13.517906  9481 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260501 13:59:13.521377  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:13.421373  9312 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:13.523391  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 99950.6us
I20260501 13:59:13.526526  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:13.472150  9455 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.532254  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.535071  7670 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:13.536424  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.513862  9492 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:13.540231  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.549177  7676 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:13.549496  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.544127  7823 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.421622  9332 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:13.552323  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.555022  7747 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260501 13:59:13.556615  7717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.836s	user 0.020s	sys 0.047s
W20260501 13:59:13.556923  7717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.853s	user 0.020s	sys 0.047s
I20260501 13:59:13.472440  9483 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.522092  9402 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.564563  7677 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:13.570829  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.572162  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.573351  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:13.574095  7821 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:13.574813  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:13.565924  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.575724  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 157) took 2290 ms. Trace:
I20260501 13:59:13.579118  9515 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:13.581303  7673 rpcz_store.cc:276] 0501 13:59:11.284828 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.419210 (+1134382us) service_pool.cc:224] Handling call
0501 13:59:12.419621 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:12.672586 (+252965us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:12.672621 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:12.672667 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:12.672701 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.575514 (+902813us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540024c054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:13.575561 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:13.575668 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581269248}
I20260501 13:59:13.591368  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.592370  7823 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:13.584574  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 158) took 2254 ms. Trace:
I20260501 13:59:13.593001  7670 rpcz_store.cc:276] 0501 13:59:11.329797 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.583843 (+2254046us) service_pool.cc:224] Handling call
0501 13:59:13.584128 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:13.584289 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:13.584313 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:13.584351 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:13.584380 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.584430 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:13.584521 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:13.592634  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.595386  7673 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:13.596611  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.597929  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.598723  7673 raft_consensus.cc:2368] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:13.599512  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.605818  7673 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:13.551390  9312 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:13.556907  9380 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:13.515009  9473 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.308084  7674 rpcz_store.cc:276] 0501 13:59:10.441837 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.810798 (+368961us) service_pool.cc:224] Handling call
0501 13:59:10.811258 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:10.811766 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:10.811803 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:10.812414 (+   611us) log.cc:844] Serialized 26 byte log entry
0501 13:59:11.574694 (+762280us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:11.640581 (+ 65887us) log.cc:844] Serialized 14 byte log entry
0501 13:59:11.946701 (+306120us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:11.952269 (+  5568us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:12.920118 (+967849us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18002cad00. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:13.245260 (+325142us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:13.307411 (+ 62151us) raft_consensus.cc:1685] finished
0501 13:59:13.307444 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:13.307586 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28548,"prepare.queue_time_us":152442,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":236204,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":16110,"spinlock_wait_cycles":197996160,"thread_start_us":960401,"threads_started":2,"wal-append.queue_time_us":701941}
I20260501 13:59:13.658605  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.565834  9402 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:13.725623  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 150852us
I20260501 13:59:13.727268  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.728266  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:13.583305  9332 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:13.589026  9425 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:13.769287  7753 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:13.770402  7670 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:13.661787  9395 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:13.659505  9513 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:13.783674  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 56468.4us
W20260501 13:59:13.784634  7750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 251) took 3367 ms (client timeout 2438 ms). Trace:
W20260501 13:59:13.801369  7750 rpcz_store.cc:269] 0501 13:59:10.401390 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.401616 (+   226us) service_pool.cc:224] Handling call
0501 13:59:13.711487 (+3309871us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001072d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.768750 (+ 57263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472394496}
I20260501 13:59:13.801671  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:13.785874  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.556219  9455 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.794773  7677 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
W20260501 13:59:13.808738  9522 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260501 13:59:13.771555  7821 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:13.670081  9515 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.784085  9498 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:13.829463  9530 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:13.830336  7749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1378) took 3475 ms (client timeout 1690 ms). Trace:
W20260501 13:59:13.847779  7749 rpcz_store.cc:269] 0501 13:59:10.355373 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.358925 (+  3552us) service_pool.cc:224] Handling call
0501 13:59:13.830041 (+3471116us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400115b54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.830250 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030678272}
I20260501 13:59:13.830801  9455 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:13.832015  7752 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:13.851912  9498 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:13.785248  9312 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.797593  9395 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:13.815068  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:13.854888  7677 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:13.842687  7673 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:13.823455  7821 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:13.862143  9525 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260501 13:59:13.794077  9425 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.826342  9526 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:13.902635  9521 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260501 13:59:13.868017  9395 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:13.852437  9498 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:13.887548  9457 log.cc:927] Time spent T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 2.249s	user 0.009s	sys 0.009s
I20260501 13:59:13.888164  9531 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:13.792879  9479 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.065s	sys 0.089s
W20260501 13:59:13.892179  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:13.825379  9513 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.865326  9501 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.878923  7823 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.913507  9527 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:13.897128  9416 consensus_meta.cc:287] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260501 13:59:13.946785  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:13.947400  7823 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:13.947736  7823 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:13.860081  9484 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:13.925259  9305 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:13.915726  9479 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.065s	sys 0.090s
I20260501 13:59:13.859850  9312 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.928561  8372 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:13.860378  9530 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.975399  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 697) took 2625 ms. Trace:
W20260501 13:59:13.938741  9524 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260501 13:59:13.938539  9483 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:13.939455  7819 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1043) took 2025 ms (client timeout 1988 ms). Trace:
I20260501 13:59:13.940402  9531 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:13.942209  7821 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.943146  9513 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:13.943324  9473 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:13.946630  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 698) took 2575 ms. Trace:
I20260501 13:59:13.952481  7823 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.949970  8381 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:14.104249  7823 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 5
I20260501 13:59:14.104046  8376 rpcz_store.cc:276] 0501 13:59:11.358782 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.359456 (+   674us) service_pool.cc:224] Handling call
0501 13:59:11.473968 (+114512us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:11.535629 (+ 61661us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.934199 (+2398570us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b540051e5d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.934401 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157801344}
W20260501 13:59:13.958787  7822 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.000s
I20260501 13:59:14.007011  7679 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:13.975883  8372 rpcz_store.cc:276] 0501 13:59:11.350125 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.359499 (+  9374us) service_pool.cc:224] Handling call
0501 13:59:13.890401 (+2530902us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:13.928251 (+ 37850us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:13.975004 (+ 46753us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.975318 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11274496}
I20260501 13:59:14.117425  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 146) took 3676 ms. Trace:
I20260501 13:59:13.953158  9416 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:13.944887  9332 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.118091  7671 rpcz_store.cc:276] 0501 13:59:10.441156 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:10.784376 (+343220us) service_pool.cc:224] Handling call
0501 13:59:10.784910 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:10.785291 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:10.785324 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:10.785997 (+   673us) log.cc:844] Serialized 26 byte log entry
0501 13:59:11.575371 (+789374us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:11.729968 (+154597us) log.cc:844] Serialized 14 byte log entry
0501 13:59:11.935871 (+205903us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:11.935987 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:13.580055 (+1644068us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:14.109014 (+528959us) raft_consensus.cc:1685] finished
0501 13:59:14.117090 (+  8076us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.117329 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77927,"prepare.queue_time_us":177526,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":231396,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":6911,"spinlock_wait_cycles":13522816,"thread_start_us":994479,"threads_started":2,"wal-append.queue_time_us":750171}
I20260501 13:59:14.105324  9425 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.114243  7822 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:13.976578  9530 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:14.140457  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 156) took 2855 ms. Trace:
I20260501 13:59:14.141526  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2075) took 2951 ms. Trace:
I20260501 13:59:14.148238  7752 rpcz_store.cc:276] 0501 13:59:11.189901 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.223916 (+ 34015us) service_pool.cc:224] Handling call
0501 13:59:13.831754 (+2607838us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:13.849570 (+ 17816us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.141234 (+291664us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400115b50. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.141442 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5996586880}
I20260501 13:59:14.121157  7821 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:14.148017  7678 rpcz_store.cc:276] 0501 13:59:11.284535 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.368863 (+1084328us) service_pool.cc:224] Handling call
0501 13:59:12.369192 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:12.694231 (+325039us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:12.694281 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:12.694357 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:12.694402 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.140090 (+1445688us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540024b654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:14.140158 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.140369 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746858880}
I20260501 13:59:14.144268  7671 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260501 13:59:14.129820  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 328213us
I20260501 13:59:14.151938  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1024) took 2795 ms. Trace:
I20260501 13:59:14.153115  7671 rpcz_store.cc:276] 0501 13:59:11.356734 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.140219 (+2783485us) service_pool.cc:224] Handling call
0501 13:59:14.140671 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.151531 (+ 10860us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.151860 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.150391  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1257) took 1002 ms. Trace:
I20260501 13:59:14.164526  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.173319  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.155490  7822 rpcz_store.cc:276] 0501 13:59:13.143925 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.172167 (+ 28242us) service_pool.cc:224] Handling call
0501 13:59:14.146184 (+974017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.176087  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.179191  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:14.104120  7819 rpcz_store.cc:269] 0501 13:59:11.914269 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.933470 (+ 19201us) service_pool.cc:224] Handling call
0501 13:59:13.939205 (+2005735us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b54003c7b54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:13.939369 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10210688}
I20260501 13:59:14.185746  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.186682  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.206271  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.193070  7750 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:14.207304  7820 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:14.188898  9125 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:14.216041  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.207913  9514 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election won for term 2
W20260501 13:59:14.220049  7827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1041) took 2318 ms (client timeout 1815 ms). Trace:
W20260501 13:59:14.221343  7827 rpcz_store.cc:269] 0501 13:59:11.898736 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.908703 (+  9967us) service_pool.cc:224] Handling call
0501 13:59:14.215807 (+2307104us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:14.217007 (+  1200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3649408}
I20260501 13:59:14.222680  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.209923  9515 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:14.213402  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.229493  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.215835  9484 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.219553  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1048) took 1231 ms. Trace:
I20260501 13:59:14.231421  7827 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:14.241215  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.241823  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.243289  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.241863  7750 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:14.244910  7827 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:14.243523  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 180568us
I20260501 13:59:14.245566  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.227989  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.250411  8376 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:14.228922  9440 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:14.244681  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:14.220235  9125 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.266225  7827 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:14.255550  7823 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:14.263756  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.267704  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.267964  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.268306  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.226406  9312 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.230811  9514 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:14.271013  7827 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
W20260501 13:59:14.251624  9480 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.013s	sys 0.010s
I20260501 13:59:14.270083  7823 raft_consensus.cc:2410] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260501 13:59:14.243786  9515 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:14.240960  7822 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:14.271538  7827 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:14.325109  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 50847us
I20260501 13:59:14.261350  9440 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:14.338209  7751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1383) took 3000 ms (client timeout 1931 ms). Trace:
W20260501 13:59:14.272332  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 93278.4us
I20260501 13:59:14.269563  9484 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
W20260501 13:59:14.342183  7751 rpcz_store.cc:269] 0501 13:59:11.337606 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.340259 (+  2653us) service_pool.cc:224] Handling call
0501 13:59:14.337911 (+2997652us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54000ada54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.338113 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750629760}
I20260501 13:59:14.270373  9485 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:14.343873  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.269500  9458 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:14.336366  9515 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.356805  9515 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:14.275053  9480 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.013s	sys 0.010s
I20260501 13:59:14.357498  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.358381  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1052) took 1133 ms. Trace:
I20260501 13:59:14.358714  7824 rpcz_store.cc:276] 0501 13:59:13.224618 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.348625 (+124007us) service_pool.cc:224] Handling call
0501 13:59:14.357315 (+1008690us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:14.358312 (+   997us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6344576}
I20260501 13:59:14.360541  9535 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:14.361730  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2082) took 1592 ms. Trace:
I20260501 13:59:14.365716  7643 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.367008  9498 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.368220  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:14.369326  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 343) took 1240 ms. Trace:
I20260501 13:59:14.369738  8377 rpcz_store.cc:276] 0501 13:59:13.128690 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.367803 (+1239113us) service_pool.cc:224] Handling call
0501 13:59:14.369247 (+  1444us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:14.303912  9399 consensus_meta.cc:287] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260501 13:59:14.371189  9399 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.372113  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 235) took 1923 ms. Trace:
I20260501 13:59:14.373207  9399 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:14.373598  9395 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.262084  9402 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.377281  9402 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.276724  9416 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:14.380015  7671 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:14.382200  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1054) took 1119 ms. Trace:
I20260501 13:59:14.382601  7819 rpcz_store.cc:276] 0501 13:59:13.263002 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.381350 (+1118348us) service_pool.cc:224] Handling call
0501 13:59:14.381711 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.381888 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.381916 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.381960 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.381990 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.382043 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.382144 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.266793  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:14.384279  8372 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:14.386272  9514 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:14.362215  7754 rpcz_store.cc:276] 0501 13:59:12.769353 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.770491 (+  1138us) service_pool.cc:224] Handling call
0501 13:59:12.803550 (+ 33059us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:13.300153 (+496603us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.361396 (+1061243us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000aee54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:14.361651 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140502784}
I20260501 13:59:14.372625  7825 rpcz_store.cc:276] 0501 13:59:12.448727 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.754954 (+306227us) service_pool.cc:224] Handling call
0501 13:59:13.939982 (+1185028us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:13.940188 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:13.940218 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:13.940265 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:13.940301 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:13.940370 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.371857 (+431487us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003c7b50. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.372006 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724538624}
I20260501 13:59:14.390188  9125 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.375594  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1032) took 1382 ms. Trace:
I20260501 13:59:14.391235  7677 rpcz_store.cc:276] 0501 13:59:12.993207 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.374542 (+1381335us) service_pool.cc:224] Handling call
0501 13:59:14.374956 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.375180 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.375218 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.375279 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.375323 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.375395 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.375525 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.393716  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1035) took 1399 ms. Trace:
I20260501 13:59:14.394277  7677 rpcz_store.cc:276] 0501 13:59:12.994135 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.392655 (+1398520us) service_pool.cc:224] Handling call
0501 13:59:14.393070 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.393297 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.393334 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.393380 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0501 13:59:14.393425 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.393511 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.393648 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.352892  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.240931  7820 rpcz_store.cc:276] 0501 13:59:12.987178 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.992785 (+  5607us) service_pool.cc:224] Handling call
0501 13:59:14.206072 (+1213287us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:14.218370 (+ 12298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7723264}
I20260501 13:59:14.403371  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 159) took 1408 ms. Trace:
I20260501 13:59:14.374068  7674 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:14.398437  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:14.404711  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:14.404251  7677 rpcz_store.cc:276] 0501 13:59:12.994753 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.400664 (+1405911us) service_pool.cc:224] Handling call
0501 13:59:14.402664 (+  2000us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.402944 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.402990 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.403052 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.403095 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.403167 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.403303 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:14.401963  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49187.8us
I20260501 13:59:14.375577  9395 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.352428  8344 leader_election.cc:400] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:14.394093  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.351225  7827 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:14.274466  9415 consensus_meta.cc:287] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.001s
I20260501 13:59:14.325520  9531 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.406075  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.407999  7827 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:14.408085  9415 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.409694  7675 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:14.409976  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.410980  9541 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:14.411495  9415 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:14.336349  9499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.014s
I20260501 13:59:14.408810  9502 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260501 13:59:14.412619  9499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.007s	sys 0.015s
I20260501 13:59:14.402256  7750 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:14.343428  9440 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:14.356832  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:14.417676  7827 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:14.407894  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 162) took 1387 ms. Trace:
I20260501 13:59:14.419955  8344 leader_election.cc:403] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260501 13:59:14.420114  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1051) took 1214 ms. Trace:
W20260501 13:59:14.420819  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77025.6us
I20260501 13:59:14.421424  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:14.419924  7677 rpcz_store.cc:276] 0501 13:59:13.020276 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.406895 (+1386619us) service_pool.cc:224] Handling call
0501 13:59:14.407258 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.407476 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.407513 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.407567 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.407608 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.407669 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.407804 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.403765  9125 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:14.417589  9492 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.003s
I20260501 13:59:14.424252  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:14.421159  7827 rpcz_store.cc:276] 0501 13:59:13.205780 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.270602 (+1064822us) service_pool.cc:224] Handling call
0501 13:59:14.270893 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.419671 (+148778us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.420046 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.449383  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.416689  9312 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:14.446658  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:14.441761  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 163) took 1385 ms. Trace:
W20260501 13:59:14.450683  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:14.368374  9538 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260501 13:59:14.450899  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:14.455607  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:14.451076  7827 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:14.456014  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.458428  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:14.458945  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.459581  7827 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:14.461340  9458 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:14.461916  9458 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:14.463327  9541 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:14.450667  9312 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:14.465727  9312 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:14.468853  9485 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:14.459859  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:14.430552  9009 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:14.424813  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 181) took 1274 ms. Trace:
I20260501 13:59:14.423359  9531 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:14.459491  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.419613  9484 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:14.452623  9125 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:14.450838  7677 rpcz_store.cc:276] 0501 13:59:13.056070 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.440559 (+1384489us) service_pool.cc:224] Handling call
0501 13:59:14.441032 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.441267 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.441305 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.441367 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.441414 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.441494 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.441682 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.466904  9312 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.415892  9501 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260501 13:59:14.453761  9415 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:14.472223  9502 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:14.425591  9095 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:14.449759  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1055) took 1185 ms. Trace:
I20260501 13:59:14.478833  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.483541  7677 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:14.455420  9492 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.475556  9541 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:14.482930  9539 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:14.491140  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:14.495941  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:14.481171  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:14.480304  9125 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:14.486164  9095 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:14.508395  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.512377  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.513130  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:14.514094  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.484731  9415 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:14.475298  8375 rpcz_store.cc:276] 0501 13:59:13.150068 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.356459 (+1206391us) service_pool.cc:224] Handling call
0501 13:59:14.424744 (+ 68285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.532369  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.533196  7752 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:14.518105  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.497936  9541 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:14.515453  9499 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:14.522933  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:14.496634  9531 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:14.525493  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.515543  9492 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.565011  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:14.488236  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2039) took 1235 ms. Trace:
I20260501 13:59:14.517563  9395 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:14.518302  9125 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:14.560658  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.564965  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:14.567430  7677 rpcz_store.cc:276] 0501 13:59:13.252574 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.483026 (+1230452us) service_pool.cc:224] Handling call
0501 13:59:14.483361 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.487947 (+  4586us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.488176 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.531003  9415 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:14.573836  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:14.479790  9458 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:14.574708  8379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 173) took 2640 ms (client timeout 1743 ms). Trace:
I20260501 13:59:14.575048  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:14.559168  9541 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:14.578890  7677 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:14.559660  9499 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:14.519284  9502 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260501 13:59:14.578387  8379 rpcz_store.cc:269] 0501 13:59:11.934109 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.944647 (+ 10538us) service_pool.cc:224] Handling call
0501 13:59:12.357249 (+412602us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:14.574521 (+2217272us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54002f35d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.574646 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325910656}
I20260501 13:59:14.583539  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:14.584645  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:14.564720  9498 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:14.570580  9395 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:14.570358  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.599360  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.580986  9299 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:14.496354  7822 rpcz_store.cc:276] 0501 13:59:13.263930 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.405619 (+1141689us) service_pool.cc:224] Handling call
0501 13:59:14.441428 (+ 35809us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.449371 (+  7943us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.449417 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.449473 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.449508 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.449572 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.449699 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.623112  7752 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:14.627796  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.565490  9484 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.586472  9499 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:14.598239  9492 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:14.645147  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:14.621624  9395 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:14.660491  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:14.630111  8372 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:14.628847  9247 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:14.628793  9332 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:14.664086  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1268) took 1304 ms. Trace:
W20260501 13:59:14.648509  9548 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260501 13:59:14.582656  9095 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.686096  9095 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:14.690433  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1022) took 3355 ms. Trace:
I20260501 13:59:14.690950  7676 rpcz_store.cc:276] 0501 13:59:11.335062 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.824100 (+2489038us) service_pool.cc:224] Handling call
0501 13:59:13.826604 (+  2504us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:14.239607 (+413003us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.239642 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:14.248885 (+  9243us) log.cc:844] Serialized 26 byte log entry
0501 13:59:14.525474 (+276589us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:14.525514 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.525586 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:14.690176 (+164590us) raft_consensus.cc:1685] finished
0501 13:59:14.690208 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.690369 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5839,"raft.queue_time_us":85416,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":124,"thread_start_us":667340,"threads_started":2,"wal-append.queue_time_us":391257}
I20260501 13:59:14.693849  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1031) took 1701 ms. Trace:
I20260501 13:59:14.694046  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 166) took 1123 ms. Trace:
I20260501 13:59:14.694288  7671 rpcz_store.cc:276] 0501 13:59:12.992909 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.154239 (+1161330us) service_pool.cc:224] Handling call
0501 13:59:14.154661 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.380451 (+225790us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.693616 (+313165us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540004ddd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:14.693790 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517800704}
I20260501 13:59:14.694599  7676 rpcz_store.cc:276] 0501 13:59:13.570565 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.692995 (+1122430us) service_pool.cc:224] Handling call
0501 13:59:14.693393 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.693635 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.693674 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.693735 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.693781 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.693853 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.693975 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:14.696154  9558 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260501 13:59:14.697309  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1053) took 1457 ms. Trace:
I20260501 13:59:14.698419  9332 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.699626  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2079) took 3474 ms. Trace:
I20260501 13:59:14.700049  7753 rpcz_store.cc:276] 0501 13:59:11.225657 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:11.227010 (+  1353us) service_pool.cc:224] Handling call
0501 13:59:13.768907 (+2541897us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:13.788290 (+ 19383us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.699422 (+911132us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54001072d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.699565 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5798355328}
I20260501 13:59:14.701072  9332 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:14.702108  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.702925  7822 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:14.655557  9492 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:14.677134  9511 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 1.528s	user 0.008s	sys 0.009s
I20260501 13:59:14.697747  7823 rpcz_store.cc:276] 0501 13:59:13.239940 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.336659 (+1096719us) service_pool.cc:224] Handling call
0501 13:59:14.338447 (+  1788us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:14.338844 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.338871 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:14.487340 (+148469us) log.cc:844] Serialized 556 byte log entry
0501 13:59:14.559041 (+ 71701us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.559074 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.559137 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:14.697030 (+137893us) raft_consensus.cc:1685] finished
0501 13:59:14.697050 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.697221 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":71329,"threads_started":1,"wal-append.queue_time_us":99859}
W20260501 13:59:14.677238  9549 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260501 13:59:14.677951  9482 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:14.682976  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2037) took 3427 ms. Trace:
I20260501 13:59:14.660463  8375 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260501 13:59:14.649488  9254 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:14.707082  7677 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 13:59:14.665354  9299 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:14.722028  9299 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.722402  9254 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.723002  9492 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.723742  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1021) took 3389 ms. Trace:
I20260501 13:59:14.724239  7670 rpcz_store.cc:276] 0501 13:59:11.334194 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.823214 (+2489020us) service_pool.cc:224] Handling call
0501 13:59:13.863492 (+ 40278us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:14.243770 (+380278us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.243803 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:14.265606 (+ 21803us) log.cc:844] Serialized 26 byte log entry
0501 13:59:14.485446 (+219840us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:14.485486 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.485556 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:14.723488 (+237932us) raft_consensus.cc:1685] finished
0501 13:59:14.723511 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.723664 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5910,"raft.queue_time_us":48818,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":525384,"threads_started":2,"wal-append.queue_time_us":294375}
I20260501 13:59:14.709631  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.711696  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:14.725932  7823 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:14.726248  7745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1408) took 1511 ms (client timeout 1582 ms). Trace:
W20260501 13:59:14.726701  7745 rpcz_store.cc:269] 0501 13:59:13.215280 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.225178 (+  9898us) service_pool.cc:224] Handling call
0501 13:59:14.711519 (+1486341us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800062798. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:14.726185 (+ 14666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687232}
I20260501 13:59:14.706810  7672 rpcz_store.cc:276] 0501 13:59:11.255655 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.354650 (+1098995us) service_pool.cc:224] Handling call
0501 13:59:12.355052 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:14.422773 (+2067721us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b1800356320. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fa6d9440 00007fb2fa6d9fdb 00007fb2fa6e4a2b
0501 13:59:14.422910 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.422936 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:14.426200 (+  3264us) log.cc:844] Serialized 26 byte log entry
0501 13:59:14.589874 (+163674us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:14.645548 (+ 55674us) log.cc:844] Serialized 14 byte log entry
0501 13:59:14.645830 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.645950 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:14.682570 (+ 36620us) raft_consensus.cc:1685] finished
0501 13:59:14.682728 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.682896 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28143,"prepare.queue_time_us":58086,"prepare.run_wall_time_us":51,"raft.queue_time_us":84009,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":64334,"spinlock_wait_cycles":108358400,"thread_start_us":330542,"threads_started":2,"wal-append.queue_time_us":246255}
W20260501 13:59:14.728459  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 148007us
I20260501 13:59:14.736826  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1046) took 1163 ms. Trace:
I20260501 13:59:14.714135  7676 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:14.737294  7672 rpcz_store.cc:276] 0501 13:59:13.573816 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.735754 (+1161938us) service_pool.cc:224] Handling call
0501 13:59:14.736152 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.736482 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.736512 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.736568 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.736612 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.736669 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.736770 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.738099  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1040) took 1166 ms. Trace:
I20260501 13:59:14.738449  7676 rpcz_store.cc:276] 0501 13:59:13.572091 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.706406 (+1134315us) service_pool.cc:224] Handling call
0501 13:59:14.713693 (+  7287us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.737842 (+ 24149us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.738043 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.705754  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1267) took 1345 ms. Trace:
I20260501 13:59:14.740454  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1023) took 3384 ms. Trace:
I20260501 13:59:14.743350  7672 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:14.740535  7671 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:14.746448  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1039) took 1174 ms. Trace:
I20260501 13:59:14.746795  7671 rpcz_store.cc:276] 0501 13:59:13.571796 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.695421 (+1123625us) service_pool.cc:224] Handling call
0501 13:59:14.695798 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.746192 (+ 50394us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.746392 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.742990  7673 rpcz_store.cc:276] 0501 13:59:11.356431 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.871071 (+2514640us) service_pool.cc:224] Handling call
0501 13:59:13.871500 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:14.271665 (+400165us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.271698 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:14.272198 (+   500us) log.cc:844] Serialized 26 byte log entry
0501 13:59:14.418734 (+146536us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.557660 (+138926us) log.cc:844] Serialized 14 byte log entry
0501 13:59:14.558151 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.558231 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:14.740236 (+182005us) raft_consensus.cc:1685] finished
0501 13:59:14.740262 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.740394 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126849,"prepare.queue_time_us":199437,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":64617,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":18275,"thread_start_us":669169,"threads_started":3,"wal-append.queue_time_us":246560}
I20260501 13:59:14.707984  9482 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:14.754208  7673 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:14.747012  7672 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:14.759963  7672 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:14.757853  7671 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:14.742655  9502 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260501 13:59:14.753399  9394 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260501 13:59:14.755175  9446 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:14.792232  7825 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:14.813709  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 248) took 1516 ms. Trace:
I20260501 13:59:14.814119  7825 rpcz_store.cc:276] 0501 13:59:13.297804 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.679180 (+1381376us) service_pool.cc:224] Handling call
0501 13:59:14.791609 (+112429us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:14.791954 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.813074 (+ 21120us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.813635 (+   561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55571200}
I20260501 13:59:14.815569  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.794654  7828 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:14.807729  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:14.800354  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.802723  7676 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:14.767231  7673 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:14.812158  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2034) took 3557 ms. Trace:
W20260501 13:59:14.826767  7826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45436 (request call id 245) took 1714 ms (client timeout 1856 ms). Trace:
W20260501 13:59:14.846391  7826 rpcz_store.cc:269] 0501 13:59:13.111936 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.206724 (+ 94788us) service_pool.cc:224] Handling call
0501 13:59:14.800180 (+1593456us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:14.826680 (+ 26500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2416000}
I20260501 13:59:14.845784  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.837563  7823 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
W20260501 13:59:14.811893  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 186778us
I20260501 13:59:14.810210  7822 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:14.862033  9469 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:14.862653  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:14.863924  9492 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260501 13:59:14.771936  7821 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.001s
I20260501 13:59:14.806200  9507 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260501 13:59:14.845616  7675 rpcz_store.cc:276] 0501 13:59:11.254521 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.006316 (+751795us) service_pool.cc:224] Handling call
0501 13:59:13.387386 (+1381070us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.410029 (+1022643us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.798809 (+388780us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540004ced4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:14.799690 (+   881us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540004ced0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.812077 (+ 12387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5510134400}
I20260501 13:59:14.842196  9061 raft_consensus.cc:2764] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260501 13:59:14.862689  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.868425  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 249) took 1473 ms. Trace:
I20260501 13:59:14.874428  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:14.877492  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1057) took 1294 ms. Trace:
I20260501 13:59:14.878219  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:14.878268  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:14.874293  7823 rpcz_store.cc:276] 0501 13:59:13.395129 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.863792 (+1468663us) service_pool.cc:224] Handling call
0501 13:59:14.864154 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.864387 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.864437 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.864502 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.864546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.868250 (+  3704us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.868358 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.805087  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:14.802587  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1041) took 1230 ms. Trace:
I20260501 13:59:14.883126  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1058) took 1299 ms. Trace:
I20260501 13:59:14.877902  7825 rpcz_store.cc:276] 0501 13:59:13.583467 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.876573 (+1293106us) service_pool.cc:224] Handling call
0501 13:59:14.876945 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.877137 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.877164 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.877212 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.877241 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.877304 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.877422 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.887084  7825 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:14.887781  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1060) took 1301 ms. Trace:
I20260501 13:59:14.811398  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:14.888177  7825 rpcz_store.cc:276] 0501 13:59:13.586495 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.886485 (+1299990us) service_pool.cc:224] Handling call
0501 13:59:14.886841 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.887517 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.887718 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.890537  7823 rpcz_store.cc:276] 0501 13:59:13.583718 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.880261 (+1296543us) service_pool.cc:224] Handling call
0501 13:59:14.882618 (+  2357us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.882811 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.882839 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.882886 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.882917 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.882972 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.883070 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:14.896078  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:14.894295  7828 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
W20260501 13:59:14.896826  7828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1248) took 2521 ms (client timeout 1687 ms). Trace:
I20260501 13:59:14.896903  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 250) took 1305 ms. Trace:
W20260501 13:59:14.897449  7828 rpcz_store.cc:269] 0501 13:59:12.374918 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:12.375660 (+   742us) service_pool.cc:224] Handling call
0501 13:59:14.225276 (+1849616us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b180026ba40. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa71ca26 00007fb2fa65696e 00007fb2fa6d837e 00007fb2fa6d9bbe 00007fb2fa6e565c 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c
0501 13:59:14.794314 (+569038us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b58000833d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa63d48a 00007fb2fa6bf827 00007fb2fa6d83c7 00007fb2fa6d9bbe 00007fb2fa6e565c 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c
0501 13:59:14.896755 (+102441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636640256}
I20260501 13:59:14.897492  7825 rpcz_store.cc:276] 0501 13:59:13.591830 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.895916 (+1304086us) service_pool.cc:224] Handling call
0501 13:59:14.896242 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.896477 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.896504 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.896549 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.896582 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.896755 (+   173us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.896853 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.867060  9470 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:14.899178  7828 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:14.899508  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 251) took 1032 ms. Trace:
I20260501 13:59:14.800004  9331 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260501 13:59:14.873701  7822 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:14.915115  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1062) took 1046 ms. Trace:
I20260501 13:59:14.866555  9095 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260501 13:59:14.915135  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1059) took 1328 ms. Trace:
I20260501 13:59:14.809921  9541 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.880692  9332 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:14.903296  7825 rpcz_store.cc:276] 0501 13:59:13.867699 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.898740 (+1031041us) service_pool.cc:224] Handling call
0501 13:59:14.899047 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.899214 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.899236 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.899280 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:14.899310 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.899362 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.899459 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3072}
I20260501 13:59:14.896003  9458 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:14.798513  9491 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260501 13:59:14.796692  9440 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.900998  7821 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 13:59:14.904455  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 252) took 1036 ms. Trace:
W20260501 13:59:14.909209  9561 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260501 13:59:14.890451  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:14.807070  9480 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260501 13:59:14.806824  9544 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260501 13:59:14.938596  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48301.2us
I20260501 13:59:14.918558  7826 rpcz_store.cc:276] 0501 13:59:13.586245 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.881632 (+1295387us) service_pool.cc:224] Handling call
0501 13:59:14.913830 (+ 32198us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.914025 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.914049 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.914110 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0501 13:59:14.914135 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.914192 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.914980 (+   788us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54002cced0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.915081 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38510336}
I20260501 13:59:14.902757  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1061) took 1065 ms. Trace:
I20260501 13:59:14.897737  9009 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3.
I20260501 13:59:14.880501  9531 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:14.945544  7750 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:14.928906  7823 rpcz_store.cc:276] 0501 13:59:13.868155 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.899516 (+1031361us) service_pool.cc:224] Handling call
0501 13:59:14.899794 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.902845 (+  3051us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.902872 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.904168 (+  1296us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:14.904224 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.904285 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.904389 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.862691  9469 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.796090  9482 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.933758  7746 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:14.934929  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 114023us
I20260501 13:59:14.939946  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:14.899324  9061 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260501 13:59:14.956600  7826 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:14.940112  7828 rpcz_store.cc:276] 0501 13:59:13.837035 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.898684 (+1061649us) service_pool.cc:224] Handling call
0501 13:59:14.899005 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.902490 (+  3485us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.902694 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.957494  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 253) took 1041 ms. Trace:
I20260501 13:59:14.957943  7826 rpcz_store.cc:276] 0501 13:59:13.916691 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.939598 (+1022907us) service_pool.cc:224] Handling call
0501 13:59:14.956172 (+ 16574us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.957145 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.957421 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.888664  7674 rpcz_store.cc:276] 0501 13:59:13.572396 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.775971 (+203575us) service_pool.cc:224] Handling call
0501 13:59:14.802344 (+1026373us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540036c9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:14.802522 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150892800}
I20260501 13:59:14.965969  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:14.907416  9470 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:14.942963  9095 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:14.926126  9415 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.970760  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:14.963538  9254 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.974822  7826 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:14.975253  7826 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:14.915604  7822 rpcz_store.cc:276] 0501 13:59:13.868928 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.914090 (+1045162us) service_pool.cc:224] Handling call
0501 13:59:14.914490 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.914692 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:14.914727 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.914787 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:14.914829 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.914910 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.915047 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.946116  9498 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:14.955924  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 243) took 1844 ms. Trace:
I20260501 13:59:14.988588  9125 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.988940  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:14.989795  8374 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:14.989907  7751 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260501 13:59:14.968843  9458 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:15.004914  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.005544  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 165) took 1435 ms. Trace:
I20260501 13:59:15.006076  7677 rpcz_store.cc:276] 0501 13:59:13.570120 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.666671 (+1096551us) service_pool.cc:224] Handling call
0501 13:59:14.667022 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.725256 (+ 58234us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.005140 (+279884us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54003f2d54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:15.005459 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86678912}
I20260501 13:59:15.004920  7670 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:14.977324  9482 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:14.974455  9095 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.013487  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1064) took 1123 ms. Trace:
W20260501 13:59:15.014171  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.014117  7825 rpcz_store.cc:276] 0501 13:59:13.889782 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.923499 (+1033717us) service_pool.cc:224] Handling call
0501 13:59:15.012899 (+ 89400us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.013121 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:15.013151 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:15.013198 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:15.013237 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.013307 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:15.013424 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:14.986428  9254 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:15.017432  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.026989  9513 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:15.028295  9513 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:15.028723  9513 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:15.028635  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.029989  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.029835  9513 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.030864  7825 raft_consensus.cc:2410] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260501 13:59:15.031137  9513 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:15.031924  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.032209  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.033087  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:15.036234  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.011765  9395 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:14.672025  7827 rpcz_store.cc:276] 0501 13:59:13.359602 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.460568 (+1100966us) service_pool.cc:224] Handling call
0501 13:59:14.476696 (+ 16128us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.476971 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 3
0501 13:59:14.580725 (+103754us) log.cc:844] Serialized 14 byte log entry
0501 13:59:14.663687 (+ 82962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.663751 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:14.663796 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.663893 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.664022 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":219589,"raft.queue_time_us":2077,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3585,"spinlock_wait_cycles":20033792,"thread_start_us":177725,"threads_started":2}
I20260501 13:59:14.742791  7820 rpcz_store.cc:276] 0501 13:59:13.359320 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.417716 (+1058396us) service_pool.cc:224] Handling call
0501 13:59:14.424825 (+  7109us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.425146 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 2
0501 13:59:14.564487 (+139341us) log.cc:844] Serialized 14 byte log entry
0501 13:59:14.640127 (+ 75640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:14.647974 (+  7847us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:14.654537 (+  6563us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.667022 (+ 12485us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:14.704447 (+ 37425us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223835,"prepare.run_wall_time_us":54,"raft.queue_time_us":11391,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":20135,"spinlock_wait_cycles":81405952,"thread_start_us":151015,"threads_started":2,"wal-append.queue_time_us":96712}
I20260501 13:59:15.023473  9498 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:15.039108  9575 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:15.057883  9575 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:15.060395  7679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2041) took 1797 ms (client timeout 1918 ms). Trace:
I20260501 13:59:15.060554  7678 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
W20260501 13:59:15.061041  7679 rpcz_store.cc:269] 0501 13:59:13.263075 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.497670 (+234595us) service_pool.cc:224] Handling call
0501 13:59:15.060101 (+1562431us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b5400037fd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:15.060310 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158373248}
I20260501 13:59:15.062592  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1025) took 3705 ms. Trace:
I20260501 13:59:15.062973  9499 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.064294  9095 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.065794  8376 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:15.075726  8376 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:15.067047  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1042) took 1494 ms. Trace:
I20260501 13:59:15.077227  7670 rpcz_store.cc:276] 0501 13:59:13.572688 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.726264 (+1153576us) service_pool.cc:224] Handling call
0501 13:59:14.747526 (+ 21262us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.007944 (+260418us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.066775 (+ 58831us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540037e454. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:15.066976 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591310080}
I20260501 13:59:15.035674  7826 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.058902  9575 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.071478  7678 rpcz_store.cc:276] 0501 13:59:11.357018 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.150469 (+2793451us) service_pool.cc:224] Handling call
0501 13:59:15.060266 (+909797us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.061190 (+   924us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.062351 (+  1161us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400037fd0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:15.062525 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091255040}
I20260501 13:59:15.053853  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.080567  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:15.047472  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.074968  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:15.091717  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 129977us
I20260501 13:59:15.093793  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:15.096879  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.097680  7825 raft_consensus.cc:2376] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3. Re-sending same reply.
I20260501 13:59:15.078234  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:15.086040  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:15.078920  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 113082us
I20260501 13:59:15.114090  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:15.116844  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:15.117837  8372 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 1 LEARNER]: Advancing to term 2
I20260501 13:59:15.076632  8376 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.123278  8376 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:15.125794  7826 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.128104  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.129326  7754 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260501 13:59:15.130685  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52547us
I20260501 13:59:15.150748  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:15.089632  9254 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:15.116430  9496 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:15.044629  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.050190  9469 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.057065  9415 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.043632  9395 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.144676  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.052767  9470 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.136022  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.124153  9531 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:15.081274  9125 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:14.993012  7821 rpcz_store.cc:276] 0501 13:59:13.111293 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.574726 (+463433us) service_pool.cc:224] Handling call
0501 13:59:13.724516 (+149790us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:14.930198 (+1205682us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:14.952306 (+ 22108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:15.155782  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.089632  9538 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:15.051288  9498 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.048020  9392 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260501 13:59:15.131004  9312 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:15.137708  9332 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 13:59:15.173260  7751 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:15.151978  9484 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:15.149091  9305 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:15.177541  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.185237  8376 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260501 13:59:15.201439  8376 pending_rounds.cc:85] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 4
I20260501 13:59:15.201982  8376 pending_rounds.cc:107] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260501 13:59:15.202266  8376 raft_consensus.cc:2889] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:15.187300  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.124439  9458 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:15.156759  9491 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:15.191009  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.159469  9356 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.193902  9531 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:15.211931  9531 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.157681  9095 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.158320  9575 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.216185  9577 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:15.216758  9577 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.219995  9450 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.214336  9491 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.220640  9491 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:15.201428  9332 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.227578  9332 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.228013  9440 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.204344  9580 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260501 13:59:15.229348  9454 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:15.229755  9454 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.194133  9351 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.230620  9454 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.168833  9569 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260501 13:59:15.194828  7826 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:15.156845  9576 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:15.154037  9009 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260501 13:59:15.198203  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:15.203293  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.194139  9538 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.209708  9458 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:15.199179  7748 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:15.161608  9496 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.164742  9544 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260501 13:59:15.232398  9499 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.241216  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1069) took 1101 ms. Trace:
W20260501 13:59:15.242214  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.205276  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
W20260501 13:59:15.244117  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 91012.9us
W20260501 13:59:15.250613  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.256870  7827 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:15.242601  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 98714.1us
I20260501 13:59:15.258540  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:15.250979  7826 rpcz_store.cc:276] 0501 13:59:14.139953 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.962974 (+823021us) service_pool.cc:224] Handling call
0501 13:59:14.974687 (+ 11713us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.240587 (+265900us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.241039 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:15.260545  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.254802  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:15.251008  7825 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:15.236827  8374 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:15.272680  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:15.274240  7671 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:15.237865  9576 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.269059  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:15.270325  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:15.250047  9480 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260501 13:59:15.271510  7679 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:59:15.279116  7671 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:15.262440  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.271528  7673 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:15.264317  9379 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260501 13:59:15.242681  9396 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260501 13:59:15.284047  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.286185  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:15.287446  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.287616  7827 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:15.250317  9392 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260501 13:59:15.274660  7821 raft_consensus.cc:606] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:15.251951  9243 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260501 13:59:15.274081  9492 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:15.276615  9576 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:15.255927  9506 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260501 13:59:15.273471  9532 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260501 13:59:15.300868  9450 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260501 13:59:15.291872  9499 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260501 13:59:15.318591  9534 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.319166  9534 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.321372  9243 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:15.321810  9243 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:15.288751  9353 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.286331  9544 raft_consensus.cc:2764] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260501 13:59:15.283974  9513 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260501 13:59:15.311914  7674 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:15.326004  9492 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:15.312376  9577 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.328189  9492 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.313114  9496 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.300284  9484 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:15.277649  9394 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260501 13:59:15.291143  9312 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:15.324419  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 65944.2us
I20260501 13:59:15.302409  7821 raft_consensus.cc:614] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:15.334316  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44596.9us
I20260501 13:59:15.335227  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:15.340903  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:15.343283  7750 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:15.344118  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.345710  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:15.355414  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.325176  9356 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:15.373760  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.322767  9243 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:15.376454  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 89213us
I20260501 13:59:15.377768  7825 raft_consensus.cc:2410] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:15.380079  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.370776  7678 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:15.383518  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:15.325490  9531 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260501 13:59:15.348987  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1265) took 1990 ms. Trace:
I20260501 13:59:15.384920  7747 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:15.345871  9585 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:15.368530  9351 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:15.302960  9458 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.377220  8372 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 13:59:15.376077  9470 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:15.381497  9312 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:15.413532  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1056) took 2145 ms. Trace:
I20260501 13:59:15.413947  7824 rpcz_store.cc:276] 0501 13:59:13.267739 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.679875 (+1412136us) service_pool.cc:224] Handling call
0501 13:59:15.412724 (+732849us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:15.412965 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.413175 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:15.413206 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:15.413248 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:15.413278 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.413345 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:15.413466 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54265088}
I20260501 13:59:15.383150  9395 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:15.416728  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:15.415138  9351 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.426988  9351 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.432487  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.373224  9544 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260501 13:59:15.378197  9327 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260501 13:59:15.444754  9305 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.447912  9499 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:15.444928  9392 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260501 13:59:15.451153  7828 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:15.451591  7828 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.441833  9404 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.415156  9513 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260501 13:59:15.404719  9415 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260501 13:59:15.452369  7828 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.431509  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.410696  9394 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:15.404655  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.369199  9493 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260501 13:59:15.411199  9356 consensus_queue.cc:1059] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260501 13:59:15.462836  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:15.463555  7827 raft_consensus.cc:606] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:15.411372  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:15.465304  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.466743  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.384133  9484 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260501 13:59:15.442870  7748 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:15.406286  9498 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260501 13:59:15.416888  9584 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260501 13:59:15.380965  9579 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260501 13:59:15.455466  9332 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.373271  9562 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260501 13:59:15.432222  9456 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260501 13:59:15.417754  9538 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.478359  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.442762  9577 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260501 13:59:15.475208  9594 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.467502  9544 consensus_queue.cc:1243] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:15.468194  9312 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:15.497064  7676 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:15.487610  7824 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.415541  9589 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
W20260501 13:59:15.498795  9588 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260501 13:59:15.499987  9541 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.477484  9404 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:15.404935  7819 rpcz_store.cc:276] 0501 13:59:13.358571 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.211959 (+1853388us) service_pool.cc:224] Handling call
0501 13:59:15.212453 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:15.212928 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:15.212989 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:15.213702 (+   713us) log.cc:844] Serialized 26 byte log entry
0501 13:59:15.277674 (+ 63972us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:15.283377 (+  5703us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.288593 (+  5216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:15.332425 (+ 43832us) raft_consensus.cc:1685] finished
0501 13:59:15.334435 (+  2010us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:15.345064 (+ 10629us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5954,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":52803,"threads_started":1,"wal-append.queue_time_us":112677}
I20260501 13:59:15.511893  9404 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.512773  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.518047  9404 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.496455  9538 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:15.529528  7823 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:15.503010  9312 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:15.536437  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:15.537846  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 131747us
I20260501 13:59:15.513952  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.544016  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:15.544164  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 113707us
I20260501 13:59:15.544874  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.546212  9353 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:15.546774  9597 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260501 13:59:15.574949  9488 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:15.575050  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.575335  9597 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:15.575489  9488 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:15.575806  9296 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:15.575894  9597 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.510948  9544 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260501 13:59:15.549261  9592 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260501 13:59:15.516301  9594 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.582118  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.583405  9480 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:15.543237  9534 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.555806  7820 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:15.585347  9395 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.556021  9493 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:15.557296  9312 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.495599  9491 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:15.558353  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:15.627697  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.558977  9332 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.561578  9394 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.562348  7748 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:15.555543  9575 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:15.566622  7577 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:15.567631  7819 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260501 13:59:15.568181  9582 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.294s	user 0.003s	sys 0.000s
I20260501 13:59:15.568312  9474 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:15.567705  9576 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.635460  9474 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:15.637252  9576 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:15.572716  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.636485  9474 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.576324  9296 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:15.531888  9538 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:15.541779  9585 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:15.576380  9488 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.578094  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.579665  9544 consensus_queue.cc:1243] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260501 13:59:15.580166  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.640089  7750 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:15.581224  9597 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:15.581301  7822 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:15.584769  9353 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:15.584863  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.584905  9480 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
W20260501 13:59:15.587296  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.589258  8375 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:15.590884  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.646908  9480 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.591244  9351 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:15.593394  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:15.594413  9009 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:15.595350  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.595942  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.642992  7822 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.596572  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:15.592588  7824 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:15.596588  9061 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:15.652537  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1280) took 1143 ms. Trace:
I20260501 13:59:15.600234  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.663682  7819 rpcz_store.cc:276] 0501 13:59:14.507742 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.562627 (+1054885us) service_pool.cc:224] Handling call
0501 13:59:15.564171 (+  1544us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.635030 (+ 70859us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.651119 (+ 16089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:15.600397  9496 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
W20260501 13:59:15.664841  9595 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260501 13:59:15.664937  9496 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:15.654590  9474 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.666152  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1075) took 1186 ms. Trace:
I20260501 13:59:15.665978  9496 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.600917  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.667265  9496 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:15.602501  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.666545  7826 rpcz_store.cc:276] 0501 13:59:14.480135 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.282271 (+802136us) service_pool.cc:224] Handling call
0501 13:59:15.299455 (+ 17184us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:15.302783 (+  3328us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:15.302814 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:15.303229 (+   415us) log.cc:844] Serialized 26 byte log entry
0501 13:59:15.464761 (+161532us) raft_consensus.cc:1645] Marking committed up to 1
0501 13:59:15.464806 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.464877 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:15.664210 (+199333us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:15.665885 (+  1675us) raft_consensus.cc:1685] finished
0501 13:59:15.665905 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:15.666092 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2818,"raft.queue_time_us":6067,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":12998,"spinlock_wait_cycles":5385600,"thread_start_us":110743,"threads_started":1,"wal-append.queue_time_us":187342}
I20260501 13:59:15.603937  8380 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260501 13:59:15.668165  8371 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:15.608560  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1067) took 1483 ms. Trace:
I20260501 13:59:15.604585  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.668859  7823 rpcz_store.cc:276] 0501 13:59:14.125094 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.969319 (+844225us) service_pool.cc:224] Handling call
0501 13:59:14.969731 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.531986 (+562255us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.608288 (+ 76302us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54002eac54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:15.608496 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286347008}
I20260501 13:59:15.656303  8381 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 2: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:15.670429  7823 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:15.670579  9305 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:15.660416  7822 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.671031  9305 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:15.610334  9454 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.611933  9243 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:15.613672  9482 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:15.626356  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.628618  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.611903  9601 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:15.676604  9482 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.661005  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.677716  9482 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.633993  7577 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:15.642530  9538 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.662556  9585 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.680766  9482 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.681228  9538 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:15.662387  9061 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.645932  7746 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:15.649957  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.631695  9575 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.654350  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.633221  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1277) took 1404 ms. Trace:
I20260501 13:59:15.642789  9312 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.653461  9296 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.655860  9009 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:15.672856  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:15.583778  9594 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:15.687736  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.655946  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.690693  7752 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:15.674031  8380 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:15.662237  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.695122  7824 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:15.675493  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:15.696681  7825 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:15.676693  9601 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:15.640620  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.679098  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.680356  7748 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:15.701268  9485 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:15.652506  9488 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.684412  7746 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:15.688830  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.667289  8377 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:15.704715  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:15.706422  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49578.8us
I20260501 13:59:15.662695  7821 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:15.710110  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1281) took 1193 ms. Trace:
I20260501 13:59:15.700444  9601 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.710638  7821 rpcz_store.cc:276] 0501 13:59:14.516379 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.557516 (+1041137us) service_pool.cc:224] Handling call
0501 13:59:15.662485 (+104969us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.708077 (+ 45592us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.709826 (+  1749us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400297050. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:15.710025 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240456448}
I20260501 13:59:15.712703  9601 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.713467  9485 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:15.714994  9532 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:15.717832  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:15.719872  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:15.711164  8377 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:15.719883  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.725760  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:15.682606  9061 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.730185  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.662097  9491 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:15.729086  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:15.734156  8381 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:15.736755  8381 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 3. Ops: []
W20260501 13:59:15.737942  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.729887  9499 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.688211  9394 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260501 13:59:15.748692  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.726073  9296 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:15.719666  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:15.748031  7792 connection.cc:254] RPC call timeout handler was delayed by -1.3674274930000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260501 13:59:15.752077  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.752381  8371 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 3. Ops: []
I20260501 13:59:15.753399  7745 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:15.754434  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.751338  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.756863  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.758499  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.769606  7675 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:15.769693  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.770066  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.760475  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.770949  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.772367  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.770605  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:15.752784  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:15.762276  7792 connection.cc:254] RPC call timeout handler was delayed by -1.2657274930000995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260501 13:59:15.767475  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:15.774888  7792 connection.cc:254] RPC call timeout handler was delayed by -1.2576274930000864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260501 13:59:15.775249  7792 connection.cc:254] RPC call timeout handler was delayed by -1.0767274930001349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260501 13:59:15.775861  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:15.776271  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.777158  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:15.779578  9600 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:15.774060  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.784837  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.671952  9305 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.785702  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:15.787204  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.784467  9541 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260501 13:59:15.788679  9577 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.789139  7676 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260501 13:59:15.769749  9061 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:15.749395  9009 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.684962  7820 rpcz_store.cc:276] 0501 13:59:14.227854 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.048434 (+820580us) service_pool.cc:224] Handling call
0501 13:59:15.048824 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.585587 (+536763us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.626604 (+ 41017us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400298454. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:15.632621 (+  6017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164888320}
I20260501 13:59:15.742897  9332 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.745481  9573 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:15.785867  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:15.744710  9472 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.808233  7673 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 3. Ops: []
I20260501 13:59:15.827410  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:15.817659  7677 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:15.739334  9598 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
W20260501 13:59:15.831612  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 45821.6us
I20260501 13:59:15.797246  7675 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:15.834681  7677 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:15.836192  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:15.839185  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:15.798697  9446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.009s	sys 0.012s
I20260501 13:59:15.841821  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:15.796782  9491 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:15.807335  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:15.847407  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 76888.2us
W20260501 13:59:15.848482  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.828770  9577 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:15.832319  9597 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:15.893143  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.746999  9480 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.849215  9125 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:15.894737  9125 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:15.895102  9480 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.895916  9125 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.749431  9575 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.806617  9458 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260501 13:59:15.846004  9446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.011s	sys 0.013s
I20260501 13:59:15.872219  9591 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:15.865855  9353 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:15.826159  9573 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:15.842167  9009 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:15.806579  9392 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260501 13:59:15.847208  9579 raft_consensus.cc:2764] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260501 13:59:15.846653  9305 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:15.897441  9125 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:15.913055  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 47187us
I20260501 13:59:15.860112  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:15.831547  9332 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.836320  9472 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.898792  9598 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:15.847661  9576 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260501 13:59:15.941960  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:15.963238  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.922127  9573 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:15.930572  9591 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:15.921011  9450 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:15.930912  9446 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
W20260501 13:59:15.976035  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.926460  9353 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:15.942553  9297 consensus_queue.cc:1059] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260501 13:59:15.981045  9297 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:15.981657  9297 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:15.997073  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:15.998072  7745 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:16.001922  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60016.1us
I20260501 13:59:16.010108  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:16.015174  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:16.019887  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:15.974239  9591 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:16.023746  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:15.940450  9575 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:16.030260  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:15.979528  9353 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:16.000553  9351 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:15.987387  9446 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:16.018368  9513 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.034642  9620 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:15.995458  9450 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:16.039170  9422 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:16.073871  9583 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.851s	user 0.008s	sys 0.000s
I20260501 13:59:16.043210  7819 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:16.053092  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:16.040920  9576 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:16.092700  9609 log.cc:927] Time spent T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260501 13:59:16.052491  9297 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:16.056800  9351 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:16.094149  9610 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260501 13:59:16.094309  9351 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:16.085759  9598 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:16.069101  9585 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.103705  9585 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:15.905728  9544 consensus_queue.cc:1175] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "91854d93e96c4756834efe8b2ef59fce" responder_term: 4 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260501 13:59:16.078936  9422 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:16.108076  8373 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:16.116647  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 359) took 1083 ms. Trace:
I20260501 13:59:16.117070  8379 rpcz_store.cc:276] 0501 13:59:15.033174 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.033623 (+   449us) service_pool.cc:224] Handling call
0501 13:59:15.042019 (+  8396us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:15.042415 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:15.042445 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:15.043007 (+   562us) log.cc:844] Serialized 26 byte log entry
0501 13:59:15.147107 (+104100us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:15.147167 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:15.147269 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:16.073169 (+925900us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:16.116307 (+ 43138us) raft_consensus.cc:1685] finished
0501 13:59:16.116333 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:16.116574 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1470,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":145,"spinlock_wait_cycles":35538176,"thread_start_us":103662,"threads_started":1,"wal-append.queue_time_us":179225}
I20260501 13:59:16.121310  9450 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:16.126893  7671 raft_consensus.cc:2410] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260501 13:59:16.128630  7828 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:16.131086  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 100962us
W20260501 13:59:16.132666  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.078552  9513 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.133394  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:16.109436  9351 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:16.110499  9422 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:16.138159  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:16.153646  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.157011  9616 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260501 13:59:16.158315  9472 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:16.144686  9579 raft_consensus.cc:2764] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260501 13:59:16.162228  9585 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:16.136970  9576 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:16.165764  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.169446  7828 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:16.170156  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1068) took 2032 ms. Trace:
I20260501 13:59:16.170490  7828 rpcz_store.cc:276] 0501 13:59:14.137562 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.963905 (+826343us) service_pool.cc:224] Handling call
0501 13:59:14.964369 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.451048 (+486679us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54003da020. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6591a0 00007fb2fa6e35a0 00007fb2fa6e4611 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c
0501 13:59:16.069632 (+618584us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b58005804d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa63d48a 00007fb2fa6bf827 00007fb2fa6d83c7 00007fb2fa6d9bbe 00007fb2fa6e3f29 00007fb2fa6e47f6 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34
0501 13:59:16.169846 (+100214us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.170095 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368623744}
I20260501 13:59:16.172117  7828 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260501 13:59:16.150714  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.150876  9332 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:16.184487  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.174924  9331 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260501 13:59:16.110342  9446 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.195719  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:16.185688  9474 consensus_meta.cc:287] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.520s	user 0.016s	sys 0.000s
I20260501 13:59:16.177079  9454 consensus_queue.cc:1059] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260501 13:59:16.202491  9243 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.007s
I20260501 13:59:16.216383  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1079) took 1200 ms. Trace:
I20260501 13:59:16.226588  7824 rpcz_store.cc:276] 0501 13:59:15.023522 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.695880 (+672358us) service_pool.cc:224] Handling call
0501 13:59:16.215580 (+519700us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:16.215810 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.216045 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:16.216073 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:16.216117 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:16.216151 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.216209 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:16.216318 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67571584}
W20260501 13:59:16.217340  9590 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.703s	user 0.004s	sys 0.000s
I20260501 13:59:16.218037  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:16.221206  7822 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:16.241066  9591 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:16.221413  9496 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
W20260501 13:59:16.233076  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.242444  7747 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
W20260501 13:59:16.245316  9601 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.008s
I20260501 13:59:16.248579  9499 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:16.249621  7826 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260501 13:59:16.250047  7826 pending_rounds.cc:85] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 4
I20260501 13:59:16.250265  7826 pending_rounds.cc:107] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:16.250491  7826 raft_consensus.cc:2889] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:16.250649  7821 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:16.251122  8375 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.003s
I20260501 13:59:16.251308  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1082) took 1173 ms. Trace:
I20260501 13:59:16.251778  7821 rpcz_store.cc:276] 0501 13:59:15.077477 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.712861 (+635384us) service_pool.cc:224] Handling call
0501 13:59:16.250164 (+537303us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:16.250408 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.251036 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.251248 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19331968}
I20260501 13:59:16.257583  7825 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:16.258255  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1083) took 1180 ms. Trace:
I20260501 13:59:16.258685  7825 rpcz_store.cc:276] 0501 13:59:15.077790 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.717196 (+639406us) service_pool.cc:224] Handling call
0501 13:59:16.257208 (+540012us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:16.257399 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.257991 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.258190 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18593664}
I20260501 13:59:16.261511  9454 consensus_queue.cc:1243] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer 91854d93e96c4756834efe8b2ef59fce log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:16.262586  7827 raft_consensus.cc:630] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Rejecting request to transfer leadership because tablet server bc1b0a0a152e46fea4bd4934ba9976ed is not a voter in the active config
I20260501 13:59:16.265152  9591 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:16.267385  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.269464  7827 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:16.270740  8376 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:16.278628  7827 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:16.212822  9446 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:16.280507  8377 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:16.281178  7678 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:16.286355  7827 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:16.268680  9095 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:16.195495  9573 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.296097  7824 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:16.276190  9514 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.308607  7678 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:16.309809  8380 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260501 13:59:16.293329  9296 consensus_meta.cc:287] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.526s	user 0.013s	sys 0.002s
I20260501 13:59:16.294708  9095 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:16.295274  9601 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260501 13:59:16.294840  9482 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260501 13:59:16.337743  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.339030  7745 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:16.319133  9480 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260501 13:59:16.345024  9608 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:16.326046  9513 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:16.345566  9608 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:16.318255  9514 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:16.346524  9608 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.348857  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:16.349660  7825 raft_consensus.cc:2410] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:16.352716  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:16.353550  9009 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:16.330736  8373 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:16.356789  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:16.361974  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:16.362949  7678 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:16.366070  7678 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260501 13:59:16.370287  7823 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:16.370716  7823 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:16.371526  7823 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.373555  7823 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:16.355201  9514 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:16.392179  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.394843  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:16.395602  7671 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:16.387239  7823 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260501 13:59:16.397441  7823 pending_rounds.cc:85] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 2
I20260501 13:59:16.397754  7823 pending_rounds.cc:107] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260501 13:59:16.398092  7823 raft_consensus.cc:2917] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260501 13:59:16.398571  7823 raft_consensus.cc:2889] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:16.399725  9589 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260501 13:59:16.400352  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1078) took 1511 ms. Trace:
I20260501 13:59:16.400849  7823 rpcz_store.cc:276] 0501 13:59:14.889320 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.671192 (+781872us) service_pool.cc:224] Handling call
0501 13:59:15.671461 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.370177 (+698716us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b54003de120. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6591a0 00007fb2fa6e35a0 00007fb2fa6e4611 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c
0501 13:59:16.399303 (+ 29126us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.400288 (+   985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148986624}
I20260501 13:59:16.403102  9573 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:16.403987  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:16.406984  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:16.381731  9608 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:16.412078  9514 raft_consensus.cc:1064] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
W20260501 13:59:16.454267  9514 raft_consensus.cc:1068] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Unable to promote non-voter 91854d93e96c4756834efe8b2ef59fce: Illegal state: Leader has not yet committed an operation in its own term
I20260501 13:59:16.417532  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1076) took 1735 ms. Trace:
I20260501 13:59:16.419720  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:50946 (request call id 1215) took 1700 ms. Trace:
I20260501 13:59:16.454852  7826 rpcz_store.cc:276] 0501 13:59:14.681730 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.668229 (+986499us) service_pool.cc:224] Handling call
0501 13:59:15.668502 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.251116 (+582614us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.417247 (+166131us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400250654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:16.417463 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335574912}
I20260501 13:59:16.424815  7819 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:16.427011  9591 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:16.456056  7819 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:16.428788  9513 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:16.428972  9422 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.457118  7819 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.458581  7819 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:16.459180  9422 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:16.435173  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:16.460562  8380 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:16.460718  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:16.411367  9379 raft_consensus.cc:1064] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:59:16.436669  7745 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260501 13:59:16.473627  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:16.474586  7747 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:16.449254  7823 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:16.451803  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:16.415282  9095 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.453292  8375 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
W20260501 13:59:16.435292  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.509794  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.454926  7827 rpcz_store.cc:276] 0501 13:59:14.719608 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:16.312170 (+1592562us) service_pool.cc:224] Handling call
0501 13:59:16.419194 (+107024us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b540028e954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb2ff6b911e 00007fb2f8c35437 00007fb2f8c353c2 00007fb2f8c352f1 00007fb2f8c3526c 00007fb2f8c34522 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:16.419652 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198468480}
I20260501 13:59:16.425498  7822 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:16.508476  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:16.527966  7826 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:16.514432  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:16.528838  7827 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:16.461871  9379 raft_consensus.cc:1068] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Unable to promote non-voter 91854d93e96c4756834efe8b2ef59fce: Illegal state: Leader has not yet committed an operation in its own term
I20260501 13:59:16.519721  7747 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:16.531009  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:16.541364  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:16.547149  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.551208  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:16.461988  9480 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:16.552135  7825 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:16.508114  9296 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260501 13:59:16.509260  9575 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:16.561261  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 44542.1us
I20260501 13:59:16.563723  7827 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:16.528446  9331 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
W20260501 13:59:16.570109  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.564834  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:16.554124  9507 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260501 13:59:16.562867  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:16.580436  7754 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
W20260501 13:59:16.615255  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48609.3us
I20260501 13:59:16.614583  9331 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:16.617776  9331 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:16.618448  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 203) took 1022 ms. Trace:
I20260501 13:59:16.618888  8376 rpcz_store.cc:276] 0501 13:59:15.596216 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.596336 (+   120us) service_pool.cc:224] Handling call
0501 13:59:16.618252 (+1021916us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54005901d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:16.618371 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381305216}
I20260501 13:59:16.621306  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:16.621942  7824 raft_consensus.cc:606] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:16.622257  7824 raft_consensus.cc:614] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:16.624783  9312 consensus_meta.cc:287] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.937s	user 0.012s	sys 0.004s
I20260501 13:59:16.625826  7679 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:16.565053  9474 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:16.630064  9474 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:16.610807  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:16.632465  7827 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:59:16.634588  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.612867  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:16.616032  7823 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:16.636224  7824 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260501 13:59:16.636570  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 259) took 1096 ms. Trace:
I20260501 13:59:16.636989  7828 rpcz_store.cc:276] 0501 13:59:15.540322 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:16.177441 (+637119us) service_pool.cc:224] Handling call
0501 13:59:16.177732 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:16.178044 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:16.178063 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:16.182676 (+  4613us) log.cc:844] Serialized 26 byte log entry
0501 13:59:16.334145 (+151469us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:16.334174 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.334245 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:16.636361 (+302116us) raft_consensus.cc:1685] finished
0501 13:59:16.636385 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:16.636509 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2839,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":5783,"thread_start_us":131276,"threads_started":1,"wal-append.queue_time_us":240438}
I20260501 13:59:16.639885  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:16.555050  9480 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:16.548624  9589 consensus_queue.cc:1175] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "109c9ba263c34ff8aee17bc446cf258e" responder_term: 2 status { last_received { term: 1 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: [1.4-1.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260501 13:59:16.635838  7825 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:16.557984  9095 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:16.563550  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1070) took 2394 ms. Trace:
I20260501 13:59:16.565960  8372 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:16.679292  7825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789c720014934abe950ad611625f9bc9"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:16.680117  7825 raft_consensus.cc:606] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:16.680553  7825 raft_consensus.cc:614] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:16.645751  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 83015.7us
I20260501 13:59:16.648576  9573 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:16.641651  9474 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.567303  9575 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:16.666105  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.667528  9620 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.008s
I20260501 13:59:16.668679  9332 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:16.604352  9513 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260501 13:59:16.685613  7826 raft_consensus.cc:2410] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:16.644699  9480 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:16.656683  9351 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260501 13:59:16.746136  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.716010  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.686751  9596 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:16.747656  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:16.690176  9573 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:16.730883  9492 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260501 13:59:16.757301  9379 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.764776  9379 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.753463  9351 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:16.765687  9351 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:16.767441  9379 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:16.761844  9454 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.768288  9499 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:16.770254  9591 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:16.744611  9599 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.772452  9573 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.731489  9620 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:16.735862  9332 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.672489  7822 rpcz_store.cc:276] 0501 13:59:14.162980 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.998284 (+835304us) service_pool.cc:224] Handling call
0501 13:59:15.052885 (+ 54601us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:15.581189 (+528304us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540041e220. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6591a0 00007fb2fa6e35a0 00007fb2fa6e4611 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c
0501 13:59:16.220757 (+639568us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b580007f1d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa63d48a 00007fb2fa6bf827 00007fb2fa6d83c7 00007fb2fa6d9bbe 00007fb2fa6e3f29 00007fb2fa6e47f6 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34
0501 13:59:16.527567 (+306810us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.556934 (+ 29367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241880704}
W20260501 13:59:16.801982  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.804378  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.787498  9591 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:16.793051  9499 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:16.804508  7821 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:16.788858  9454 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:16.794327  9599 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:16.853233  9636 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260501 13:59:16.858887  9454 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:16.848912  9591 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:16.868453  9575 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:16.895007  9599 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:16.902325  9634 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.502s	user 0.003s	sys 0.000s
W20260501 13:59:16.907035  9628 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.502s	user 0.000s	sys 0.006s
W20260501 13:59:16.690640  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 160555us
I20260501 13:59:16.954896  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:16.956010  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1071) took 1026 ms. Trace:
I20260501 13:59:16.956924  7674 rpcz_store.cc:276] 0501 13:59:15.929421 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.933334 (+  3913us) service_pool.cc:224] Handling call
0501 13:59:15.985136 (+ 51802us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:15.985609 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:15.985640 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:15.986281 (+   641us) log.cc:844] Serialized 52 byte log entry
0501 13:59:16.152723 (+166442us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:16.200217 (+ 47494us) log.cc:844] Serialized 14 byte log entry
0501 13:59:16.661582 (+461365us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800422e00. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2f74761f0 00007fb2f7640b24 00007fb2f7640a95 00007fb2fa6d9440 00007fb2fa6ebaf6 00007fb2fa6fc667 00007fb2fa6fc5e8
0501 13:59:16.661817 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.661913 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:16.661962 (+    49us) raft_consensus.cc:1685] finished
0501 13:59:16.733868 (+ 71906us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:16.955660 (+221792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23602,"prepare.queue_time_us":20325,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":408,"raft.queue_time_us":454475,"raft.run_cpu_time_us":1130,"raft.run_wall_time_us":20650,"spinlock_wait_cycles":4358016,"thread_start_us":149074,"threads_started":1,"wal-append.queue_time_us":193660}
W20260501 13:59:16.972822  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 225074us
W20260501 13:59:16.980151  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.986019  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.988612  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:16.973475  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:16.995239  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:16.996933  7823 raft_consensus.cc:606] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:16.997749  7823 raft_consensus.cc:614] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:17.000198  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.002800  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:17.003593  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:17.004909  7754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1443) took 1667 ms (client timeout 2128 ms). Trace:
I20260501 13:59:17.008322  9395 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.009492  9395 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.010341  9422 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.011248  9422 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.012156  9312 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:17.013134  9312 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.014442  9422 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.005602  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.019773  7751 raft_consensus.cc:2410] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:17.021339  9332 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.022140  9332 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.022919  9332 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.028446  9312 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.029605  9312 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:17.030592  9312 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.033074  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2056) took 1272 ms. Trace:
I20260501 13:59:17.033216  9378 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:17.033883  7679 rpcz_store.cc:276] 0501 13:59:15.760550 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.773748 (+ 13198us) service_pool.cc:224] Handling call
0501 13:59:17.032466 (+1258718us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540019c154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:17.032754 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938263424}
I20260501 13:59:17.035717  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.037384  9379 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:17.038329  9379 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:16.992292  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1093) took 1338 ms. Trace:
I20260501 13:59:17.040457  9379 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.040053  7821 rpcz_store.cc:276] 0501 13:59:15.653460 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:16.254790 (+601330us) service_pool.cc:224] Handling call
0501 13:59:16.255049 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.988200 (+733151us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.991361 (+  3161us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540028df54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:16.991781 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241894656}
I20260501 13:59:17.042716  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 199) took 1451 ms. Trace:
I20260501 13:59:17.045156  8372 rpcz_store.cc:276] 0501 13:59:15.591382 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.593041 (+  1659us) service_pool.cc:224] Handling call
0501 13:59:17.042145 (+1449104us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540049c0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:17.042400 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197458688}
I20260501 13:59:17.023519  9395 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.052271  9395 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 13:59:17.052446  8381 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:17.037397  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:17.053915  9395 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:17.057082  9446 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:17.034801  9378 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
W20260501 13:59:17.006799  7754 rpcz_store.cc:269] 0501 13:59:15.337736 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:15.337855 (+   119us) service_pool.cc:224] Handling call
0501 13:59:15.672707 (+334852us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800062798. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:17.004450 (+1331743us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54003acfd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:17.004685 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573239296}
I20260501 13:59:17.060792  9378 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:17.006798  7819 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.018s
W20260501 13:59:17.115445  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.117197  9589 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.118276  9589 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:17.125314  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 166663us
I20260501 13:59:17.129528  7823 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:17.107051  9395 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260501 13:59:17.128443  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.135568  9492 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:16.871768  9499 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.137274  9507 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.142943  9531 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.143252  9507 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.144127  9531 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.131140  7819 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:17.155345  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 263) took 1545 ms. Trace:
I20260501 13:59:17.152901  9312 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:17.154392  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:17.159514  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58346.1us
W20260501 13:59:17.172355  9629 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.000s	sys 0.012s
W20260501 13:59:17.157275  9061 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260501 13:59:17.158974  9599 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:17.178330  9629 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.000s	sys 0.013s
I20260501 13:59:17.183923  9492 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:17.184813  9095 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.004s
I20260501 13:59:17.185902  7750 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:17.186565  9492 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.187459  9395 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:17.188159  9589 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.188915  9378 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.155864  7819 rpcz_store.cc:276] 0501 13:59:15.609585 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:16.223764 (+614179us) service_pool.cc:224] Handling call
0501 13:59:16.253367 (+ 29603us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:16.424690 (+171323us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b540041dd20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6591a0 00007fb2fa6e35a0 00007fb2fa6e4611 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c
0501 13:59:17.154897 (+730207us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:17.155241 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35203456}
I20260501 13:59:17.192075  9332 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.192770  9514 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.193549  9514 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.178738  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.196753  9446 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:17.205420  9507 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:17.212919  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:17.215435  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.216602  9009 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.216210  9599 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.155774  9480 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.208436  9446 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.219471  9446 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:17.220825  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:17.220935  9599 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.222218  9125 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:17.222548  9598 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:17.222780  9125 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.223302  9125 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:17.228255  9492 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:17.217411  9009 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.229527  9480 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.223301  9598 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.231559  9009 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.198714  9514 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.264568  9422 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:17.291373  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 147209us
W20260501 13:59:17.294335  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 72223.8us
W20260501 13:59:17.299583  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 170181us
I20260501 13:59:17.300966  9492 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:17.301954  9456 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:17.302531  9492 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.302673  9456 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.305243  9492 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.305447  9456 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.308179  9600 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:17.307982  9422 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.308954  9600 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.310550  9422 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.311249  9600 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.296574  9514 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:17.318042  9514 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:17.322166  9351 consensus_meta.cc:287] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.014s
I20260501 13:59:17.321921  9305 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:17.323258  9659 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260501 13:59:17.323388  9575 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.323962  9378 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:17.327618  9598 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.334969  9600 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.329161  9492 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:17.357187  9492 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.356994  9600 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:17.359476  9492 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.329105  9657 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:17.337208  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.360965  7750 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
W20260501 13:59:17.339112  9646 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.186s	user 0.000s	sys 0.003s
I20260501 13:59:17.341037  9446 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.344172  9591 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:17.345517  9658 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:17.346472  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.354132  9575 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.355106  9305 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.369172  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:17.372231  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 55140.9us
I20260501 13:59:17.375761  9422 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.377347  9422 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.350451  9351 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:17.382304  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.385012  9658 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.376381  9498 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.386754  9498 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.388111  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:17.389285  7754 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:17.373811  9600 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:17.390246  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.383808  9514 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.387646  9531 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.387455  9658 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.403148  9422 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.406689  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.407007  9658 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.407776  9658 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.410717  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1077) took 1231 ms. Trace:
I20260501 13:59:17.411140  7677 rpcz_store.cc:276] 0501 13:59:16.179396 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:16.256374 (+ 76978us) service_pool.cc:224] Handling call
0501 13:59:16.256716 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:16.667097 (+410381us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:16.667133 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:16.667593 (+   460us) log.cc:844] Serialized 26 byte log entry
0501 13:59:16.955711 (+288118us) raft_consensus.cc:1645] Marking committed up to 1
0501 13:59:16.955801 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:16.955951 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:17.338509 (+382558us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b24000f8a08. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7495e94 00007fb2f7493f9b 00007fb2f7522d39 00007fb2f75229c5 00007fb2f752200d 00007fb2fa2644ae 00007fb2fa27bc2c 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1
0501 13:59:17.410213 (+ 71704us) raft_consensus.cc:1685] finished
0501 13:59:17.410238 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:17.410493 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410004,"raft.queue_time_us":414241,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":50629376,"thread_start_us":287367,"threads_started":1,"wal-append.queue_time_us":470264}
I20260501 13:59:17.407541  7747 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:17.413245  9446 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.414656  9351 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:17.415926  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.415778  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.416754  7820 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:17.417492  9531 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:17.418263  9661 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260501 13:59:17.419153  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.418788  9531 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:17.422938  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.424589  9305 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.424701  9095 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:17.419786  7747 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:17.425673  9575 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.426805  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.428535  9498 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.432528  9446 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:17.434789  7754 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
W20260501 13:59:17.438232  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.439085  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:17.439239  9095 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:17.439808  9095 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.440186  9095 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:17.435345  9125 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:17.452611  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:17.454762  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.456584  9531 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.465032  9534 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.465343  9125 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.460161  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.484710  7750 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:17.486979  9534 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.491317  9422 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:17.495122  9422 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.496260  9575 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.497182  9422 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.489992  9534 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.497092  9575 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.505249  7820 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:17.503693  9531 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.520390  9095 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.521139  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.521471  9531 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.522894  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.522991  9095 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.520150  9061 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.523512  9480 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:17.524786  9575 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.526955  9061 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.529268  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.529628  9061 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.530820  9061 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:17.529907  9575 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:17.523679  9531 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.533372  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:17.533643  7821 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 13:59:17.531553  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.539664  9534 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:17.540143  9534 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.540498  9534 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:17.541019  7751 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:17.542791  7745 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260501 13:59:17.544418  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.547619  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.550330  9095 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:17.550875  7819 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:17.549448  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.549757  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:17.552253  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.552199  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.554140  8381 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:17.554302  7827 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:17.554737  7820 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:17.555703  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.556342  7746 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:17.557565  7827 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:17.558743  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.559105  7828 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260501 13:59:17.559665  7819 raft_consensus.cc:2410] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260501 13:59:17.565512  9532 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:17.566071  9532 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.566460  9532 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:17.568046  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:17.571949  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.576819  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.577631  7827 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:17.577677  7819 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:17.576841  9660 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:17.579152  9660 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.579555  9660 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:17.582469  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.575237  9658 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.584218  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:17.584918  7827 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:17.587533  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.588454  7819 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:17.588819  9573 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:17.588675  9422 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:17.589247  9573 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.589653  9573 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:17.602916  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:17.607278  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.623143  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 296) took 4204 ms. Trace:
I20260501 13:59:17.623287  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.625180  7827 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
W20260501 13:59:17.626278  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 94918.2us
I20260501 13:59:17.615135  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:17.627894  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:17.629384  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.630800  7824 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:17.630631  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.631609  9009 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:17.632118  9009 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:17.632544  9009 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:17.621858  9573 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.636453  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.616339  9660 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.636981  7827 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:17.629117  7822 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:17.642342  7754 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:17.648192  9660 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.648573  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.649396  7819 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:17.650375  7820 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260501 13:59:17.650904  7820 pending_rounds.cc:85] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 4
I20260501 13:59:17.651194  7820 pending_rounds.cc:107] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:17.651631  7820 raft_consensus.cc:2889] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:17.653328  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.654174  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.643515  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.660300  7746 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:17.634680  7576 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 4, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:17.639349  9446 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.665691  9446 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.667030  7824 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:17.656412  9573 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.656610  9591 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.665726  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.678251  7745 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:17.678133  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.682359  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.672860  9480 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:17.684360  8372 raft_consensus.cc:2410] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260501 13:59:17.683136  9125 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:17.686641  9125 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:17.686717  9061 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:17.690285  9125 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.674244  9534 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.679569  9591 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:17.700264  9671 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260501 13:59:17.691314  9532 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.702716  9446 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.710383  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.624269  7577 rpcz_store.cc:276] 0501 13:59:13.416381 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:13.416538 (+   157us) service_pool.cc:224] Handling call
0501 13:59:17.620798 (+4204260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:15.779441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:15.781228 (+  1787us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:15.781280 (+    52us) write_op.cc:435] Acquired schema lock
0501 13:59:15.781306 (+    26us) tablet.cc:662] Decoding operations
0501 13:59:15.781856 (+   550us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:15.781944 (+    88us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:15.781986 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0501 13:59:15.782390 (+   404us) tablet.cc:701] Row locks acquired
0501 13:59:15.782412 (+    22us) write_op.cc:260] PREPARE: finished
0501 13:59:15.782601 (+   189us) write_op.cc:270] Start()
0501 13:59:15.782757 (+   156us) write_op.cc:276] Timestamp: P: 1777643955782548 usec, L: 0
0501 13:59:15.782786 (+    29us) op_driver.cc:348] REPLICATION: starting
0501 13:59:15.783663 (+   877us) log.cc:844] Serialized 923 byte log entry
0501 13:59:16.401884 (+618221us) op_driver.cc:464] REPLICATION: finished
0501 13:59:16.895264 (+493380us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2f762682c 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fe123360
0501 13:59:17.261755 (+366491us) write_op.cc:301] APPLY: starting
0501 13:59:17.261977 (+   222us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:17.262216 (+   239us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:17.262268 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:17.373498 (+111230us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:17.396947 (+ 23449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0501 13:59:17.397658 (+   711us) write_op.cc:312] APPLY: finished
0501 13:59:17.403960 (+  6302us) log.cc:844] Serialized 29 byte log entry
0501 13:59:17.430434 (+ 26474us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b1800154ba0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fe123360 00007fb2fe1238f9 00007fb2fe125b8a
0501 13:59:17.537076 (+106642us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:17.581922 (+ 44846us) write_op.cc:454] Released schema lock
0501 13:59:17.591893 (+  9971us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:17.593770 (+  1877us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:17.593803 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":769530,"apply.run_cpu_time_us":37792,"apply.run_wall_time_us":356422,"num_ops":2,"prepare.queue_time_us":54219,"prepare.run_cpu_time_us":10759,"prepare.run_wall_time_us":191727,"raft.queue_time_us":280765,"raft.run_cpu_time_us":44801,"raft.run_wall_time_us":1042631,"replication_time_us":618872,"spinlock_wait_cycles":130444928,"thread_start_us":1263408,"threads_started":5,"wal-append.queue_time_us":376591,"wal-append.run_cpu_time_us":17957,"wal-append.run_wall_time_us":1270744}]]}
I20260501 13:59:17.716614  7828 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260501 13:59:17.722747  9534 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:17.720846  7754 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:17.725967  7827 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:17.729549  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:17.731560  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.736132  9061 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:17.736238  9446 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:17.739267  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.740206  7827 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:17.738924  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.742332  9446 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.748557  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.749323  8380 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:17.744899  9591 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.747713  9446 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.760625  9532 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.766701  9658 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.767488  9658 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:17.773310  9009 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.785502  8380 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:17.786315  9658 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:17.804407  9009 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:17.806447  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 86346.8us
I20260501 13:59:17.810688  7822 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:17.814325  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.815089  8380 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:17.814942  9532 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:17.816006  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.816694  8372 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:17.820662  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.822695  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.823535  8380 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:17.823830  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:17.825476  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.826097  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.826640  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.826808  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.827773  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.828613  7746 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:17.829514  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.830339  8381 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:17.831239  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.832052  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.832762  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.833448  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.834157  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.835065  7751 raft_consensus.cc:2410] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260501 13:59:17.835611  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:17.838404  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.839468  8373 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:17.841794  7828 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:17.842677  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:17.843180  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:17.845252  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:17.856205  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:17.858901  7824 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260501 13:59:17.863015  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:17.865522  9009 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:17.805562  9061 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:17.877916  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:17.865100  9095 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:17.896935  9573 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:17.897603  9573 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:17.897976  9573 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:17.877137  9061 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:17.900852  9061 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:17.883538  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.905411  9660 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:17.905843  9660 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:17.905754  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:17.906344  9660 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:17.881068  9534 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:17.908671  9534 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:17.909065  9534 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:17.909409  9534 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:17.911099  9243 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:17.916100  9660 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.140177  9095 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:18.327647  7718 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.025s
W20260501 13:59:18.329423  7718 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.010s	sys 0.025s
W20260501 13:59:18.329846  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 592897us
W20260501 13:59:18.332207  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.002s (SENT) [suppressed 21 similar messages]
W20260501 13:59:18.340390  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 433613us
I20260501 13:59:18.353683  9125 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260501 13:59:18.363639  9573 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.365818  9685 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.366677  9685 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.367162  9573 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.382522  9684 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260501 13:59:18.405108  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 63882.1us
W20260501 13:59:18.404282  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49158.4us
I20260501 13:59:18.409281  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.401814  9685 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.393735  9660 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.441627  8380 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260501 13:59:18.473239  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 649501us
I20260501 13:59:18.384145  9534 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.520048  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:18.521332  9095 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:18.522076  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.523121  9095 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:18.523586  9095 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:18.524029  9095 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:18.524629  9690 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:18.525139  9690 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:18.525547  9690 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:18.530965  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:18.531430  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:18.531769  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:18.536387  9691 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:18.536928  9691 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:18.537356  9691 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:18.530965  9534 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.552340  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:18.554068  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:18.560165  7824 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:18.560710  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:18.562281  9095 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.523272  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.566658  7746 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:18.568244  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.595938  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:18.602269  7827 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:18.592732  9095 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.604032  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:18.604271  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 81093.5us
I20260501 13:59:18.605059  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.607731  7824 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:18.592923  9694 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:18.608628  9682 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:18.608978  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:18.609810  9095 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:18.614257  9690 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.620441  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.623106  9095 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:18.625777  9095 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:18.626279  9697 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:18.627213  9697 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:18.627709  9697 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:18.641976  9095 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:18.643960  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48747.1us
I20260501 13:59:18.623073  9682 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:18.644176  9694 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:18.646261  9534 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:18.655366  9694 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.656342  9534 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:18.652829  9682 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:18.659224  9534 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.660373  9095 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.619892  9691 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.663028  9691 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.666620  9690 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.680660  7827 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:18.700544  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 173) took 4468 ms. Trace:
I20260501 13:59:18.709164  9697 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:18.720074  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 115101us
I20260501 13:59:18.737236  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:18.741295  8381 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 13:59:18.742220  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 97487us
W20260501 13:59:18.734556  7792 connection.cc:254] RPC call timeout handler was delayed by -1.2208530169999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260501 13:59:18.701061  7576 rpcz_store.cc:276] 0501 13:59:14.231875 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:14.232011 (+   136us) service_pool.cc:224] Handling call
0501 13:59:18.700460 (+4468449us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:17.744732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:17.762497 (+ 17765us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:17.762558 (+    61us) write_op.cc:435] Acquired schema lock
0501 13:59:17.762582 (+    24us) tablet.cc:662] Decoding operations
0501 13:59:17.762986 (+   404us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:17.763086 (+   100us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:17.763138 (+    52us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:17.763459 (+   321us) tablet.cc:701] Row locks acquired
0501 13:59:17.763477 (+    18us) write_op.cc:260] PREPARE: finished
0501 13:59:17.763650 (+   173us) write_op.cc:270] Start()
0501 13:59:17.763783 (+   133us) write_op.cc:276] Timestamp: P: 1777643957763581 usec, L: 0
0501 13:59:17.763843 (+    60us) op_driver.cc:348] REPLICATION: starting
0501 13:59:17.764760 (+   917us) log.cc:844] Serialized 533 byte log entry
0501 13:59:17.769891 (+  5131us) op_driver.cc:464] REPLICATION: finished
0501 13:59:17.770635 (+   744us) write_op.cc:301] APPLY: starting
0501 13:59:17.770735 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:17.770851 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:17.770955 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:17.771258 (+   303us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:17.771441 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:17.771488 (+    47us) write_op.cc:312] APPLY: finished
0501 13:59:17.771697 (+   209us) log.cc:844] Serialized 23 byte log entry
0501 13:59:17.771916 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:17.772016 (+   100us) write_op.cc:454] Released schema lock
0501 13:59:17.772067 (+    51us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:17.784824 (+ 12757us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:17.784857 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":512,"apply.run_cpu_time_us":1843,"apply.run_wall_time_us":14110,"num_ops":1,"prepare.queue_time_us":53878,"prepare.run_cpu_time_us":3539,"prepare.run_wall_time_us":20363,"replication_time_us":5884,"thread_start_us":20953,"threads_started":1}]]}
I20260501 13:59:18.746940  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:18.736034  9697 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.754478  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.752432  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:18.755767  9694 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:18.755808  8376 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:18.756275  9243 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.764887  9243 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.756343  9694 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:18.769496  9694 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:18.770906  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:18.772027  9095 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.772812  9095 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.756412  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:18.775768  9095 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:18.782361  7823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.018s	sys 0.014s
W20260501 13:59:18.786264  7823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.020s	sys 0.015s
I20260501 13:59:18.797087  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.790758  9682 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.804171  8372 raft_consensus.cc:2368] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4.
I20260501 13:59:18.805207  9682 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.805477  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:18.806928  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:18.761694  9690 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260501 13:59:18.798417  9243 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:18.807575  7822 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:18.815999  9095 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:18.824159  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:18.824930  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:18.824967  8380 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:18.840392  8380 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:18.841979  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.854238  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:18.855293  7822 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 4
I20260501 13:59:18.855866  8376 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:18.869184  9658 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:18.870244  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:18.870828  7825 raft_consensus.cc:1813] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Handling vote request from an unknown peer bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:18.871255  7825 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:18.869949  9658 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:18.880033  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 122679us
I20260501 13:59:18.883708  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:18.888166  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:18.889626  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:18.892021  9709 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260501 13:59:18.891371  9690 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:18.894762  9690 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:18.895176  9690 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:18.886529  9657 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.898126  9657 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.900398  9657 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.900950  9657 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.901454  9657 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.903453  9657 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.905211  9095 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:18.907250  9125 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:18.907651  9095 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.910867  9701 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:18.920508  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:18.921242  7826 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:18.921272  9658 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.913188  9694 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:18.928560  9694 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.931150  9690 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.934615  9714 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:18.934561  7574 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 2 to 3, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:18.920596  9701 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.930802  9694 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.938083  7820 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260501 13:59:18.939292  7822 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:18.932250  7826 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:18.943244  9658 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.943867  9658 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.944208  9657 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:18.944790  9657 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:18.945281  9701 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.945951  9658 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.940050  9125 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:18.946828  9657 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:18.947149  9125 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.940745  7574 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:18.948872  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:18.949409  7574 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:18.950340  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:18.951068  7574 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:18.953540  7574 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:18.955108  7574 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 5 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:18.957928  9658 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:18.968190  9658 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:18.971505  9681 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.628s	user 0.004s	sys 0.000s
I20260501 13:59:18.967613  9690 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.972580  9690 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:18.973212  9690 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.973616  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1313) took 1206 ms. Trace:
I20260501 13:59:18.976217  7823 rpcz_store.cc:276] 0501 13:59:17.767073 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:17.772303 (+  5230us) service_pool.cc:224] Handling call
0501 13:59:17.787355 (+ 15052us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:17.837344 (+ 49989us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:17.837379 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:17.838121 (+   742us) log.cc:844] Serialized 26 byte log entry
0501 13:59:18.786869 (+948748us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:18.798558 (+ 11689us) log.cc:844] Serialized 14 byte log entry
0501 13:59:18.812698 (+ 14140us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:18.812796 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:18.970783 (+157987us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:18.973288 (+  2505us) raft_consensus.cc:1685] finished
0501 13:59:18.973390 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:18.973532 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25960,"prepare.queue_time_us":11286,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":45,"raft.queue_time_us":68352,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":5666,"spinlock_wait_cycles":2516224,"thread_start_us":948254,"threads_started":1,"wal-append.queue_time_us":309497}
I20260501 13:59:18.975584  9690 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:18.980959  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:18.980787  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60421.6us
I20260501 13:59:18.983273  9715 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:18.984073  9715 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:18.986539  9715 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.987507  9715 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:18.988039  9715 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:18.990126  9715 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:18.935320  9714 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.004060  9690 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.010551  9701 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:19.011410  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.011695  9701 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.010351  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:18.991878  9715 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:19.012898  7746 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:19.026369  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.027170  7747 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:19.027359  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.029428  9721 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.033073  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:19.033046  9721 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:19.033936  7819 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:19.035916  7748 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:19.016336  9716 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.038726  9695 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.039374  9695 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.041729  9695 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:19.042189  9701 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.035661  9721 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.043556  9721 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.038772  9716 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.024530  9690 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.044082  9721 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.047364  9716 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.053792  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.055177  7819 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:19.043977  9715 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:19.065223  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 82830.8us
I20260501 13:59:19.067463  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.058295  7746 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:19.068228  7750 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:19.078998  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.080138  7677 raft_consensus.cc:2410] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260501 13:59:19.082470  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.083451  7746 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:19.088299  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.088976  7752 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:19.091925  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.092661  7679 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:19.093633  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.094511  7674 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:19.096793  7746 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:19.098523  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.095741  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.100512  9658 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.101202  9658 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.101425  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.102078  7745 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:19.101750  9658 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.080595  9724 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:19.105491  9724 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.102099  9721 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.096693  9690 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.111637  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.108275  9724 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:19.118574  7745 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:19.119336  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 364) took 1303 ms. Trace:
I20260501 13:59:19.119668  7745 rpcz_store.cc:276] 0501 13:59:17.815568 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.101189 (+1285621us) service_pool.cc:224] Handling call
0501 13:59:19.119252 (+ 18063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:19.124635  7679 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
W20260501 13:59:19.124517  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 282656us
I20260501 13:59:19.129460  7750 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:19.132464  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:19.133443  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:19.137740  7752 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:19.138597  7675 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:19.148535  7679 raft_consensus.cc:1217] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-4.4]   Dedup: 4.4->[]
I20260501 13:59:19.149442  7679 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260501 13:59:19.135051  9697 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:19.157673  7746 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:19.137483  9658 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.160434  9712 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.164297  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.164888  7670 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 1. Current term is 2. Ops: []
I20260501 13:59:19.165472  9697 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:19.166033  9711 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.169507  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:19.168066  9699 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:19.167115  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:19.186216  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:19.189548  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:19.191164  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:19.194203  7679 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:19.201081  9685 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.201345  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.201839  9685 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.202313  9732 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.200480  9699 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.202905  9732 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.193547  9711 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.204651  9685 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.205161  9699 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:19.205305  9685 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.205896  9699 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:19.205958  9685 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.206496  9699 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:19.206468  9711 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.208568  9711 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.209235  9732 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.208056  9699 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:19.209348  9711 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:19.211076  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.213305  7670 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 2: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:19.213727  9697 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.192238  9712 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.216162  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1315) took 1361 ms. Trace:
I20260501 13:59:19.216573  7828 rpcz_store.cc:276] 0501 13:59:17.854565 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:17.854696 (+   131us) service_pool.cc:224] Handling call
0501 13:59:19.216055 (+1361359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:19.211710  9685 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.216965  9712 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.217768  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.219733  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:19.221163  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:19.222906  9731 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:19.223426  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.225263  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.226079  7676 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:19.227109  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.227742  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:19.228430  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.231360  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.236256  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.237766  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.238587  7676 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:19.239521  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.218146  9711 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.249003  9735 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.249895  9735 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.288074  7819 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
W20260501 13:59:19.606825  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:19.424263  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:19.424765  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:19.518524  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 327428us
I20260501 13:59:19.797061  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:19.797571  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:19.579608  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:19.795670  7828 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:19.797838  7675 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:19.804677  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:19.806563  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.806821  9737 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.807610  9737 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.808705  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1318) took 1040 ms. Trace:
W20260501 13:59:19.782482  9733 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260501 13:59:19.809124  7825 rpcz_store.cc:276] 0501 13:59:18.768346 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:18.888942 (+120596us) service_pool.cc:224] Handling call
0501 13:59:18.905631 (+ 16689us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:19.197245 (+291614us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:19.197552 (+   307us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:19.210339 (+ 12787us) log.cc:844] Serialized 26 byte log entry
0501 13:59:19.466398 (+256059us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:19.466460 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:19.466572 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:19.808314 (+341742us) raft_consensus.cc:1685] finished
0501 13:59:19.808338 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:19.808633 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214668,"raft.queue_time_us":232807,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":9134,"thread_start_us":318890,"threads_started":2,"wal-append.queue_time_us":542871}
I20260501 13:59:19.810072  9735 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.774621  9696 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:19.754310  9724 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.592073  9658 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.720067  9694 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.680141  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:19.816656  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:19.808033  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:19.819828  8344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.014s
W20260501 13:59:19.822887  8344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.001s	sys 0.014s
W20260501 13:59:19.823501  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 568327us
I20260501 13:59:19.824710  7792 leader_election.cc:400] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4.
I20260501 13:59:19.825138  7792 leader_election.cc:403] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:19.829886  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.831019  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.813303  9711 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:19.835222  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.838481  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.856956  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.857270  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:19.820232  9697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.005s	sys 0.022s
I20260501 13:59:19.860379  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:19.858237  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:19.862372  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:19.820863  9125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.005s	sys 0.019s
I20260501 13:59:19.866672  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.867641  7675 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:19.861423  7828 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:19.833039  7820 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:19.840682  9735 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4.
W20260501 13:59:19.865083  9697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.007s	sys 0.024s
W20260501 13:59:19.869270  9125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.007s	sys 0.021s
W20260501 13:59:19.883873  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 86397.9us
I20260501 13:59:19.884389  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:19.822638  9658 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.888128  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1319) took 1119 ms. Trace:
I20260501 13:59:19.827939  9694 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.821215  9696 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.890362  7819 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:19.889213  9744 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:19.894263  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:19.881286  9736 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.886833  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:19.869563  9734 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:19.899220  7824 rpcz_store.cc:276] 0501 13:59:18.768654 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:18.889036 (+120382us) service_pool.cc:224] Handling call
0501 13:59:18.904713 (+ 15677us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:19.125748 (+221035us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:19.125800 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:19.131060 (+  5260us) log.cc:844] Serialized 26 byte log entry
0501 13:59:19.218995 (+ 87935us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:19.221045 (+  2050us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:19.221151 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:19.887777 (+666626us) raft_consensus.cc:1685] finished
0501 13:59:19.887810 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:19.888033 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237554,"raft.queue_time_us":229020,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":952,"thread_start_us":80107,"threads_started":1,"wal-append.queue_time_us":84321}
I20260501 13:59:19.823966  9724 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.916406  7828 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 1.
I20260501 13:59:19.922894  9696 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:19.924335  9737 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:19.924723  9718 raft_consensus.cc:1064] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:59:19.950042  7819 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:19.928618  9736 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:19.926595  9734 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:20.001400  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 184849us
I20260501 13:59:20.032097  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.023277  7675 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:19.918999  8373 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
W20260501 13:59:20.003223  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 75484.2us
W20260501 13:59:19.954272  7792 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.562s (SENT)
I20260501 13:59:20.127346  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:20.023308  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:20.128298  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 229076us
W20260501 13:59:19.996290  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080027d400 after lost signal to thread 6457
W20260501 13:59:20.027957  9743 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260501 13:59:20.141299  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.142336  7675 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:20.027988  9699 consensus_meta.cc:287] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.775s	user 0.014s	sys 0.000s
I20260501 13:59:20.020494  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.146654  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 375) took 1058 ms. Trace:
I20260501 13:59:19.990787  9658 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:20.147120  7749 rpcz_store.cc:276] 0501 13:59:19.087802 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.090960 (+  3158us) service_pool.cc:224] Handling call
0501 13:59:19.100357 (+  9397us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:19.106921 (+  6564us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:19.106973 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:19.107061 (+    88us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:19.107109 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:20.145029 (+1037920us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b5400106dd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:20.146269 (+  1240us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:20.146434 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14474496}
I20260501 13:59:20.148355  9658 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:20.148937  9658 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:20.149742  9737 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:20.149961  9658 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.150709  7820 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:20.150938  9724 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:20.018604  9694 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:20.033964  9731 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:20.151702  9731 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:20.153916  9737 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.154520  9737 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:19.999402  9714 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:19.998585  9715 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:20.141261  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 187041us
I20260501 13:59:20.157342  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.143115  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.143502  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:19.936589  9697 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:19.985693  9735 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:20.164899  7792 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.612s (SENT)
I20260501 13:59:20.158459  7679 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:20.165910  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:20.161078  9753 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:20.156700  9737 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.164113  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.160420  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.138121  9711 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:20.177013  7675 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:20.162180  9697 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.176445  7670 raft_consensus.cc:2376] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5. Re-sending same reply.
I20260501 13:59:20.169514  9735 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.183759  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.186393  9734 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.173030  9715 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260501 13:59:20.188020  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.189860  9735 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.190529  9697 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.191231  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.165313  9699 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.192203  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.193091  7824 raft_consensus.cc:2410] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260501 13:59:20.193148  9699 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.194545  7828 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 4: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:20.177603  9711 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.222119  9734 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:20.223924  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:20.224781  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.222504  9757 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260501 13:59:20.233798  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 88129.3us
I20260501 13:59:20.234062  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:20.233878  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75764.7us
W20260501 13:59:20.235062  7792 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.651s (SENT)
I20260501 13:59:20.236640  7828 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:20.228447  9756 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:20.193902  9731 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.228394  9715 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260501 13:59:20.377313  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.292807  9736 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.290763  9734 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.234205  9735 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:20.239089  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:20.289896  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 86259.1us
I20260501 13:59:20.332326  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.354543  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.364476  9718 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.388433  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:20.389660  9764 raft_consensus.cc:2764] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260501 13:59:20.385782  9734 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.238341  9756 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:20.328751  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.392379  9734 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.237969  9697 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.392918  9734 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:20.392477  9756 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.393322  9697 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:20.279925  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.346550  7828 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:20.366657  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 190) took 1128 ms. Trace:
I20260501 13:59:20.392571  7819 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:20.381816  8372 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:20.241237  7824 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260501 13:59:20.238420  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 98082.8us
W20260501 13:59:20.387168  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 152125us
I20260501 13:59:20.385883  9735 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.302700  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 370) took 1220 ms. Trace:
I20260501 13:59:20.320194  9243 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:20.319813  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.390816  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:20.330735  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.276623  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:20.269330  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800330080 after lost signal to thread 7611
I20260501 13:59:20.264361  9737 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:20.393868  9756 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:20.395735  9697 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.400017  9736 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.460170  9736 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:20.460510  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.462235  9736 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.400378  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.463409  7820 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:20.400951  7671 rpcz_store.cc:276] 0501 13:59:19.238471 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.244144 (+  5673us) service_pool.cc:224] Handling call
0501 13:59:20.365504 (+1121360us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606a3e 000000000035a3c9 00007fb2ff63e8e0 00007fb2ff707784 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:20.365755 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:20.366046 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:20.366083 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:20.366140 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:20.366188 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:20.366265 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:20.366433 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271901184}
W20260501 13:59:20.402661  9751 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.382s	user 0.000s	sys 0.004s
I20260501 13:59:20.467741  9711 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:20.410970  7823 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:20.416900  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:20.468431  9711 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.419202  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.420002  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.470597  9711 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.471967  9736 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:20.421028  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1127) took 2712 ms. Trace:
I20260501 13:59:20.472585  9736 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.474915  9736 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.472739  7821 rpcz_store.cc:276] 0501 13:59:17.708829 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:17.708958 (+   129us) service_pool.cc:224] Handling call
0501 13:59:17.714317 (+  5359us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:17.715901 (+  1584us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:17.715941 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:17.716576 (+   635us) log.cc:844] Serialized 26 byte log entry
0501 13:59:17.747276 (+ 30700us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18003a5b20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 13:59:17.859971 (+112695us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:17.862496 (+  2525us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:18.492792 (+630296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:20.419676 (+1926884us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540041e220. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa65719e 00007fb2fa661d10 00007fb2fa661cb8 00007fb2fa661c38 00007fb2fa661bf3 00007fb2fa660e7c 00007fb300539d16 00007fb3005344c8 00007fb2fa69dbab 00007fb2fa6a06a0
0501 13:59:20.420786 (+  1110us) raft_consensus.cc:1685] finished
0501 13:59:20.420808 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:20.420936 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":2114,"spinlock_wait_cycles":1469323904,"thread_start_us":105100,"threads_started":1,"wal-append.queue_time_us":179846}
I20260501 13:59:20.416242  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.420794  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.477454  7573 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:20.489878  7573 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260501 13:59:20.424228  9243 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:20.510308  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd9e0 after lost signal to thread 7703
W20260501 13:59:20.510774  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1520 after lost signal to thread 7704
I20260501 13:59:20.422305  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 203) took 1029 ms. Trace:
I20260501 13:59:20.511126  9243 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.426695  9715 consensus_queue.cc:1243] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260501 13:59:20.430142  9694 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260501 13:59:20.513011  9694 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:20.513370  9694 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:20.514197  9694 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.515471  9694 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:20.427356  7673 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:20.521926  9657 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:20.522357  9657 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:20.425422  7678 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:20.449676  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58919.1us
W20260501 13:59:20.524415  7678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 197) took 1281 ms (client timeout 1578 ms). Trace:
W20260501 13:59:20.524807  7678 rpcz_store.cc:269] 0501 13:59:19.242608 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.244688 (+  2080us) service_pool.cc:224] Handling call
0501 13:59:20.319427 (+1074739us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:20.524346 (+204919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445562112}
I20260501 13:59:20.525715  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:20.511579  7679 rpcz_store.cc:276] 0501 13:59:19.393165 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:20.167313 (+774148us) service_pool.cc:224] Handling call
0501 13:59:20.176518 (+  9205us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:20.181257 (+  4739us) raft_consensus.cc:1534] Early marking committed up to index 7
0501 13:59:20.381899 (+200642us) log.cc:844] Serialized 14 byte log entry
0501 13:59:20.421895 (+ 39996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:20.421946 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:20.422029 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:20.422101 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:20.422249 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59113,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":112,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":226615,"threads_started":2,"wal-append.queue_time_us":72991}
I20260501 13:59:20.457652  9735 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.458037  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.414525  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.528311  7754 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:20.528878  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:20.450500  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 285) took 3314 ms. Trace:
I20260501 13:59:20.454928  9422 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:20.530145  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:20.519243  7573 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:20.528277  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 70317.1us
I20260501 13:59:20.531621  9753 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:20.531693  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.532295  9715 raft_consensus.cc:2764] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260501 13:59:20.534092  9701 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:20.534632  9701 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:20.532326  9753 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:20.535900  9753 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:20.538491  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.539287  9716 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:20.539773  9716 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:20.540426  9125 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.540721  9716 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.541007  9125 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.542995  9125 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.423360  7751 rpcz_store.cc:276] 0501 13:59:19.082376 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.082913 (+   537us) service_pool.cc:224] Handling call
0501 13:59:19.093101 (+ 10188us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:19.128877 (+ 35776us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:19.128912 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:19.130737 (+  1825us) log.cc:844] Serialized 26 byte log entry
0501 13:59:20.301792 (+1171055us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180035b360. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471
0501 13:59:20.302058 (+   266us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:20.302115 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:20.302220 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:20.302305 (+    85us) raft_consensus.cc:1685] finished
0501 13:59:20.302326 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:20.302612 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62062,"raft.queue_time_us":37243,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":15870,"spinlock_wait_cycles":3759360,"thread_start_us":21927,"threads_started":1,"wal-append.queue_time_us":31136,"wal-append.run_cpu_time_us":1826,"wal-append.run_wall_time_us":1002298}
I20260501 13:59:20.401981  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.405320  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.415892  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:20.544409  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 139219us
I20260501 13:59:20.415220  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.431756  9731 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.545123  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.545980  9770 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:20.546655  9770 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:20.547968  9770 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.535615  9701 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.432811  9737 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.531724  7573 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:20.554976  9737 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.426450  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 198) took 1183 ms. Trace:
I20260501 13:59:20.560387  7672 rpcz_store.cc:276] 0501 13:59:19.242932 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.245225 (+  2293us) service_pool.cc:224] Handling call
0501 13:59:20.330532 (+1085307us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:20.426379 (+ 95847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213575424}
I20260501 13:59:20.530462  9422 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.471837  9697 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.562106  9697 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.526634  9756 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:20.563745  9756 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:20.564329  9756 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:20.529495  7574 rpcz_store.cc:276] 0501 13:59:17.146158 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:17.164381 (+ 18223us) service_pool.cc:224] Handling call
0501 13:59:17.446612 (+282231us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:20.450388 (+3003776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:19.047984 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:19.049270 (+  1286us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:19.049348 (+    78us) write_op.cc:435] Acquired schema lock
0501 13:59:19.049395 (+    47us) tablet.cc:662] Decoding operations
0501 13:59:19.051076 (+  1681us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:19.051225 (+   149us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:19.051288 (+    63us) tablet.cc:685] Acquiring locks for 6 operations
0501 13:59:19.052555 (+  1267us) tablet.cc:701] Row locks acquired
0501 13:59:19.052624 (+    69us) write_op.cc:260] PREPARE: finished
0501 13:59:19.052985 (+   361us) write_op.cc:270] Start()
0501 13:59:19.053411 (+   426us) write_op.cc:276] Timestamp: P: 1777643959052863 usec, L: 0
0501 13:59:19.053446 (+    35us) op_driver.cc:348] REPLICATION: starting
0501 13:59:19.078857 (+ 25411us) log.cc:844] Serialized 2521 byte log entry
0501 13:59:19.809363 (+730506us) op_driver.cc:464] REPLICATION: finished
0501 13:59:19.999971 (+190608us) write_op.cc:301] APPLY: starting
0501 13:59:20.000068 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:20.000290 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:20.000433 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:20.018415 (+ 17982us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:20.018799 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0501 13:59:20.018919 (+   120us) write_op.cc:312] APPLY: finished
0501 13:59:20.019567 (+   648us) log.cc:844] Serialized 53 byte log entry
0501 13:59:20.021219 (+  1652us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:20.021427 (+   208us) write_op.cc:454] Released schema lock
0501 13:59:20.021519 (+    92us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:20.163387 (+141868us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:20.163433 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":543720192,"child_traces":[["op",{"apply.queue_time_us":190300,"apply.run_cpu_time_us":5259,"apply.run_wall_time_us":141488,"num_ops":6,"prepare.queue_time_us":73290,"prepare.run_cpu_time_us":9813,"prepare.run_wall_time_us":38116,"raft.queue_time_us":639487,"raft.run_cpu_time_us":12183,"raft.run_wall_time_us":116962,"replication_time_us":755680,"thread_start_us":233001,"threads_started":4,"wal-append.queue_time_us":56971}]]}
I20260501 13:59:20.565752  9422 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:20.558516  9764 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:20.544507  9243 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:20.554672  7573 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:20.564847  9697 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.523228  9657 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:20.569957  7573 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:20.573753  9748 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:59:20.500344  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 205) took 1020 ms. Trace:
I20260501 13:59:20.566649  9243 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:20.593343  7573 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:20.600569  7673 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:20.601781  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2081) took 1365 ms. Trace:
W20260501 13:59:20.512045  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5100 after lost signal to thread 7778
I20260501 13:59:20.582434  9657 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:20.584661  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:20.588268  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.591408  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:20.592846  7670 rpcz_store.cc:276] 0501 13:59:19.480222 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:20.178581 (+698359us) service_pool.cc:224] Handling call
0501 13:59:20.188093 (+  9512us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:20.188271 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 6
0501 13:59:20.362728 (+174457us) log.cc:844] Serialized 14 byte log entry
0501 13:59:20.499848 (+137120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:20.499907 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:20.499967 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:20.500082 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:20.500248 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5883,"prepare.queue_time_us":52372,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":116,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":304517,"threads_started":2,"wal-append.queue_time_us":136715}
W20260501 13:59:20.604315  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080009cca0 after lost signal to thread 7779
I20260501 13:59:20.602342  7673 rpcz_store.cc:276] 0501 13:59:19.236193 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.239921 (+  3728us) service_pool.cc:224] Handling call
0501 13:59:20.276380 (+1036459us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:20.601692 (+325312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445099904}
W20260501 13:59:20.611486  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 135999us
W20260501 13:59:20.612488  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800336640 after lost signal to thread 7852
W20260501 13:59:20.614044  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080031e0a0 after lost signal to thread 8405
I20260501 13:59:20.602219  7573 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:20.617290  7573 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:20.610710  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:20.587301  9744 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:59:20.619268  7573 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:20.620946  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.619807  9765 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:20.625761  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:20.621236  7573 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 2 to 4, term changed from 3 to 4, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to <none>, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:20.630287  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.630573  9243 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.631585  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.632761  9717 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:20.633169  9717 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:20.633526  9717 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:20.634523  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.637089  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:20.639288  9722 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:20.639741  9722 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:20.640110  7820 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:20.641083  9714 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:20.618552  9125 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:20.645340  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.623353  9422 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:20.641779  9737 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:20.650350  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.650556  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:20.652359  7573 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:20.653456  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:20.624413  9745 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.640136  9722 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:20.643626  9701 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260501 13:59:20.660751  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.661515  9757 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:20.628477  9708 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:20.626691  9696 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.628789  9573 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:20.662635  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:20.671317  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:20.673254  7747 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:20.680359  7754 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:20.673938  7823 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:20.674711  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.683804  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.684926  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.685245  7746 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:20.685915  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.634023  9765 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:20.674896  9750 raft_consensus.cc:2764] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260501 13:59:20.662767  9714 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:20.655107  9731 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:20.655300  9737 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:20.650355  9764 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260501 13:59:20.654624  9753 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:20.715293  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:20.690733  7792 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.533s (SENT)
I20260501 13:59:20.670878  9422 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:20.676487  9708 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.657047  9125 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:20.768391  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.715880  9658 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:20.778923  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:20.779233  8376 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:20.779636  7823 raft_consensus.cc:606] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:20.779488  9422 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.780081  7823 raft_consensus.cc:614] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:20.719460  9573 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:20.789482  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:20.789739  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.791493  9095 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:20.762234  9737 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:20.794488  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.769861  9708 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:20.683753  9696 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.792265  9095 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.765503  9699 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:20.808354  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.810187  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.800733  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:20.821859  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 131143us
I20260501 13:59:20.824045  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.762967  9756 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.831278  9095 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:20.832520  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.835089  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.808003  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.835479  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:20.843007  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.575s (SENT)
I20260501 13:59:20.853552  8373 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
W20260501 13:59:20.855513  7643 connection.cc:254] RPC call timeout handler was delayed by -1.9289344759999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260501 13:59:20.856137  7643 connection.cc:254] RPC call timeout handler was delayed by -1.8551344759999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260501 13:59:20.856465  7643 connection.cc:254] RPC call timeout handler was delayed by -1.7651344760000711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260501 13:59:20.856746  7643 connection.cc:254] RPC call timeout handler was delayed by -1.7552344760000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260501 13:59:20.857033  7643 connection.cc:254] RPC call timeout handler was delayed by -1.6301344760000802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260501 13:59:20.857215  7643 connection.cc:254] RPC call timeout handler was delayed by -1.4024344760000531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260501 13:59:20.857497  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3286344760000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260501 13:59:20.858341  8376 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:20.860342  7676 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:20.861400  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.862112  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.845019  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.865084  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.865856  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.866142  7746 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:20.863077  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.867354  7675 raft_consensus.cc:2410] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:20.867977  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:20.844055  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.870186  7673 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260501 13:59:20.871688  7673 pending_rounds.cc:85] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 1
I20260501 13:59:20.871979  7673 pending_rounds.cc:107] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260501 13:59:20.872189  7673 raft_consensus.cc:2889] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:20.835266  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:20.884588  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.884881  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.885425  7670 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:20.873921  9095 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:20.822732  9699 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:20.887384  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 64075.1us
I20260501 13:59:20.875443  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.889259  9701 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:20.890493  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.891705  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.892567  7672 raft_consensus.cc:2410] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260501 13:59:20.893296  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.894102  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.894577  7672 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:20.895154  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.895546  7672 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:20.863737  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.873605  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.874873  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.896611  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.897449  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.860428  9750 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:20.869321  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.910385  9095 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:20.910300  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.874552  7821 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:59:20.887645  9695 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:20.915670  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.916411  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.916478  7673 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
W20260501 13:59:20.918015  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:20.897826  8372 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:20.920732  9095 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.909493  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.914817  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.673713  9745 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.901316  9573 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.780200  9765 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:20.924233  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.008890  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.936055  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.940039  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.955796  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.931890  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.937495  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:20.940234  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.939682  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.019059  7679 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:20.930104  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:20.941489  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:20.979530  9095 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.005023  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.042872  7745 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
W20260501 13:59:21.045995  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 115992us
I20260501 13:59:21.047263  7827 raft_consensus.cc:2410] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260501 13:59:20.966176  9784 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260501 13:59:20.917382  9695 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:20.938344  9786 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260501 13:59:21.049233  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:20.939496  7748 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:20.980360  9125 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.054569  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:20.967839  9699 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:20.973143  9753 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:21.053699  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.055809  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:20.915148  9750 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.061311  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.062057  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:21.054210  9694 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.004s
I20260501 13:59:21.062391  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.020162  7674 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:21.069635  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.064472  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:20.929533  9714 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260501 13:59:21.044472  9735 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:21.051148  9695 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:21.068632  7678 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:21.082553  7675 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:20.939896  9757 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260501 13:59:21.052678  9764 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:21.018043  9697 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260501 13:59:21.077679  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.078753  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.089663  9095 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:21.090121  9095 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:21.044067  7822 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:21.090452  9095 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:21.062547  9696 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.084312  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.050755  9715 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260501 13:59:21.084748  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.101603  7820 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:21.092840  7671 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:21.086906  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.087674  7754 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:21.105805  7675 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:21.084251  9125 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:21.088217  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:21.096350  7825 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:21.096946  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:21.098284  9793 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260501 13:59:21.081156  9699 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:21.118779  7750 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:21.118773  7718 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.877s (SENT)
I20260501 13:59:21.119463  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.123977  7745 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:21.124737  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.126024  7752 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:21.085282  9735 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.122562  9699 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:21.145726  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 57595.4us
I20260501 13:59:21.149320  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:21.150339  7643 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:21.151203  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:21.154177  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.140302  9714 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:21.156316  9714 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:21.156777  9714 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:21.140398  9782 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.377s	user 0.005s	sys 0.000s
I20260501 13:59:21.113622  9722 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.125057  9796 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:21.139791  7674 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:21.176354  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.180104  7745 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:21.155439  9699 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:21.122400  9760 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260501 13:59:21.122401  9125 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.186918  9095 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:21.178920  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 84751.7us
I20260501 13:59:21.189924  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.190891  9095 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.193089  7751 raft_consensus.cc:2368] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:21.192878  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.192252  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.187733  9745 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.175726  9697 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:21.186542  9799 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:21.198307  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.198313  9095 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:21.199992  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:21.204706  7752 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:21.205713  9095 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:21.206061  9095 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:21.207113  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.208302  9750 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:21.208601  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:21.209244  7826 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 1 FOLLOWER]: Advancing to term 3
I20260501 13:59:21.188217  9715 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:21.212038  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.213281  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.214039  9722 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:21.214231  9717 consensus_meta.cc:287] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260501 13:59:21.214668  9717 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.216001  7749 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:21.217626  9658 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:21.218545  7671 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:21.219864  9735 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.220665  7754 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:21.222929  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:21.223610  7821 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:21.224040  7821 raft_consensus.cc:614] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:21.159418  9708 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.203987  9802 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:21.228160  9708 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.238009  7752 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:21.243409  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.239518  7825 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:21.210382  9125 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:21.247555  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.002s (SENT)
I20260501 13:59:21.251972  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:21.252123  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:21.248457  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.197032  9757 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:21.249696  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:21.262324  7825 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:21.252750  7747 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:21.268420  7745 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260501 13:59:21.268783  9795 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260501 13:59:21.229763  9697 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.268939  9708 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:21.288053  7718 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.060s (SENT)
W20260501 13:59:21.284713  9805 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260501 13:59:21.250599  9737 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:21.281819  9657 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260501 13:59:21.290015  9801 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:21.306898  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:21.308032  9756 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.308147  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.308866  7823 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:21.309661  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:21.309795  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.310563  7823 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:21.310801  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:21.311401  7822 raft_consensus.cc:606] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:21.312216  7673 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:21.322769  7679 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260501 13:59:21.323195  7679 pending_rounds.cc:85] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 1
I20260501 13:59:21.323432  7679 pending_rounds.cc:107] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260501 13:59:21.323704  7679 raft_consensus.cc:2889] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:21.322772  7827 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:21.324985  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.334131  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:21.343652  7826 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:21.342725  9095 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:21.348716  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 176316us
I20260501 13:59:21.349577  7819 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:21.340380  9697 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.347981  7825 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:21.353585  9095 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.349757  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:21.311755  7822 raft_consensus.cc:614] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:21.355913  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.358261  9745 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:21.358796  9745 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:21.359939  9764 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:21.359763  9745 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.363575  7826 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260501 13:59:21.364655  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.365309  7828 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:21.343094  9802 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:21.373232  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.352164  9695 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.379904  9801 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:21.384492  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.368379  9737 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:21.401935  7750 raft_consensus.cc:1217] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260501 13:59:21.406612  9800 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:21.411021  9800 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:21.411454  9800 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:21.411638  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:21.415092  8344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.022s	sys 0.021s
W20260501 13:59:21.415624  8344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.022s	sys 0.021s
I20260501 13:59:21.410459  7750 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260501 13:59:21.415985  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 766947us
W20260501 13:59:21.403265  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 160334us
I20260501 13:59:21.429390  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:21.430387  7746 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:21.431795  7753 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:21.402500  9722 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
W20260501 13:59:21.442795  7676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 199) took 2193 ms (client timeout 1884 ms). Trace:
I20260501 13:59:21.440600  9534 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:21.448295  9534 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.450886  9534 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
W20260501 13:59:21.451320  9817 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260501 13:59:21.448309  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.454890  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:21.406783  9717 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:21.445660  7676 rpcz_store.cc:269] 0501 13:59:19.243246 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:19.245365 (+  2119us) service_pool.cc:224] Handling call
0501 13:59:20.401781 (+1156416us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:21.436320 (+1034539us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54000389d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:21.436504 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173898496}
I20260501 13:59:21.457896  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.491755  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:21.490825  7792 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.507s (SENT)
W20260501 13:59:21.504647  7792 leader_election.cc:336] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.512s (SENT)
I20260501 13:59:21.517740  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:21.517910  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.518550  7746 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:21.520735  7679 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260501 13:59:21.455659  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.630595  7678 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:21.455087  9803 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:21.574146  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:21.645884  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.539316  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.547159  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:21.526185  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68243.9us
I20260501 13:59:21.523452  7677 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:21.661149  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:21.628326  9816 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260501 13:59:21.662818  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:21.663069  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 158464us
W20260501 13:59:21.590585  9810 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260501 13:59:21.520766  7674 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260501 13:59:21.663740  8376 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:21.664074  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:21.580651  9813 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260501 13:59:21.525465  9715 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:21.517588  9722 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:21.670404  8380 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:21.661485  7754 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:21.676714  7746 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:21.628263  9695 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.686080  9095 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:21.571246  9694 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260501 13:59:21.668887  7674 pending_rounds.cc:85] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 1
I20260501 13:59:21.640908  9714 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.651782  9803 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:21.522863  9764 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
I20260501 13:59:21.683434  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.686834  9095 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:21.686990  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.687168  8380 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260501 13:59:21.708014  9095 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:21.708953  9803 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.710211  9803 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:21.543455  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.679148  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.691262  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.589447  9699 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.679478  9715 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:21.706285  7676 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:21.709137  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.689476  7792 leader_election.cc:400] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:21.716336  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.719559  7792 leader_election.cc:403] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:21.719853  7673 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:21.717087  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:21.720276  9095 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.720927  7820 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:21.721098  7792 leader_election.cc:336] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.674s (SENT)
I20260501 13:59:21.717254  7754 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:21.669577  9744 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260501 13:59:21.721834  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:21.722792  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.723100  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.724109  9722 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.728140  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:21.728770  9699 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.730996  9715 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:21.731698  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.732820  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:21.733479  7673 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:21.733613  9714 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:21.700730  7674 pending_rounds.cc:107] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260501 13:59:21.734167  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.734309  7674 raft_consensus.cc:2889] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:21.735594  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.736115  7672 raft_consensus.cc:2368] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5.
I20260501 13:59:21.736209  7674 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:21.737303  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.759793  7820 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:21.547554  9802 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:21.576576  9801 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:21.870327  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.880252  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.872291  8381 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260501 13:59:21.881650  7676 raft_consensus.cc:2410] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260501 13:59:21.859977  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 138903us
W20260501 13:59:21.882908  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.687s (SENT)
W20260501 13:59:21.884030  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.701s (SENT)
I20260501 13:59:21.884532  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:21.880393  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.880257  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:21.840556  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.888635  7673 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
W20260501 13:59:21.900769  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.894208  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:21.795773  9095 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:21.891355  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.738297  9796 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:21.925611  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:21.926792  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.739002  9820 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:21.858958  9814 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:21.927475  7673 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:21.872177  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:21.928579  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.969666  9095 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:21.821305  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:21.869825  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.859522  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:21.955222  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:21.961658  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.979882  7673 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:21.985554  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.968319  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.890777  9731 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:21.795011  9422 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:21.970387  9095 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:21.970840  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:21.977226  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:21.979337  7754 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:21.986469  7673 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:21.997463  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:21.997864  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:21.998128  7746 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:21.929317  9736 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:21.998441  7673 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:21.973522  9757 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.002s
I20260501 13:59:22.012429  9095 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.015128  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.015851  7670 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:22.028757  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:21.993566  7822 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:21.931761  9796 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:22.036178  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 81097.9us
I20260501 13:59:22.041837  7746 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:22.046106  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:22.049841  7673 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:22.017999  9757 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:22.049124  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:22.061820  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.063202  7754 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:22.020409  9736 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:22.064837  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:22.067356  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.068297  7676 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:22.069648  9820 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:22.070602  9736 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.074978  9699 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
W20260501 13:59:22.048456  9826 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260501 13:59:21.887127  9800 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:22.071410  9825 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260501 13:59:22.008672  9422 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:22.151996  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.153678  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1130) took 1259 ms. Trace:
I20260501 13:59:22.154188  7678 rpcz_store.cc:276] 0501 13:59:20.894234 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:21.518196 (+623962us) service_pool.cc:224] Handling call
0501 13:59:21.597753 (+ 79557us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:21.645390 (+ 47637us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:22.153379 (+507989us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b540042e0d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:22.153590 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109531904}
I20260501 13:59:22.156592  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:22.197543  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.259421  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:22.261049  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.263545  9757 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:22.264997  7718 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.545s (SENT)
I20260501 13:59:22.274363  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:22.276404  7673 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:22.278436  7673 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:22.278914  7673 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:22.264638  9696 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:22.286559  7673 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.282553  9744 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:22.289273  9820 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:22.310335  7673 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:22.273753  9757 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.300576  9691 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:22.297031  9696 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.325047  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.311203  9699 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:22.328586  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.336544  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.337051  7674 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:22.318446  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.324530  9691 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.333810  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.334537  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.336236  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.357969  7673 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260501 13:59:22.359009  7673 pending_rounds.cc:85] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 4
I20260501 13:59:22.359375  7673 pending_rounds.cc:107] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:22.359833  7673 raft_consensus.cc:2889] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:22.360327  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 81376.7us
I20260501 13:59:22.362510  7746 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:22.357262  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:22.325286  9800 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:22.376649  7825 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 13:59:22.378419  7825 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:22.330986  9422 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:22.383870  7750 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:22.321821  9820 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.375840  9757 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:22.411849  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.384323  9814 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:22.414072  9800 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:22.435921  9095 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:22.415904  7746 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260501 13:59:22.436523  7746 pending_rounds.cc:85] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 5
I20260501 13:59:22.436837  7746 pending_rounds.cc:107] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260501 13:59:22.436595  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:22.437063  7746 raft_consensus.cc:2889] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:22.437320  7819 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:22.393132  9696 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:22.390157  9839 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:22.441140  9095 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.459046  7826 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260501 13:59:22.460007  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 89073.5us
I20260501 13:59:22.463770  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:22.468480  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:22.441852  9814 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.403688  9699 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.442678  9800 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.446066  9838 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260501 13:59:22.474646  7753 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260501 13:59:22.487574  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.490604  9800 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:22.474676  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 53401.5us
I20260501 13:59:22.493094  7822 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:22.459794  9802 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260501 13:59:22.508983  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:22.510447  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.493427  9814 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:22.515308  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:22.515657  7792 leader_election.cc:336] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.561s (SENT)
I20260501 13:59:22.516165  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:22.518848  7828 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:22.520311  9814 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260501 13:59:22.524521  7672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1103) took 1638 ms (client timeout 1877 ms). Trace:
W20260501 13:59:22.475613  9834 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
W20260501 13:59:22.525902  7672 rpcz_store.cc:269] 0501 13:59:20.886302 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:20.899888 (+ 13586us) service_pool.cc:224] Handling call
0501 13:59:21.306709 (+406821us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:22.524303 (+1217594us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540019c154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:22.524458 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990296192}
W20260501 13:59:22.525373  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.447619  9839 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.463528  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:22.538842  9796 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:22.543268  9803 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.833s	user 0.008s	sys 0.004s
I20260501 13:59:22.544327  7670 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:22.549244  7825 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:22.525317  9691 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:22.551208  9715 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.820s	user 0.014s	sys 0.000s
I20260501 13:59:22.477617  9744 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260501 13:59:22.477422  9760 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260501 13:59:22.563282  9839 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:22.564085  9839 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:22.574077  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68460.5us
W20260501 13:59:22.582492  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.583353  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:22.559464  9715 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.598767  7819 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:22.573503  9839 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.584851  9803 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:22.605571  9125 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:22.606854  7792 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.885s (SENT)
I20260501 13:59:22.608062  9125 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:22.608557  9125 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:22.607837  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.609186  7671 raft_consensus.cc:2376] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6. Re-sending same reply.
I20260501 13:59:22.612829  9803 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.614897  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:22.621610  8374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:35982
I20260501 13:59:22.624462  8374 raft_consensus.cc:606] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:22.620409  7625 auto_rebalancer.cc:786] Removing replace marker failed: Couldn't find leader for tablet a769b271cb04497eb1cb86169399ceb2
W20260501 13:59:22.626235  7625 auto_rebalancer.cc:814] Could not move replica: Not found: Couldn't find leader for tablet a769b271cb04497eb1cb86169399ceb2
W20260501 13:59:22.626633  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet a769b271cb04497eb1cb86169399ceb2
I20260501 13:59:22.627727  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.628734  7678 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:22.620703  9744 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:22.632258  9803 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:22.632687  9744 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:22.633630  9744 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.634829  7754 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260501 13:59:22.617091  9836 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.299s	user 0.004s	sys 0.000s
I20260501 13:59:22.640426  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:22.663045  9699 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:22.664947  9839 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:22.663582  9854 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 13:59:22.666798  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.668404  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:22.672653  7718 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.897s (SENT)
I20260501 13:59:22.677475  7825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b540df5a794f06ab617858163d4297"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:22.678197  7825 raft_consensus.cc:606] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:22.678653  7825 raft_consensus.cc:614] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:22.666152  9811 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.614s	user 0.002s	sys 0.002s
I20260501 13:59:22.703752  9125 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:22.709589  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 88573.2us
W20260501 13:59:22.712909  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.718142  9125 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:22.718883  9095 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:22.720482  8377 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260501 13:59:22.721484  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.723951  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:22.757172  9422 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:22.758526  9422 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:22.758908  9422 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:22.755156  9863 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260501 13:59:22.759786  9863 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:22.760170  9863 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:22.761037  9829 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.650s	user 0.011s	sys 0.023s
W20260501 13:59:22.762575  9860 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260501 13:59:22.764732  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:22.765573  7753 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:22.766121  7750 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:22.751526  9715 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:22.779688  7754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60254
I20260501 13:59:22.784291  7754 raft_consensus.cc:606] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Received request to transfer leadership
I20260501 13:59:22.761122  9863 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.791939  9715 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:22.794935  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:22.795974  7746 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260501 13:59:22.796319  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:22.727939  9844 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260501 13:59:22.801477  7576 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:22.826929  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.826952  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.807986  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:22.837174  7718 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.518s (SENT)
I20260501 13:59:22.838119  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:22.840018  7718 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.541s (SENT)
I20260501 13:59:22.840457  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:22.842708  7678 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:22.850108  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:22.852320  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 104697us
I20260501 13:59:22.802314  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1169) took 1655 ms. Trace:
W20260501 13:59:22.854125  7792 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.201s (SENT)
I20260501 13:59:22.857542  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:22.858991  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:22.859445  7819 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:22.859745  7670 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:22.781339  9699 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260501 13:59:22.842370  9694 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:22.847422  9863 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:22.875329  9844 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:22.857440  9839 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260501 13:59:22.850400  9691 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:22.807206  9715 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.777097  9422 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:22.884946  9715 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:22.856858  7821 rpcz_store.cc:276] 0501 13:59:21.142448 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:21.224670 (+ 82222us) service_pool.cc:224] Handling call
0501 13:59:21.225048 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:21.225464 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:21.225502 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:21.226060 (+   558us) log.cc:844] Serialized 26 byte log entry
0501 13:59:21.251707 (+ 25647us) raft_consensus.cc:1645] Marking committed up to 1
0501 13:59:21.263231 (+ 11524us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:21.269488 (+  6257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:21.379632 (+110144us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b180035fe60. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2fe5c33ef 00007fb2f7643bb1 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d
0501 13:59:22.009475 (+629843us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180035fe60. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:22.665530 (+656055us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:22.774409 (+108879us) raft_consensus.cc:1685] finished
0501 13:59:22.774437 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:22.797474 (+ 23037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11500,"raft.queue_time_us":53300,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7190,"spinlock_wait_cycles":64969984,"thread_start_us":20459,"threads_started":1,"wal-append.queue_time_us":59933}
I20260501 13:59:22.889751  9125 raft_consensus.cc:993] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower ca8dd10afb304b4c96cfcec7e2309947 to start an election
I20260501 13:59:22.890278  9125 raft_consensus.cc:1081] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Signalling peer ca8dd10afb304b4c96cfcec7e2309947 to start an election
I20260501 13:59:22.895529  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.897253  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.897970  7677 raft_consensus.cc:2376] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4. Re-sending same reply.
I20260501 13:59:22.902750  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.903528  7670 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:22.905470  8377 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:22.905826  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.906551  7678 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:22.909211  7748 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:22.914372  9715 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:22.914995  9715 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:22.915970  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:22.916621  7677 raft_consensus.cc:2376] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4. Re-sending same reply.
I20260501 13:59:22.917476  9715 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:22.925379  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.926151  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:22.927156  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:22.928591  7753 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260501 13:59:22.882313  7718 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.950s (SENT)
W20260501 13:59:22.936810  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54524.7us
W20260501 13:59:22.939913  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:22.944770  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 70073.8us
I20260501 13:59:22.946717  9862 raft_consensus.cc:993] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:22.947172  9862 raft_consensus.cc:1081] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:22.950862  7746 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:22.948767  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:22.955924  7576 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 2, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 2 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:22.960459  9095 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:22.961944  9095 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:22.964030  7819 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:22.965603  7827 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:22.965582  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:22.968603  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:22.969436  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:22.969658  7751 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 13:59:22.970081  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.972039  7826 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:22.968588  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:22.977034  7746 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:22.979632  9095 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:22.980031  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.981029  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:22.958761  7576 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132), now has a pending config: VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:22.985639  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:22.988703  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:22.989164  7821 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:22.972030  9699 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:22.990610  9699 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:22.991127  9699 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:22.992046  7822 raft_consensus.cc:1217] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
I20260501 13:59:22.992698  7822 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260501 13:59:22.967298  9715 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:23.003482  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:22.999850  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60254
W20260501 13:59:22.996414  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.035176  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.039356  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.035991  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:23.040580  9694 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:23.042258  9694 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 13:59:23.044251  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:23.046672  9717 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:23.048216  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:23.048453  9841 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:23.044270  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:23.050827  7746 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:22.981669  9801 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260501 13:59:23.052906  7745 raft_consensus.cc:606] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Received request to transfer leadership
W20260501 13:59:23.054622  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51223.4us
W20260501 13:59:23.131862  9866 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260501 13:59:23.130615  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:23.167493  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:22.983083  9422 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:23.006616  9803 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:23.035063  9796 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:22.976245  9718 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.155s
I20260501 13:59:22.956830  9842 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260501 13:59:23.127784  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:23.011261  7826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:50954
I20260501 13:59:23.183604  7826 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:23.165966  7745 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:22.972100  9844 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.157s
I20260501 13:59:23.185418  7826 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:23.193161  7746 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260501 13:59:23.194718  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.584s (SENT)
I20260501 13:59:23.200110  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.126760  9715 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:23.204821  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.626s (SENT)
W20260501 13:59:23.205955  7718 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.685s (SENT)
W20260501 13:59:23.207717  7718 leader_election.cc:336] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.027s (SENT)
I20260501 13:59:23.208316  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:23.213503  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 243015us
W20260501 13:59:23.214250  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:23.214947  7718 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.725s (SENT)
I20260501 13:59:23.215514  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.167233  9731 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260501 13:59:23.235462  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 196228us
I20260501 13:59:23.236402  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.180070  9745 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260501 13:59:23.179423  9744 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260501 13:59:23.188017  9803 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.193778  9796 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:23.207543  9814 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260501 13:59:23.292609  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 56278.6us
I20260501 13:59:23.298113  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.307577  7822 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
W20260501 13:59:23.314450  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 87777.8us
I20260501 13:59:23.315352  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:23.318275  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.324275  7819 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:23.313489  9878 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:23.321223  7826 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.331341  9715 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:23.332073  9715 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.332784  9715 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.318125  9877 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:23.340075  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.341967  7826 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:23.345048  7820 raft_consensus.cc:1217] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
I20260501 13:59:23.345567  7820 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260501 13:59:23.341368  7819 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260501 13:59:23.346047  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:23.352629  9803 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:23.355172  9125 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:23.355507  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:23.363458  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 148544us
I20260501 13:59:23.364159  9699 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.351547  9796 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:23.364205  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.975s (SENT) [suppressed 82 similar messages]
I20260501 13:59:23.377873  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.378379  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:23.336206  9882 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:23.342471  9715 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:23.382740  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:23.380192  7718 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.207s (SENT)
I20260501 13:59:23.339998  9880 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:23.356956  9878 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:23.391184  7820 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:23.391093  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.392153  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:23.364866  9876 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260501 13:59:23.401466  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.406723  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.407871  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:23.408632  7746 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
W20260501 13:59:23.408620  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.824s (SENT)
I20260501 13:59:23.409219  7746 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:23.409585  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:23.409919  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.871s (SENT)
I20260501 13:59:23.410384  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.410521  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:23.408806  7562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 147196us
I20260501 13:59:23.410043  7746 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.348620  9877 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.415071  7746 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:23.407789  9863 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.535s	user 0.000s	sys 0.012s
I20260501 13:59:23.415895  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:23.380712  9881 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260501 13:59:23.418007  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60254
I20260501 13:59:23.403908  9718 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.394446  9715 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:23.424639  9715 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:23.413733  9878 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:23.425298  9715 raft_consensus.cc:2764] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260501 13:59:23.425400  9878 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:23.416287  9803 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:23.425956  9878 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:23.417536  9843 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.412434  9796 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:23.413606  9884 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:23.445739  9891 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:23.447078  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.481415  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:23.411734  9888 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:23.391964  9882 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.485327  7746 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:23.483737  7576 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 5, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:23.487406  7752 raft_consensus.cc:606] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Received request to transfer leadership
I20260501 13:59:23.487895  7752 raft_consensus.cc:614] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:23.485791  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 264) took 5886 ms. Trace:
W20260501 13:59:23.507889  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.447124  9846 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:23.477890  9699 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:23.515806  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 99993.9us
I20260501 13:59:23.517158  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.490069  7573 rpcz_store.cc:276] 0501 13:59:17.599693 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:17.600011 (+   318us) service_pool.cc:224] Handling call
0501 13:59:23.485697 (+5885686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:20.999291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:21.116794 (+117503us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:21.119041 (+  2247us) write_op.cc:435] Acquired schema lock
0501 13:59:21.121113 (+  2072us) tablet.cc:662] Decoding operations
0501 13:59:21.280223 (+159110us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:21.280301 (+    78us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:21.280349 (+    48us) tablet.cc:685] Acquiring locks for 12 operations
0501 13:59:21.299419 (+ 19070us) tablet.cc:701] Row locks acquired
0501 13:59:21.299450 (+    31us) write_op.cc:260] PREPARE: finished
0501 13:59:21.299661 (+   211us) write_op.cc:270] Start()
0501 13:59:21.299843 (+   182us) write_op.cc:276] Timestamp: P: 1777643961299597 usec, L: 0
0501 13:59:21.299874 (+    31us) op_driver.cc:348] REPLICATION: starting
0501 13:59:21.305071 (+  5197us) log.cc:844] Serialized 4845 byte log entry
0501 13:59:22.076612 (+771541us) op_driver.cc:464] REPLICATION: finished
0501 13:59:22.298955 (+222343us) write_op.cc:301] APPLY: starting
0501 13:59:22.302878 (+  3923us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:22.321775 (+ 18897us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:22.328248 (+  6473us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:22.478032 (+149784us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:22.549117 (+ 71085us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0501 13:59:22.549168 (+    51us) write_op.cc:312] APPLY: finished
0501 13:59:22.549535 (+   367us) log.cc:844] Serialized 89 byte log entry
0501 13:59:22.549720 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:22.549870 (+   150us) write_op.cc:454] Released schema lock
0501 13:59:22.549929 (+    59us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:22.550335 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:22.550369 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8306,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":208927,"apply.run_cpu_time_us":5979,"apply.run_wall_time_us":258230,"num_ops":12,"prepare.queue_time_us":174347,"prepare.run_cpu_time_us":22573,"prepare.run_wall_time_us":403104,"raft.queue_time_us":368752,"raft.run_cpu_time_us":17485,"raft.run_wall_time_us":184292,"replication_time_us":776505,"thread_start_us":489056,"threads_started":4,"wal-append.queue_time_us":67943}]]}
W20260501 13:59:23.524901  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 204363us
I20260501 13:59:23.526870  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:23.522337  9888 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.528478  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:23.540616  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:23.540892  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.532950  9803 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.541935  9888 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:23.524109  9884 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260501 13:59:23.542384  9888 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:23.542619  9893 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:23.542834  9888 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:23.543452  9893 consensus_queue.cc:1243] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 13:59:23.543989  9863 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:23.544026  9881 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:23.544504  9863 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:23.544893  9881 consensus_queue.cc:1243] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:23.532585  9715 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260501 13:59:23.545406  9881 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:23.545780  9881 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:23.545948  9715 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:23.546365  9715 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:23.546705  9864 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:23.546561  9881 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.547119  9864 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:23.532721  9890 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260501 13:59:23.550405  9877 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:23.545408  9863 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.552552  9863 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:23.553864  9888 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.542836  9884 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
W20260501 13:59:23.598279  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 188371us
W20260501 13:59:23.599089  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.921s (SENT)
W20260501 13:59:23.600095  7718 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.929s (SENT)
I20260501 13:59:23.600524  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:23.601658  7718 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.000s (SENT)
I20260501 13:59:23.602118  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:23.602835  8380 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:23.556803  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:23.572508  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 123366us
I20260501 13:59:23.547183  9715 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:23.616111  9864 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.617858  9864 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:23.592676  9878 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.558228  9881 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:23.555241  9877 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260501 13:59:23.623327  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 66618.3us
I20260501 13:59:23.605988  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.607352  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.609838  9882 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:23.614276  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.627071  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.628803  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:23.629343  9803 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:23.604838  9884 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:23.635264  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:23.641743  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.638864  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.639804  8380 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:23.604485  9891 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:23.654072  8373 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:23.654567  8373 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:23.656230  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:23.656898  8376 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:23.631845  9859 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:23.648487  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:23.661450  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.650225  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:23.667398  9708 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:23.668205  9708 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:23.669422  9708 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.677595  9796 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:23.678525  9796 consensus_queue.cc:1243] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260501 13:59:23.680487  9884 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:23.682026  9884 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:23.685496  9715 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:23.686537  9878 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:23.643345  9896 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 4, Time since last communication: 0.057s
I20260501 13:59:23.647964  9877 consensus_queue.cc:1243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260501 13:59:23.738819  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.224s (SENT)
W20260501 13:59:23.901858  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.657s (SENT)
I20260501 13:59:23.910801  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:23.800163  7820 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260501 13:59:23.904062  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.776062  9877 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
W20260501 13:59:23.907840  7718 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.572s (SENT)
I20260501 13:59:23.655479  8373 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.915227  9882 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:23.916105  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:23.922749  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:23.925091  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 286328us
I20260501 13:59:23.924822  9882 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:23.927961  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.928454  9882 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:23.929818  9882 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:23.930627  9888 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:24.366042  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:24.162395  9864 consensus_meta.cc:287] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260501 13:59:24.369949  9900 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:24.369042  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 461235us
W20260501 13:59:24.075728  7792 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.739s (SENT)
I20260501 13:59:24.381222  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:23.952883  9839 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:24.382450  9839 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:23.985824  8373 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:24.291991  9896 consensus_queue.cc:1243] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260501 13:59:24.167984  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.385682  9878 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:24.386083  9878 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:24.335150  9888 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:24.387212  7718 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.553s (SENT)
W20260501 13:59:24.103979  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.387873  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:24.388643  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.366012  8380 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260501 13:59:24.214385  9902 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
W20260501 13:59:24.389750  7718 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.645s (SENT)
I20260501 13:59:24.384024  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:24.066453  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:24.373733  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:24.392347  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:24.392628  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.936777  8376 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:24.371490  9891 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:24.393047  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:23.954469  9820 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:24.078217  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:24.357967  9715 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260501 13:59:24.367684  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:24.387094  9878 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:24.397018  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 321347us
I20260501 13:59:23.922816  9877 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:24.400987  9801 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.401224  9878 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:24.239853  9803 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.011s
I20260501 13:59:24.402349  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:24.394613  9900 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:24.366314  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:23.971544  9736 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:23.945111  8374 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 2 LEARNER]: Advancing to term 3
W20260501 13:59:24.411090  7792 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.747s (SENT)
W20260501 13:59:24.408488  8344 connection.cc:254] RPC call timeout handler was delayed by -1.7730020210000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260501 13:59:24.416060  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.578s (SENT)
I20260501 13:59:24.416819  7828 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:24.416702  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:24.417058  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.619s (SENT)
W20260501 13:59:24.418141  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.710s (SENT)
W20260501 13:59:24.418929  8344 connection.cc:254] RPC call timeout handler was delayed by -1.702802021000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260501 13:59:24.420042  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:24.402441  9881 consensus_meta.cc:287] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.012s
I20260501 13:59:24.422986  7753 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:24.422025  7828 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:24.428716  8377 raft_consensus.cc:2410] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:24.407326  9884 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:24.407756  9801 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:24.410247  9803 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:24.412935  9731 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:24.430311  7753 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:24.432906  9125 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:24.415175  9715 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.386943  9888 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:24.441018  7750 raft_consensus.cc:1217] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-3.5]   Dedup: 3.5->[]
W20260501 13:59:24.441237  9882 consensus_meta.cc:287] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.001s
I20260501 13:59:24.441511  7750 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: [1.4-3.5]
I20260501 13:59:24.399035  9891 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.409500  9796 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260501 13:59:24.444232  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:24.431005  9884 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:24.453891  7792 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.850s (SENT)
I20260501 13:59:24.444716  9907 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260501 13:59:24.410421  9896 consensus_queue.cc:765] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 3 is ahead of the local log (next sequential op: 3). Destination peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 4, Last known committed idx: 3, Time since last communication: 0.768s
I20260501 13:59:24.437579  9801 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:24.425199  8371 raft_consensus.cc:2376] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:24.466692  9801 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:24.428900  9900 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:24.437662  9877 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:24.467394  9900 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:24.468258  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2179) took 1075 ms. Trace:
I20260501 13:59:24.469604  9900 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:24.469827  9877 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:24.470932  9882 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.472321  8379 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260501 13:59:24.472671  8379 pending_rounds.cc:85] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 4
I20260501 13:59:24.472875  8379 pending_rounds.cc:107] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:24.473083  8379 raft_consensus.cc:2889] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:24.468752  7747 rpcz_store.cc:276] 0501 13:59:23.392870 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:23.393099 (+   229us) service_pool.cc:224] Handling call
0501 13:59:23.402401 (+  9302us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:23.402756 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 7
0501 13:59:23.439433 (+ 36677us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b180035ba20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fe0e4837 00007fb2fa6ebd87 00007fb2fa6fb49f 00007fb2fa6fb418
0501 13:59:23.519728 (+ 80295us) log.cc:844] Serialized 14 byte log entry
0501 13:59:23.608520 (+ 88792us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:23.639378 (+ 30858us) log.cc:844] Serialized 26 byte log entry
0501 13:59:23.639580 (+   202us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:23.639632 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:23.639767 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:24.458080 (+818313us) raft_consensus.cc:1685] finished
0501 13:59:24.467974 (+  9894us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:24.468176 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40586,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":21820,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":4189,"spinlock_wait_cycles":4800256,"thread_start_us":168411,"threads_started":2,"wal-append.queue_time_us":194283}
I20260501 13:59:24.448487  7819 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260501 13:59:24.428572  9905 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260501 13:59:24.477108  7750 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260501 13:59:24.455226  7625 auto_rebalancer.cc:814] Could not move replica: Illegal state: not currently leader
I20260501 13:59:24.431916  9820 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:24.478281  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Illegal state: not currently leader
I20260501 13:59:24.453625  9888 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:24.442163  9731 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.482237  9731 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:24.447636  8375 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:24.486385  9839 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:24.456852  9884 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:24.455969  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.459846  9846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50946 (request call id 1198) took 16874 ms. Trace:
I20260501 13:59:24.460331  9911 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260501 13:59:24.462656  9891 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:24.505985  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:24.506845  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52694.7us
I20260501 13:59:24.507108  7750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:42716
I20260501 13:59:24.509061  7750 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:24.509550  7750 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:24.425500  9736 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:24.509598  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.942s (SENT)
I20260501 13:59:24.512668  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.513563  9911 consensus_queue.cc:1243] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 91854d93e96c4756834efe8b2ef59fce log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:24.504679  9846 rpcz_store.cc:276] 0501 13:59:07.585872 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:07.586017 (+   145us) service_pool.cc:224] Handling call
0501 13:59:07.696146 (+110129us) log.cc:844] Serialized 494 byte log entry
0501 13:59:07.864500 (+168354us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b18003a3ae0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:07.954028 (+ 89528us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003a3ae0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:24.459689 (+16505661us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165,"raft.run_cpu_time_us":1538,"raft.run_wall_time_us":44363,"spinlock_wait_cycles":28306048,"thread_start_us":115913,"threads_started":1,"wal-append.queue_time_us":138972,"wal-append.run_cpu_time_us":1944,"wal-append.run_wall_time_us":1003665}
I20260501 13:59:24.521688  7822 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:24.526472  9736 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:24.551288  7718 leader_election.cc:336] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.605s (SENT)
I20260501 13:59:24.554513  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:24.550797  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.945s (SENT)
W20260501 13:59:24.555918  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.694s (SENT)
I20260501 13:59:24.556226  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:24.557193  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:24.559929  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.984s (SENT)
I20260501 13:59:24.560539  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.506697  9839 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:24.568249  7718 leader_election.cc:336] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.857s (SENT)
I20260501 13:59:24.582180  8373 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260501 13:59:24.582810  8373 pending_rounds.cc:85] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 4
I20260501 13:59:24.583125  8373 pending_rounds.cc:107] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:24.583456  8373 raft_consensus.cc:2889] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:24.590971  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.819s (SENT)
W20260501 13:59:24.592648  7718 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.103s (SENT)
W20260501 13:59:24.598965  7718 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.167s (SENT)
I20260501 13:59:24.599428  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:24.592782  7792 leader_election.cc:336] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.860s (SENT)
I20260501 13:59:24.601336  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:24.604650  7792 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.893s (SENT)
I20260501 13:59:24.606683  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.564057  9906 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:24.641513  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.597s (SENT)
I20260501 13:59:24.642024  9820 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:24.566064  9914 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.644794  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:24.647218  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 230561us
W20260501 13:59:24.650236  7792 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.718s (SENT)
W20260501 13:59:24.650965  7792 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.718s (SENT)
I20260501 13:59:24.651351  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.637403  7750 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.613236  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 367eab87da314007b62b7bd0a0905d38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260501 13:59:24.653873  7562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 74889.9us
I20260501 13:59:24.566455  9891 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260501 13:59:24.655335  9915 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260501 13:59:24.643219  9731 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.642961  9911 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:24.656260  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:24.656992  7752 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:24.656697  9911 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.659200  9911 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:24.659776  9820 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.662519  9820 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:24.663242  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:24.664388  9801 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:24.668174  9912 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.579588  9715 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:24.670116  9715 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:24.670353  9760 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.671214  9715 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.672907  9715 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:24.638258  9708 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:24.620046  9839 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:24.637065  9736 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.683138  7820 raft_consensus.cc:1217] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260501 13:59:24.683658  7820 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:24.687808  7750 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:24.689580  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.745s (SENT)
I20260501 13:59:24.690176  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:24.693380  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 3.108s (SENT)
I20260501 13:59:24.696271  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:24.697044  7822 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:24.694419  7792 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.884s (SENT)
I20260501 13:59:24.697805  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.652863  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:24.710785  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 57996.5us
I20260501 13:59:24.711809  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:24.713474  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:24.699483  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 279953us
W20260501 13:59:24.701509  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 3.178s (SENT)
W20260501 13:59:24.712062  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.957s (SENT)
W20260501 13:59:24.718318  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.718225  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:24.721172  7792 leader_election.cc:336] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.005s (SENT)
I20260501 13:59:24.721792  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.696314  9914 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:24.726257  7792 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.207s (SENT)
I20260501 13:59:24.728006  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:24.729987  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.730268  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:24.731153  7678 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:24.729651  7679 raft_consensus.cc:2376] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3. Re-sending same reply.
W20260501 13:59:24.734311  7792 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 2.245s (SENT)
W20260501 13:59:24.735036  7792 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.245s (SENT)
I20260501 13:59:24.735451  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.743182  7822 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:24.745154  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:24.694725  9884 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.757040  7679 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:24.716854  9877 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.750339  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.713903  9731 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.755779  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.750067  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:24.762914  7675 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260501 13:59:24.763499  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.719226  9911 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:24.764802  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.754601  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:24.843451  7792 leader_election.cc:336] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.039s (SENT)
I20260501 13:59:24.727284  9796 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:24.889827  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:24.915122  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 71724.4us
W20260501 13:59:24.916509  7792 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.059s (SENT)
I20260501 13:59:24.917032  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:24.840135  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:24.872009  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.768000  7672 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:24.752051  9736 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:24.856684  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:24.891538  7675 pending_rounds.cc:85] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 3
W20260501 13:59:24.894491  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.773765  9914 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.924769  9699 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.774024  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:24.923851  7675 pending_rounds.cc:107] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260501 13:59:24.930444  7675 raft_consensus.cc:2889] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:24.927635  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.932793  7677 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:24.895515  7676 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:24.927937  7679 raft_consensus.cc:2410] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260501 13:59:24.929173  7718 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.083s (SENT)
I20260501 13:59:24.934314  7678 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:24.936034  7673 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
W20260501 13:59:24.936890  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:24.801353  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.732219  9912 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:24.727573  9820 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.939251  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:24.773550  8374 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:24.911955  9911 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:24.967098  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.984649  7670 raft_consensus.cc:2410] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260501 13:59:24.964422  7674 raft_consensus.cc:2376] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4. Re-sending same reply.
I20260501 13:59:24.970871  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:24.777232  9884 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:24.831498  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.758759  9891 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:24.985872  7677 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260501 13:59:25.007964  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:25.017968  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:25.018765  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:24.870625  9803 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:24.928857  8373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3031b746c62f413a9da6fed211d638da"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 13:59:24.929807  9881 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:24.734963  9919 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.855034  9882 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:24.922513  9731 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:24.995961  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51744 (request call id 762) took 1218 ms. Trace:
I20260501 13:59:25.028626  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.057408  7670 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:25.037549  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.037835  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.040076  7672 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:25.036130  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.061244  7679 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.062093  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.062659  7679 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:25.036762  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.061254  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.063838  7673 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:25.064446  7672 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:25.065585  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.066504  7672 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:25.067467  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.044955  8374 rpcz_store.cc:276] 0501 13:59:23.768774 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:23.915730 (+146956us) service_pool.cc:224] Handling call
0501 13:59:24.986964 (+1071234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:25.068208  7672 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
W20260501 13:59:25.054307  9916 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260501 13:59:25.072175  7672 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260501 13:59:25.072299  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.073091  7672 pending_rounds.cc:85] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 3
I20260501 13:59:25.073487  7672 pending_rounds.cc:107] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260501 13:59:25.073861  7672 raft_consensus.cc:2889] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:25.074153  7673 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:25.029124  8373 raft_consensus.cc:606] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.022531  9864 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.077659  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.081112  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.055809  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.082180  7678 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:25.090065  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:25.032951  9924 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260501 13:59:25.032416  9917 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260501 13:59:25.090986  7677 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:25.021337  9803 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:25.026714  9891 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:25.103018  7675 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.115545  7677 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260501 13:59:25.056322  9919 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:25.027485  9882 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:25.035106  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:25.130095  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.139s (SENT)
I20260501 13:59:25.141949  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.145911  7677 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:25.077728  9881 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:25.149714  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.223s (SENT)
I20260501 13:59:25.157181  7672 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:25.160794  7679 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:25.115540  9801 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:25.192039  7677 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:25.195569  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:25.196573  7752 raft_consensus.cc:606] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.197007  7752 raft_consensus.cc:614] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:25.095911  9864 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.204957  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.206598  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.207279  8380 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.208750  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.217294  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.220435  8380 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.221596  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.221871  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.222471  8381 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:25.177109  9877 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:25.225845  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.226783  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.228428  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.229707  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.235958  8376 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:25.236263  8376 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:25.236279  7745 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:25.229743  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.230115  9941 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:25.231801  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:25.234030  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.230587  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.245040  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:25.258157  9930 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260501 13:59:25.258872  9925 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260501 13:59:25.231194  9760 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.264313  7747 raft_consensus.cc:606] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.264336  8376 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.211833  9796 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:25.264458  7752 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:25.239285  9731 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260501 13:59:25.135327  9919 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.277536  7676 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:25.278795  9699 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:25.280326  9820 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:25.235484  8373 raft_consensus.cc:2376] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3. Re-sending same reply.
W20260501 13:59:25.284798  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46084.4us
I20260501 13:59:25.287647  7672 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:25.287791  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.288187  9814 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:25.294252  8381 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
W20260501 13:59:25.305459  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 115655us
I20260501 13:59:25.282218  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:25.332399  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.212260  9803 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.298664  9914 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.336216  8381 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:25.345093  7670 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:25.345484  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.291050  9859 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:25.346119  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.216109  9882 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.352214  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.358172  9125 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:25.358523  8376 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:25.286705  9941 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.264864  9877 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.326718  9922 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.333159  9911 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:25.369832  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:25.371744  7747 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.284368  9891 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.301267  9760 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.355500  8381 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.377754  8381 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:25.357913  9708 raft_consensus.cc:2764] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260501 13:59:25.312321  9796 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.364647  9803 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:25.348656  7674 raft_consensus.cc:2376] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5. Re-sending same reply.
W20260501 13:59:25.389700  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:25.389930  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.398452  8376 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.420697  9881 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.422127  9877 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:25.425554  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:25.426338  7750 raft_consensus.cc:606] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.359185  9914 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.438584  9914 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:25.358850  9859 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.441919  9859 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:25.371327  9922 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.444355  9922 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.409215  9882 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:25.426297  9927 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260501 13:59:25.447566  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:25.448506  7753 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260501 13:59:25.448750  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.020s (SENT)
W20260501 13:59:25.449712  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:25.450139  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.458081  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:25.461642  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:25.462464  7679 raft_consensus.cc:2376] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6. Re-sending same reply.
I20260501 13:59:25.464000  9125 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:25.478638  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.479802  7679 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:25.483278  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:25.465034  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.490666  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.496292  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:25.497566  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:25.495966  9125 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:25.495975  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 138410us
W20260501 13:59:25.505158  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.474364  9864 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.487886  9884 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:25.520994  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.526763  9796 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.519279  9922 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.539757  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.525251  9877 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:25.548205  9760 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.548935  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 174) took 5092 ms. Trace:
I20260501 13:59:25.549140  9941 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.550915  7573 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 7, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:25.552932  7573 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:25.554628  7573 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 4 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:25.558145  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.559772  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:25.544826  9715 consensus_meta.cc:287] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.871s	user 0.014s	sys 0.001s
W20260501 13:59:25.561661  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.561009  7573 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:25.563050  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 47101.7us
W20260501 13:59:25.553083  9939 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260501 13:59:25.568969  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 88586.6us
I20260501 13:59:25.549357  7576 rpcz_store.cc:276] 0501 13:59:20.456649 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:20.456853 (+   204us) service_pool.cc:224] Handling call
0501 13:59:25.548857 (+5092004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:23.944564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:24.141923 (+197359us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:24.141968 (+    45us) write_op.cc:435] Acquired schema lock
0501 13:59:24.141992 (+    24us) tablet.cc:662] Decoding operations
0501 13:59:24.185722 (+ 43730us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:24.185809 (+    87us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:24.185849 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0501 13:59:24.186578 (+   729us) tablet.cc:701] Row locks acquired
0501 13:59:24.186603 (+    25us) write_op.cc:260] PREPARE: finished
0501 13:59:24.186811 (+   208us) write_op.cc:270] Start()
0501 13:59:24.186974 (+   163us) write_op.cc:276] Timestamp: P: 1777643964186740 usec, L: 0
0501 13:59:24.187001 (+    27us) op_driver.cc:348] REPLICATION: starting
0501 13:59:24.191314 (+  4313us) log.cc:844] Serialized 2301 byte log entry
0501 13:59:24.925784 (+734470us) op_driver.cc:464] REPLICATION: finished
0501 13:59:25.127231 (+201447us) write_op.cc:301] APPLY: starting
0501 13:59:25.131380 (+  4149us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:25.202354 (+ 70974us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:25.215847 (+ 13493us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:25.357886 (+142039us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:25.378554 (+ 20668us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0501 13:59:25.403547 (+ 24993us) write_op.cc:312] APPLY: finished
0501 13:59:25.421447 (+ 17900us) log.cc:844] Serialized 47 byte log entry
0501 13:59:25.421632 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:25.421750 (+   118us) write_op.cc:454] Released schema lock
0501 13:59:25.421796 (+    46us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:25.422156 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:25.422184 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":643843,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":180682,"apply.run_cpu_time_us":3903,"apply.run_wall_time_us":307724,"num_ops":5,"prepare.queue_time_us":286129,"prepare.run_cpu_time_us":19485,"prepare.run_wall_time_us":521213,"raft.queue_time_us":256346,"raft.run_cpu_time_us":18343,"raft.run_wall_time_us":97572,"replication_time_us":738579,"spinlock_wait_cycles":2816,"thread_start_us":583098,"threads_started":4,"wal-append.queue_time_us":351306}]]}
I20260501 13:59:25.570596  9919 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.566838  7573 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:25.546450  9884 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:25.584211  8381 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260501 13:59:25.586551  7573 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:25.593914  8381 pending_rounds.cc:85] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 5
I20260501 13:59:25.596002  8381 pending_rounds.cc:107] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260501 13:59:25.596349  8381 raft_consensus.cc:2889] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:25.544499  9922 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.598206  7573 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:25.608013  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:25.609220  7822 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.584933  9877 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 13:59:25.611207  7573 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:25.587368  9715 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:25.614041  7573 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:25.622057  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.593418  9929 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260501 13:59:25.593700  9937 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260501 13:59:25.622179  7573 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 6, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:25.633011  9953 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:25.635318  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:25.640034  9953 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:25.640604  7822 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:25.641000  9953 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.642601  9953 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:25.642844  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.223s (SENT)
I20260501 13:59:25.644263  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.638381  7573 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 5, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:25.636189  9922 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.646289  7573 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:25.650528  7573 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 3 to 4, term changed from 3 to 4, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted, no longer has a pending config: VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 4 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:25.653891  7573 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:25.656971  7573 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:25.660439  7573 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:25.663707  7573 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:25.667954  9708 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:25.667549  7573 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:25.668915  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.670351  9722 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:25.670905  9722 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.690016  9722 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:25.719669  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 129058us
I20260501 13:59:25.723387  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:25.724713  9722 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:25.725108  9722 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:25.725512  9722 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:25.731232  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 171552us
I20260501 13:59:25.732929  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.734930  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.736263  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:25.782140  7821 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:25.782658  9882 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:25.736089  9937 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:25.737036  9959 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:25.783495  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:25.738534  9958 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260501 13:59:25.785678  9722 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.784528  9717 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:25.787024  9717 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:25.787386  9717 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:25.788427  9941 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:25.788889  9941 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:25.781244  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46371.1us
I20260501 13:59:25.789634  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.790753  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.791287  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.792279  8372 raft_consensus.cc:2410] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260501 13:59:25.791410  8381 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:25.793982  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:25.795182  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.027s (SENT)
I20260501 13:59:25.795630  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:25.796380  9948 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:25.800809  9717 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.804827  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.803856  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:25.806177  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.806753  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:25.806119  7825 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:25.807334  8376 raft_consensus.cc:2376] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:25.807691  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.808862  8372 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:25.793138  9941 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.809947  9717 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.807098  8381 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:25.810298  9941 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:25.808288  9937 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.813094  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.813612  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:25.813385  9937 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.814224  7821 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:25.801432  9722 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.804878  8379 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:25.817095  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.817862  7673 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:25.819924  7825 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:25.821007  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.821157  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:25.822618  9937 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:25.824702  9722 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:25.825421  9722 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:25.828155  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:25.831905  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.832600  7753 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:25.833496  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:25.835954  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:25.838459  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:25.831471  9948 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:25.825556  8375 raft_consensus.cc:2955] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:25.844316  9722 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.846694  7821 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:25.848798  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:25.852604  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.853333  7673 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:25.853981  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:25.855378  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:25.851526  9745 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260501 13:59:25.855217  9859 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:25.856537  9859 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:25.857543  9859 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:25.855217  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:25.862479  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:25.863487  9801 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:25.862362  9959 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:25.864038  9801 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:25.864509  9959 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.864477  9801 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:25.867259  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:25.868384  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:25.870026  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:25.870983  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:25.872898  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.873176  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:25.875718  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.230s (SENT)
W20260501 13:59:25.878921  7718 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.101s (SENT)
I20260501 13:59:25.879442  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.882349  9959 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:25.894179  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.872819  9820 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:25.877971  9947 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:25.901173  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.885865  9912 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:25.905021  7673 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:25.912978  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.899438  9947 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:25.919670  9947 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:25.926771  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.927443  7671 raft_consensus.cc:2376] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6. Re-sending same reply.
I20260501 13:59:25.904225  9820 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:25.913832  7673 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
W20260501 13:59:25.966517  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:25.974133  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:25.974969  7673 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:25.937570  9820 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:25.993369  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.006793  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.007772  7674 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:26.007872  7679 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:26.008828  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.009111  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.009778  7675 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:26.010694  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.020308  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.021194  7671 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:26.030659  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.028296  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.032903  7677 raft_consensus.cc:2368] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:26.034957  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:26.038389  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 161449us
W20260501 13:59:26.039808  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:26.040578  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.027019  9801 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.044539  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:25.984860  9947 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.067147  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.067996  8372 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:26.074378  7677 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
W20260501 13:59:26.086199  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.575s (SENT)
I20260501 13:59:26.061405  9948 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:26.088685  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.060557  9900 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:26.056859  9801 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.093801  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.094666  7678 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:26.087378  9745 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:26.101310  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 56046.8us
I20260501 13:59:26.111636  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.112337  7675 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:26.103439  9937 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:26.093634  9900 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.116268  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.117671  7670 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:26.118358  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.119040  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.120154  7679 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:26.121476  7825 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:26.124101  7825 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:26.132761  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.133803  7679 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:26.136372  9947 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.136763  9900 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.107764  9745 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.150072  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.151113  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.151142  7679 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:26.153507  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.153663  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:26.154796  7675 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
W20260501 13:59:26.157210  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.161239  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.166817  9745 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.180034  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:26.181075  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.739s (SENT)
I20260501 13:59:26.181680  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.182108  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.182161  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.183447  7673 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:26.185411  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.187266  7678 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:26.190707  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.191448  7678 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:26.186558  7670 raft_consensus.cc:2376] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4. Re-sending same reply.
I20260501 13:59:26.160519  9864 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.210896  9859 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260501 13:59:26.219010  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.219805  7670 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.216805  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.188668  9937 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.228360  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.228442  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.229434  7822 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:26.230253  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.232532  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.231087  7825 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:26.213543  9745 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.212016  9960 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.245882  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.248602  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.248677  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.254180  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:26.256880  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 75283.3us
I20260501 13:59:26.257788  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.212695  9708 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260501 13:59:26.264366  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.935s (SENT)
I20260501 13:59:26.264936  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.258471  9919 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:26.266036  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.959s (SENT)
I20260501 13:59:26.267174  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.244694  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.276705  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.276866  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.278653  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.270680  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:26.273343  8379 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:26.279611  8381 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.274245  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.279906  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:26.282673  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:26.283252  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:26.266944  9960 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:26.278527  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:26.288938  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:26.292011  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.292191  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.292608  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.278028  9717 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:26.295153  8381 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:26.321285  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.315632  9891 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:26.324251  9891 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:26.324604  9986 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260501 13:59:26.325353  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:26.327152  9984 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260501 13:59:26.327322  8373 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:26.290165  9881 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.312510  9717 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:26.329142  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.329229  9717 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.330780  9717 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:26.331108  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:26.331679  7750 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:26.324630  9891 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:26.333180  9912 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:26.334450  7821 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260501 13:59:26.340242  9982 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260501 13:59:26.346271  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.314603  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:26.356298  8374 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:26.356403  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.268920  9919 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.358358  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.359258  9919 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:26.323089  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.361904  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.319787  9731 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:26.365502  9731 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.372751  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.373449  9731 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.374919  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.375485  7752 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:26.365834  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.376884  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:26.378172  9912 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:26.378592  9912 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:26.378916  9912 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:26.369517  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.384627  7576 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:26.386346  7576 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:26.387609  7576 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:26.388422  7753 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:26.388123  9912 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.389631  7576 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 4, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:26.364144  9891 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.393038  7670 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:26.393452  9959 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:26.391137  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:26.393962  9959 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.394379  7753 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:26.392091  7576 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:26.396627  7750 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
W20260501 13:59:26.401054  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:26.400806  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 84626.6us
I20260501 13:59:26.401784  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.402925  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.403743  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.406533  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.406250  9981 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260501 13:59:26.410274  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.410743  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.416530  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:26.417471  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.410566  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.421258  7822 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:26.423014  7752 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:26.408104  9708 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260501 13:59:26.406514  9722 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260501 13:59:26.435842  7677 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:26.437181  7670 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:26.437233  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.438180  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.438933  7677 raft_consensus.cc:2368] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5.
I20260501 13:59:26.440155  7678 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:26.440456  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.441124  7670 raft_consensus.cc:2368] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5.
I20260501 13:59:26.441571  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:26.442106  8381 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:26.442374  7678 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:26.443013  7675 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:26.444272  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.424829  9820 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:26.445604  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:26.448446  7675 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:26.448499  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.449394  8381 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:26.425484  9985 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:26.423130  9912 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.450532  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.450793  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.453897  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.454352  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.462958  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.454480  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.456235  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.464918  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.458348  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.466180  7679 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:26.415452  9900 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260501 13:59:26.456537  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:26.472167  7670 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:26.474197  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:26.475255  7671 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:26.481721  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:26.426455  9948 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260501 13:59:26.444936  9981 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260501 13:59:26.485733  7750 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.450095  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:26.481544  9994 raft_consensus.cc:993] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:26.490226  9997 consensus_queue.cc:1059] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:26.492184  9959 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.492614  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.471153  9731 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:26.497025  9994 raft_consensus.cc:1081] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
W20260501 13:59:26.498075  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.495999  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:26.499300  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54736.3us
I20260501 13:59:26.513731  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.502502  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 265) took 2042 ms. Trace:
I20260501 13:59:26.506790  9937 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260501 13:59:26.460336  9881 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260501 13:59:26.474992  9985 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:26.514789  7573 rpcz_store.cc:276] 0501 13:59:24.459919 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:24.460101 (+   182us) service_pool.cc:224] Handling call
0501 13:59:26.502394 (+2042293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:25.802203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:25.802780 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:25.802820 (+    40us) write_op.cc:435] Acquired schema lock
0501 13:59:25.802838 (+    18us) tablet.cc:662] Decoding operations
0501 13:59:25.881799 (+ 78961us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:25.888465 (+  6666us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:25.893152 (+  4687us) tablet.cc:685] Acquiring locks for 18 operations
0501 13:59:25.933498 (+ 40346us) tablet.cc:701] Row locks acquired
0501 13:59:25.933529 (+    31us) write_op.cc:260] PREPARE: finished
0501 13:59:25.933740 (+   211us) write_op.cc:270] Start()
0501 13:59:25.933917 (+   177us) write_op.cc:276] Timestamp: P: 1777643965933673 usec, L: 0
0501 13:59:25.933949 (+    32us) op_driver.cc:348] REPLICATION: starting
0501 13:59:25.934890 (+   941us) log.cc:844] Serialized 7054 byte log entry
0501 13:59:26.100056 (+165166us) op_driver.cc:464] REPLICATION: finished
0501 13:59:26.242925 (+142869us) write_op.cc:301] APPLY: starting
0501 13:59:26.252090 (+  9165us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:26.294780 (+ 42690us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:26.346881 (+ 52101us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:26.348760 (+  1879us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:26.349046 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0501 13:59:26.349091 (+    45us) write_op.cc:312] APPLY: finished
0501 13:59:26.349454 (+   363us) log.cc:844] Serialized 125 byte log entry
0501 13:59:26.349634 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:26.349823 (+   189us) write_op.cc:454] Released schema lock
0501 13:59:26.349884 (+    61us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:26.364085 (+ 14201us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:26.364119 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33021,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":121476,"apply.run_cpu_time_us":4552,"apply.run_wall_time_us":137652,"num_ops":18,"prepare.queue_time_us":79782,"prepare.run_cpu_time_us":6861,"prepare.run_wall_time_us":133045,"replication_time_us":155447,"thread_start_us":165217,"threads_started":2}]]}
W20260501 13:59:26.533653  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77511.9us
I20260501 13:59:26.536448  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.539116  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.541324  9914 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:26.542006  9998 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:26.544250  7663 tablet_service.cc:1558] Processing DeleteTablet for tablet 367eab87da314007b62b7bd0a0905d38 with delete_type TABLET_DATA_TOMBSTONED (TS bc1b0a0a152e46fea4bd4934ba9976ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38224
I20260501 13:59:26.546134  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.547005  7674 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:26.547379  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.510358  9731 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:26.551265  8344 leader_election.cc:400] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5.
I20260501 13:59:26.509078  8375 raft_consensus.cc:2376] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:26.552764  8344 leader_election.cc:403] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260501 13:59:26.513721  9989 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260501 13:59:26.548017  9912 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:26.545261  9980 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:26.548640  9959 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:26.549495  9801 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.587534  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.519953  9708 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260501 13:59:26.576181  9997 consensus_queue.cc:1243] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260501 13:59:26.532480  9859 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260501 13:59:26.554819  9731 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:26.586158  7753 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:26.591501  9990 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:26.603000  9985 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.604322  9959 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:26.605482  9959 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.591322  9989 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:26.565591  9981 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.552451  9929 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260501 13:59:26.609192  9929 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:26.609664  9929 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:26.610751  9929 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.578961  9912 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:26.612040  9912 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.612246  9891 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:26.617563  9864 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:26.618090  9864 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:26.620400 10000 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:26.620972 10000 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.623162 10000 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:26.624934  9929 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:26.580345  9980 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:26.571156  9992 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5.
W20260501 13:59:26.630151  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 116464us
I20260501 13:59:26.595618  9998 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:26.638818  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.643100  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:26.643712 10003 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:26.644270 10003 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:26.644426  9949 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:26.644826  9949 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:26.645218 10003 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.645658  9949 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.646136  9997 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:26.646634  9949 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.646744  9997 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.643805  7672 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.649144  9997 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:26.637279  9980 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:26.650192  9997 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:26.650725  9997 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.652091  9998 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.647006 10003 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.654747  9998 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:26.619136  9864 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.661468  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.662431  9919 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:26.665341  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.674229  7672 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:26.730472  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 159050us
I20260501 13:59:26.672837  9919 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:26.839646  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 252133us
I20260501 13:59:26.843587  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:26.874018  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.863483  9864 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:26.673545  9998 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260501 13:59:26.868422  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 203170us
I20260501 13:59:26.887800  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.879738  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:26.870203  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 322892us
I20260501 13:59:26.660997 10000 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260501 13:59:26.870468  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.868587  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:26.867022 10005 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.896754 10015 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 13:59:26.893256  9994 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:26.903118  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.906730  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.907703  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.912263  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.924451  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:26.914300  9717 raft_consensus.cc:993] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:26.930902  7825 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260501 13:59:26.925314 10004 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.932291  9981 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:26.933482  7821 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:26.887120  9959 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:26.880425  9731 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.913637 10014 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:26.939375  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:26.935683  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:26.958689  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:26.941804  9981 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:26.977567  9981 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.946611  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:26.980122  8375 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Advancing to term 4
I20260501 13:59:26.981252  9997 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:26.947216  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:26.947448  9998 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:26.992959 10006 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260501 13:59:26.995625  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:27.004850  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 47098.1us
W20260501 13:59:27.009543  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 70239.9us
I20260501 13:59:27.010488  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.000241  9960 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.012099  9960 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.014289  9960 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.000440  9989 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.015106  9989 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.017856  9989 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.019001 10018 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:27.019500 10018 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:27.019874 10018 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:26.922092  9994 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.913759 10008 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:27.023941 10017 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:26.954928  9912 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.924652  9919 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:26.889638  9980 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:26.921346 10000 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:26.965261  9731 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:26.965811  7822 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:26.966526  9717 raft_consensus.cc:1081] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:26.970588 10011 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:26.972224 10002 raft_consensus.cc:993] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
W20260501 13:59:26.975919 10016 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260501 13:59:27.040844  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:27.043536  7747 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:27.049124  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.050251  7820 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:27.056262  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.028815  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.033578  7825 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:27.057840  7750 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:26.976657  9959 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.058511  7643 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.054459  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.066407  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.066521  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.036962  9998 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:27.042383  9912 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.046111  9731 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:27.059249 10000 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:27.065614 10003 raft_consensus.cc:1081] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:27.083974 10005 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:27.084388  9992 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 13:59:27.086040  9919 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:27.087332  9717 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:27.089470  8374 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:27.089752  9980 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.098435 10002 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 13:59:27.105113  9994 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.105409 10007 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:27.072484 10017 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:27.074935 10013 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260501 13:59:27.118692  9948 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:27.124599  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.131008  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.168349  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:27.168794  7822 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:27.169036  7750 raft_consensus.cc:606] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:27.168962  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44471.4us
I20260501 13:59:27.169994  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:27.172389  9992 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:27.173017  8375 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:27.177547 10014 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:27.178535  7752 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:27.171321 10015 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 13:59:27.181512  9948 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:27.181874  9948 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:27.182685  9948 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.131693  9731 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.184859 10015 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 13:59:27.185223  9981 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.185940  9731 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.186161 10008 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:27.152494  9760 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260501 13:59:27.187183 10008 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:27.177673  9929 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:27.187533  9981 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.187613 10008 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:27.195467 10017 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.188817  9959 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:27.206314  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.196916  9929 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:27.205945  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:27.196851  9948 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:27.209666  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:27.210598  7747 raft_consensus.cc:606] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:27.214708  9929 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.201167 10018 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.217998 10018 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.222337  9929 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:27.225378 10015 ts_tablet_manager.cc:1916] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:59:27.205570 10004 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:27.228067 10004 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:27.228499 10004 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:27.235587  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.236872  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:27.237677  7747 raft_consensus.cc:606] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:27.231630  9981 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:27.247078 10008 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.254561 10008 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:27.256178 10018 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.248560 10007 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260501 13:59:27.256840 10018 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.248492  9947 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260501 13:59:27.246902 10011 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:27.259609 10018 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.263901 10011 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.267417 10018 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.268180 10018 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.270712 10018 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:27.290678  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 224345us
I20260501 13:59:27.292143  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.295940  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:27.296008  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.294020  9981 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:27.303546  9981 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:27.310597  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 58764.4us
I20260501 13:59:27.209952 10017 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.295531 10018 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:27.299152  9959 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:27.325327  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:27.351406 10017 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.388857  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.394018  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.399889  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.403257  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.404832  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:27.406052  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:27.406543  7752 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:27.407230  7747 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:27.407891  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.420061  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:27.420678  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.422398  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.424860  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.425657  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.429068  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "962840f0434049bbb395d330e010962d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:27.429267  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.429723  7745 raft_consensus.cc:606] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:27.434180  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.434544  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:27.435451  8373 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:27.437034  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.437767  8376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:35982
I20260501 13:59:27.438414  8374 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 LEARNER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:27.438541  8376 raft_consensus.cc:606] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.439101  8376 raft_consensus.cc:614] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:27.440052  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:27.440426  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.441229  8381 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:27.441847  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:27.442936  8379 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:27.443192  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.440470  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:27.446952  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 13:59:27.446913  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.452356  9881 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:27.453428  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.453397  9881 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:27.458191  9919 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.459246  9919 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.459954  7745 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:27.462764  9919 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.463584  9919 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:27.463616  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.464687  9919 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.465660  9919 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.466883  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.467238  8377 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:27.468968  9937 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.469846  9937 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.468447  9864 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:27.473894  9997 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:27.468986  9959 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:27.476553  9959 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:27.477466 10000 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:27.482919  9997 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.484552  9997 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.487659  9997 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.487852  9937 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.468099  9919 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.494966  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:27.499856  9731 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:27.500423  9731 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:27.500782 10027 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260501 13:59:27.501819  9731 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.510488  7753 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260501 13:59:27.516155  8371 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:27.518728  8381 raft_consensus.cc:2410] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260501 13:59:27.532183  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:27.535493  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:27.538962  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.542086  9731 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:27.547376  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.548357  7820 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:27.551419  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.556119  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.556644  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.557317  7752 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:27.562017  8372 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:27.563139  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.563412  9919 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.568643  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.569108  9919 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.566248  7821 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:27.571364  9919 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.578424 10012 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.579236 10012 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.581909 10012 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.585940  9937 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:27.587744  9864 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:27.588181  9864 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:27.589407  9864 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.590894  9864 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:27.593380  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:27.594358  7672 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:27.541530  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:27.606725  7677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:27.607640  7677 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:27.607894  7671 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260501 13:59:27.608093  7677 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
W20260501 13:59:27.613831  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 299627us
I20260501 13:59:27.616307  9919 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.617273  9919 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.620002  9919 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.620291  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:27.621318  7821 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:27.622179  9919 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.622959  9919 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.625327  9919 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.626174  7677 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.629158  7677 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.632360  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 175) took 1927 ms. Trace:
I20260501 13:59:27.637835  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:27.638967  7745 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:27.640260  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.641132  9937 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:27.641534  9937 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.641901  9937 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:27.645043 10004 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.646610  7747 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:27.673131  7672 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:27.647794 10004 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:27.678058  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.674957  9919 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:27.679145  9919 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.678076  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:27.680593  7677 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260501 13:59:27.681561  9919 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.681769 10011 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:27.682627 10011 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:27.684777 10011 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.649370  9731 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260501 13:59:27.700927  7672 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:27.648430  7573 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:27.632947  7576 rpcz_store.cc:276] 0501 13:59:25.705242 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:25.705493 (+   251us) service_pool.cc:224] Handling call
0501 13:59:27.632039 (+1926546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:26.866917 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:26.893255 (+ 26338us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:26.893294 (+    39us) write_op.cc:435] Acquired schema lock
0501 13:59:26.893311 (+    17us) tablet.cc:662] Decoding operations
0501 13:59:26.893997 (+   686us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:26.894061 (+    64us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:26.894085 (+    24us) tablet.cc:685] Acquiring locks for 5 operations
0501 13:59:26.894599 (+   514us) tablet.cc:701] Row locks acquired
0501 13:59:26.894619 (+    20us) write_op.cc:260] PREPARE: finished
0501 13:59:26.894775 (+   156us) write_op.cc:270] Start()
0501 13:59:26.894892 (+   117us) write_op.cc:276] Timestamp: P: 1777643966894726 usec, L: 0
0501 13:59:26.894914 (+    22us) op_driver.cc:348] REPLICATION: starting
0501 13:59:26.895569 (+   655us) log.cc:844] Serialized 2050 byte log entry
0501 13:59:27.175890 (+280321us) op_driver.cc:464] REPLICATION: finished
0501 13:59:27.230532 (+ 54642us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2f762682c 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fe123360
0501 13:59:27.323981 (+ 93449us) write_op.cc:301] APPLY: starting
0501 13:59:27.324084 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:27.324251 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:27.324273 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:27.324962 (+   689us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:27.325188 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0501 13:59:27.325235 (+    47us) write_op.cc:312] APPLY: finished
0501 13:59:27.325461 (+   226us) log.cc:844] Serialized 47 byte log entry
0501 13:59:27.325631 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:27.325770 (+   139us) write_op.cc:454] Released schema lock
0501 13:59:27.325816 (+    46us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:27.326149 (+   333us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:27.326175 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92076,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":143127,"apply.run_cpu_time_us":2200,"apply.run_wall_time_us":3831,"num_ops":5,"prepare.queue_time_us":386078,"prepare.run_cpu_time_us":3544,"prepare.run_wall_time_us":29015,"replication_time_us":280768,"spinlock_wait_cycles":37097856,"thread_start_us":310168,"threads_started":2}]]}
W20260501 13:59:27.806845 10043 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260501 13:59:27.768424  9937 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.810600  7573 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 5, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:27.811892  9937 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:27.812492  7573 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:27.791661 10041 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260501 13:59:27.831171  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:27.833437  7745 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:27.843348  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:27.844247  7822 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:27.847013  7573 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:27.852993  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.863360  7672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:27.872625 10011 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:27.873013  7672 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:27.873489  7672 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:27.874298 10033 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:27.875974  8375 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:27.912593  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:27.916178 10015 ts_tablet_manager.cc:1929] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260501 13:59:27.898736  9864 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:27.919382 10048 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260501 13:59:27.919540  9864 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.921001 10021 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260501 13:59:27.922103  9864 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:27.924746  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:27.928742 10042 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260501 13:59:27.929152 10007 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:27.873494 10011 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.928164 10015 log.cc:1199] T 367eab87da314007b62b7bd0a0905d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/wals/367eab87da314007b62b7bd0a0905d38
I20260501 13:59:27.940409  9919 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:27.941241  9919 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.943666  9919 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.948215  9919 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:27.948945  9919 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.951368  9919 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:27.953966 10007 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:27.954747 10007 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:27.961623 10007 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:27.967154  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:27.972075  7747 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:27.975135  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:27.965299  7672 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:27.979115  9864 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:27.979743  7673 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:27.980113  9864 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:27.984251  7674 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:27.993814  7672 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:28.001577  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:28.006621  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 94137.1us
I20260501 13:59:28.009517  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.027554  7677 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260501 13:59:28.033320  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.034277  7671 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:28.035391  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.031441  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.037593  7679 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:28.047675  7672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:28.048271  7672 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:28.043387  7670 raft_consensus.cc:2376] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5. Re-sending same reply.
I20260501 13:59:28.048696  7672 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.049787  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.050107  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.035713  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.050446  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:28.051095  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.038923  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.048156  7673 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:28.054818  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.061492  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.063170  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.065606  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.066244  7822 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:28.066061  7671 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:28.036058  9981 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.071105  7670 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:28.071696  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:28.066205  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.074627  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:28.077185  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:28.072577  7678 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:28.077756  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.080549  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.081094  7673 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:28.081676  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:28.082803  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.084668  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.059747 10015 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38224 (request call id 703) took 1504 ms. Trace:
I20260501 13:59:28.088644  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.089078  9881 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:28.089887  9881 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.092495  9919 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:28.092655 10022 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:28.093115 10022 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.093618 10022 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:28.093129  9919 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.095613  9919 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.096364  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:28.097167  7826 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:28.100157  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.100724  7752 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:28.101022  7752 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:28.101054  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:28.101898  7752 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.101868  7825 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.107095  7752 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:28.107165  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.108104  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.107894  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:28.108886  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 95000.2us
I20260501 13:59:28.113095  7678 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:28.114329  7750 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:28.047423  9864 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.125682  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.132186  7674 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:28.114363  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.110647 10011 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.103227  9981 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.143675  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.131989  9919 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260501 13:59:28.151204  7747 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:28.153149  7747 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:28.164144  7821 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260501 13:59:28.165189  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.154096  7748 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
W20260501 13:59:28.181736  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 113293us
I20260501 13:59:28.167615  9881 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.170833 10007 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:28.192618  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:28.193109  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53975.8us
I20260501 13:59:28.196730  7826 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:28.177043  7747 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.206575  7672 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.208992  7672 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.211057  8381 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 13:59:28.212976  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.218209  7747 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.227735  7752 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:28.235350  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.202448 10023 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:28.087360 10015 rpcz_store.cc:276] 0501 13:59:26.543366 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:26.543901 (+   535us) service_pool.cc:224] Handling call
0501 13:59:26.896288 (+352387us) ts_tablet_manager.cc:1151] Deleting tablet 367eab87da314007b62b7bd0a0905d38
0501 13:59:26.896408 (+   120us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0501 13:59:27.184353 (+287945us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b540037fad4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e9742 00007fb2fe0df7bc 00007fb2ff705cca 00007fb2ff736990 00007fb2ff71cefd 00007fb2ff71cea9 00007fb2ff71ce39 00007fb2ff71ce01 00007fb2ff71c02d 0000000000379254
0501 13:59:27.561287 (+376934us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:27.904979 (+343692us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:28.044994 (+140015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159865,"spinlock_wait_cycles":199168768,"tablet-delete.queue_time_us":351284,"thread_start_us":257953,"threads_started":1}
I20260501 13:59:28.242027  7678 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 13:59:28.260155  7826 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:28.264302 10064 raft_consensus.cc:2764] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260501 13:59:28.276832  9981 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.260509 10023 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.280508 10023 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:28.280539  7562 catalog_manager.cc:5002] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): tablet 367eab87da314007b62b7bd0a0905d38 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:59:28.235435 10007 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.284907  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.285698  7746 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:28.286676  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.287284  7752 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
W20260501 13:59:28.287935 10057 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
W20260501 13:59:28.288271  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52115.1us
I20260501 13:59:28.289203  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:28.260196  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.290601  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:28.291536 10014 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.292119 10002 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.292101  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:28.295418  7673 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:28.311597  7747 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
W20260501 13:59:28.313226  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:28.318970  7825 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:28.321257  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:28.327556  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 103404us
I20260501 13:59:28.324676 10023 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:28.331763  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 119007us
I20260501 13:59:28.328794  9731 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260501 13:59:28.334576 10059 log.cc:927] Time spent T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260501 13:59:28.334900 10014 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:28.335249  9731 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.336233 10068 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:28.336377  9731 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:28.336853 10068 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.339376 10068 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:28.334617 10071 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260501 13:59:28.331881 10023 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.341230 10023 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.334673 10066 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:28.342790 10066 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.342665 10022 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.344949 10021 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:28.344918  7674 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:28.349673 10022 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:28.351496  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.352183  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:28.353101  9881 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:28.353587  9881 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.354058  9881 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.354547 10014 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:28.356774  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:28.358181  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:28.369155  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:28.370198  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:28.378410 10007 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.369524 10022 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:28.380203 10022 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.380640 10022 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:28.361420  8375 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260501 13:59:28.371305 10078 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.403529 10023 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.408004 10068 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
W20260501 13:59:28.411155  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 56637.7us
I20260501 13:59:28.417150  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:28.410959 10068 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:28.417860 10014 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:28.430042 10078 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:28.430678 10066 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.430902 10078 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:28.431741 10068 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.432008 10078 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.434979 10079 raft_consensus.cc:993] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.427680 10002 raft_consensus.cc:993] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.441977 10023 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.442564  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.440827  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:28.459314  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:28.446087  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:28.465309  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:28.465516 10080 raft_consensus.cc:1081] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.443537  9820 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.468771 10069 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.469012  9914 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.469657  9914 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.460108 10014 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.473323  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.474056  7747 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:28.475241 10021 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 13:59:28.471721  9914 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.478401  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.483058  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:28.484405  9864 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:28.484808  9864 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.485248  9864 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.486513  7574 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 1 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:28.488473  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:28.488150  9820 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.498317  7752 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:28.479303  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 266) took 1635 ms. Trace:
I20260501 13:59:28.513644  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:28.443652  9731 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.467734  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.452399  9881 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:28.526026  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:28.510833 10002 raft_consensus.cc:1081] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.504243  7573 rpcz_store.cc:276] 0501 13:59:26.844399 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:26.867684 (+ 23285us) service_pool.cc:224] Handling call
0501 13:59:28.479236 (+1611552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:28.090329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:28.091062 (+   733us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:28.091113 (+    51us) write_op.cc:435] Acquired schema lock
0501 13:59:28.091131 (+    18us) tablet.cc:662] Decoding operations
0501 13:59:28.091859 (+   728us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:28.091979 (+   120us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:28.092010 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0501 13:59:28.092607 (+   597us) tablet.cc:701] Row locks acquired
0501 13:59:28.092635 (+    28us) write_op.cc:260] PREPARE: finished
0501 13:59:28.092811 (+   176us) write_op.cc:270] Start()
0501 13:59:28.092953 (+   142us) write_op.cc:276] Timestamp: P: 1777643968092745 usec, L: 0
0501 13:59:28.092993 (+    40us) op_driver.cc:348] REPLICATION: starting
0501 13:59:28.093719 (+   726us) log.cc:844] Serialized 1684 byte log entry
0501 13:59:28.282055 (+188336us) op_driver.cc:464] REPLICATION: finished
0501 13:59:28.395107 (+113052us) write_op.cc:301] APPLY: starting
0501 13:59:28.395243 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:28.395504 (+   261us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:28.395693 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:28.396700 (+  1007us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:28.397112 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0501 13:59:28.397185 (+    73us) write_op.cc:312] APPLY: finished
0501 13:59:28.397615 (+   430us) log.cc:844] Serialized 41 byte log entry
0501 13:59:28.419946 (+ 22331us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:28.423128 (+  3182us) write_op.cc:454] Released schema lock
0501 13:59:28.428071 (+  4943us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:28.443480 (+ 15409us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:28.443515 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":84317,"apply.run_cpu_time_us":3677,"apply.run_wall_time_us":48399,"num_ops":4,"prepare.queue_time_us":110889,"prepare.run_cpu_time_us":3824,"prepare.run_wall_time_us":18580,"replication_time_us":169324,"thread_start_us":85888,"threads_started":2}]]}
I20260501 13:59:28.528044 10068 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:28.530938  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 63332.1us
I20260501 13:59:28.531766  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.520812 10023 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:28.522442  9937 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:28.539810  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.540426  7754 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:28.535833  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54697.1us
I20260501 13:59:28.543043  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.545176  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:28.545825 10083 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260501 13:59:28.552723  9820 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:28.552968 10023 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:28.553443 10068 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.554095 10023 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:28.556161 10085 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.056s	user 0.000s	sys 0.003s
I20260501 13:59:28.558382  9881 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.564811  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:28.565567  7825 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.569597  9864 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.572649  9937 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.574718  9937 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.576120 10078 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.538136  9731 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:28.577903  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.586864  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.592235  7825 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:28.593336 10078 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.571646  9864 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.602123  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:28.606333  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.605232  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.608222  7747 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.611745  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:28.613657 10078 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.535857 10022 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.616482  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:28.620062  7792 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:28.607441 10066 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:28.622006  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.623793 10011 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.624814  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.624178 10014 raft_consensus.cc:993] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
W20260501 13:59:28.618978 10088 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260501 13:59:28.626801  7825 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:28.629248 10082 raft_consensus.cc:1081] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.626868 10068 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:28.628362 10014 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:28.630390 10021 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.630972 10021 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.632169 10066 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:28.633473 10021 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.621356 10078 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:28.635123 10078 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.635476 10078 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:28.657047  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.657958  7745 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:28.658398  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.660869  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.662073  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.662168 10069 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:28.660125  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:28.664022  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.665745  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.651505  9881 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260501 13:59:28.669881  9919 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.672735 10092 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.673048 10011 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.673611 10022 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.673465 10092 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.673573 10011 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.670686  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.663203 10068 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.681325  7747 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:28.666839  9864 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:28.667009 10071 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.691627  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:28.668563 10069 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.692729  7825 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.669175  9731 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.694387  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:28.693627  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:28.708181  7822 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 6
I20260501 13:59:28.694517  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:28.695175  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.695982  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:28.697886  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:28.698319  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:28.698653  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.700340  7745 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260501 13:59:28.708007  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:28.700668  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.700923  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.713541  7821 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:28.702524  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.704185  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.704881  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.714763  7753 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:28.707366  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:28.709807  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:28.712323  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.716250  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.718832  7676 raft_consensus.cc:2368] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:28.713899  7671 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:28.722270  7746 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:28.722470  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.722853  7746 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:28.723906  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.723750  7746 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.724545  7678 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:28.725195 10072 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:28.725485 10064 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:28.726048 10064 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:28.726387  7673 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:28.726990 10064 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.728205  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 297) took 8065 ms. Trace:
I20260501 13:59:28.728621  7574 rpcz_store.cc:276] 0501 13:59:20.662490 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:20.662652 (+   162us) service_pool.cc:224] Handling call
0501 13:59:28.728114 (+8065462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:28.548205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:28.548736 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:28.548774 (+    38us) write_op.cc:435] Acquired schema lock
0501 13:59:28.548804 (+    30us) tablet.cc:662] Decoding operations
0501 13:59:28.549260 (+   456us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:28.549332 (+    72us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:28.549367 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:28.549558 (+   191us) tablet.cc:701] Row locks acquired
0501 13:59:28.549576 (+    18us) write_op.cc:260] PREPARE: finished
0501 13:59:28.549758 (+   182us) write_op.cc:270] Start()
0501 13:59:28.549889 (+   131us) write_op.cc:276] Timestamp: P: 1777643968549707 usec, L: 0
0501 13:59:28.549912 (+    23us) op_driver.cc:348] REPLICATION: starting
0501 13:59:28.550647 (+   735us) log.cc:844] Serialized 533 byte log entry
0501 13:59:28.553884 (+  3237us) op_driver.cc:464] REPLICATION: finished
0501 13:59:28.554466 (+   582us) write_op.cc:301] APPLY: starting
0501 13:59:28.554561 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:28.554663 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:28.554751 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:28.554990 (+   239us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:28.555159 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:28.555206 (+    47us) write_op.cc:312] APPLY: finished
0501 13:59:28.555407 (+   201us) log.cc:844] Serialized 23 byte log entry
0501 13:59:28.555562 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:28.555657 (+    95us) write_op.cc:454] Released schema lock
0501 13:59:28.555696 (+    39us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:28.556729 (+  1033us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:28.556763 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15555,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":302,"apply.run_cpu_time_us":1597,"apply.run_wall_time_us":2209,"num_ops":1,"prepare.queue_time_us":690,"prepare.run_cpu_time_us":2720,"prepare.run_wall_time_us":2720,"replication_time_us":3799}]]}
I20260501 13:59:28.732517  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:28.733458 10033 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:28.733889 10080 raft_consensus.cc:993] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.734318 10033 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:28.734519 10080 raft_consensus.cc:1081] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.724843  7746 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.738572  7822 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:28.742229  7753 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:28.744184  7754 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:28.691051 10022 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:28.722332 10068 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.706772  9864 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.759763  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:28.764508  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:28.780041  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.766235  9914 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.766942 10033 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.769657  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:28.770802  7679 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260501 13:59:28.803838  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.717120  9731 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.776875  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:28.777984  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:28.808660  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 76235.6us
I20260501 13:59:28.801544  7746 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
W20260501 13:59:28.805663  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 45999.5us
W20260501 13:59:28.814642  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47114.6us
I20260501 13:59:28.669930 10066 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.818228  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.819262  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:28.808295 10071 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:28.784430  9864 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.775266 10078 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:28.841499  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 61568us
I20260501 13:59:28.822865 10011 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.854445  7825 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:28.840893  9881 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:28.823983  9919 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:28.857785  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:28.841203 10092 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.868176 10081 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260501 13:59:28.870023  9937 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:28.870965  7672 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:28.827665  9914 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.872478 10068 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:28.871928 10094 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.821017 10033 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.857465  9881 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:28.856106 10065 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:28.901372 10065 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:28.902081 10065 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.883863  9937 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:28.881721 10089 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 13:59:28.881994 10014 raft_consensus.cc:993] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.904322 10014 raft_consensus.cc:1081] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:28.904165  9937 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.882455 10093 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:28.905483 10093 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.909116  9881 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.823658 10072 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260501 13:59:28.895272  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 76076.5us
I20260501 13:59:28.894152 10068 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:28.913233 10068 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:28.911507 10094 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:28.955160 10072 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:28.955953 10072 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:28.957161 10072 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:28.985509  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 125576us
I20260501 13:59:28.986554  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:28.986791 10093 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.987525  9981 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:28.987516  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.988274 10094 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:28.988672 10098 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:28.989265  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:28.990078  9919 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:28.992002  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:28.992842  7752 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:28.995393  7752 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:28.995393  7822 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 13:59:28.997689  9919 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:28.986209 10033 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:28.999691 10069 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:29.006901 10071 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:29.008082 10071 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.008756 10072 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:28.862701  7577 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 1 to 3, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:29.011740  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 156343us
I20260501 13:59:29.003929  9937 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:29.004561  9731 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.033452 10078 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.059602  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:29.060359  7825 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:29.073846  7748 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:29.048983 10069 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:29.094310  8381 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260501 13:59:29.100374  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.102890  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:29.103610  7672 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:29.104842  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.106921 10093 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:29.055766 10033 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260501 13:59:29.136106  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.154623 10023 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.096479 10069 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.157290 10066 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.158541  9881 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.099246 10068 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.137470  7821 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:29.164012  7825 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:29.162284  7820 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:29.115597  9731 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:29.107617 10093 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.167030  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:29.168196  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 77459.7us
I20260501 13:59:29.172468  7754 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:29.172737  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:29.185941 10021 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:29.188761  9864 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.191013  9864 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.181438  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:29.154610  9914 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.193110  9881 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.160140 10064 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.193943  9919 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:29.194036 10064 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.194802  9919 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:29.217823  9919 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.219209 10021 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:29.171554 10011 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.198915 10065 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.220292 10011 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.200410 10094 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:29.181116 10066 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.202582 10069 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.204473  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.205195  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.208463  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:29.169649 10023 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.182796 10092 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.208120 10033 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.221608 10065 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.244402 10011 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:29.250697 10098 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:29.183868 10100 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260501 13:59:29.252053 10033 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.211239  9731 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.254354 10033 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.256062 10096 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.256548 10096 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.258358 10096 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.259723 10093 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.223477 10094 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.240746  7825 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260501 13:59:29.260501 10094 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.220966 10021 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.264160 10078 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:29.268384 10066 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:29.241969 10104 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260501 13:59:29.242079  9914 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:29.271138  9914 consensus_queue.cc:1243] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer bc1b0a0a152e46fea4bd4934ba9976ed log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:29.208392 10068 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:29.276450  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68114.7us
I20260501 13:59:29.255605  9731 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:29.273209  9981 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.286626  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:29.275570 10011 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:29.293818  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:29.294996  7672 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.297601  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.297962  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.279606 10093 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:29.312783  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.318722  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:29.315619  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:29.319154  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:29.319525  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:29.315315  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 80137.5us
I20260501 13:59:29.367885  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:29.368796  7826 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:29.317607  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:29.370200  7753 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.319098  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:29.373276  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:29.373720  7752 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.374102  8381 raft_consensus.cc:2368] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4.
I20260501 13:59:29.319484  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:29.374959  7674 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:29.319969  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:29.376355  7671 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.293098 10100 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:29.277967 10092 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.294775 10011 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:29.315515  9981 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.299180 10068 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.290627 10078 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.389453  7792 leader_election.cc:400] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:29.394439  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:29.401253  7792 leader_election.cc:403] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:29.401630  7673 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:29.402179  7673 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.316085 10065 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.313903 10093 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.404194  7670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:29.406037  7675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:29.406776  7675 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:29.407131  7675 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.406981  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.409703  7825 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:29.409127 10093 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.418678  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.420089 10082 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:29.420632 10082 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.422987 10082 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.426746  7753 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:29.451687 10115 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260501 13:59:29.452286  7678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "962840f0434049bbb395d330e010962d"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:29.453078  7678 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:29.453450  7678 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.455010  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.455760  7826 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:29.455983  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:29.451982 10002 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:29.460255  9731 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:29.462949 10011 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.464327 10011 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:29.428783 10065 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.467972 10065 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.456000  9914 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.469491  9914 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.417364 10078 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.476565  7670 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:29.476971  7670 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:29.477970  7821 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260501 13:59:29.450489  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 80457.5us
I20260501 13:59:29.483412 10118 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 13:59:29.486625 10064 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.487231  9981 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.488093 10023 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:29.487684 10092 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:29.489259 10078 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:29.471632  9914 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:29.491586  8375 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260501 13:59:29.478350  7821 pending_rounds.cc:85] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 4
I20260501 13:59:29.495096  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.493606  7821 pending_rounds.cc:107] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:29.498034  7821 raft_consensus.cc:2889] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:29.546214  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:29.559158  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 192268us
I20260501 13:59:29.482905  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:29.560613  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77794.5us
I20260501 13:59:29.571000  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.573782  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.578477 10122 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:29.552775  7673 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.496800 10078 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.581450  7673 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.583186  7672 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:29.495800 10068 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.562511  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:29.597800  7822 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:29.599272  7828 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:29.603112  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:29.608780  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:29.611013  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:29.611739  7673 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:29.612188  7673 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:29.588459  9914 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:29.550523 10093 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.621542 10097 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:29.579265 10122 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.625893  7753 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:29.587611 10072 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:29.631292  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:29.587893 10069 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:29.639358  7752 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:29.641435  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 93864.2us
I20260501 13:59:29.624389  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:29.602241  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:29.601809 10023 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:29.614323 10096 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:29.593166 10078 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.654704  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.656227  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:29.658751  7752 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:29.659171  7752 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:29.660102  7752 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.661412  7752 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.664260  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.608054 10068 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.644152  9731 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:29.670703  7745 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:29.675390  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:29.676198  7826 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:29.682790  7673 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.657232 10096 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:29.656754 10065 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:29.693193  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.689951  7673 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.699777  7827 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:29.663672  8375 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 1.
I20260501 13:59:29.702713  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:29.710880  7828 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:29.706497  7745 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260501 13:59:29.708555  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:29.686889  9731 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:29.672770 10069 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:29.718482  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:29.751922  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:30.066859  7674 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260501 13:59:29.824044  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.720484  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.100982  7674 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
W20260501 13:59:30.038853  7670 consensus_meta.cc:287] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
W20260501 13:59:30.097980 10126 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
W20260501 13:59:29.972143  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 287261us
W20260501 13:59:30.102041  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 336212us
I20260501 13:59:30.103436  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:30.105063  7752 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:29.691196 10096 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:30.104411  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:30.102649  7670 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.115873  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:30.116683  7671 consensus_meta.cc:287] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.002s
I20260501 13:59:30.117096  7671 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:30.115644  7718 leader_election.cc:400] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4.
I20260501 13:59:30.118466  7718 leader_election.cc:403] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:30.117931  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:29.725425  9937 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
W20260501 13:59:29.768452 10094 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.002s
I20260501 13:59:30.139421  8377 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:29.758670 10022 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:30.138453  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:30.078368 10068 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.778481 10071 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:29.710738 10072 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.147364  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:30.172906  7678 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.001s
I20260501 13:59:30.149333  7671 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:30.139901  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:29.715411 10065 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:30.173405  7678 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:29.817137 10033 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.130029  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:30.203902  7745 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:30.153698  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:29.737910 10133 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:29.994467 10093 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:29.994215 10064 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:29.937424 10082 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.121690  7826 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:30.071879  9881 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:29.772228  9820 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:30.109262 10087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.003s	sys 0.007s
I20260501 13:59:29.937640 10099 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.493s
I20260501 13:59:30.113687 10129 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.108614 10078 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:30.185174  7672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.017s
W20260501 13:59:30.259786  7672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.008s	sys 0.017s
I20260501 13:59:30.186694  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.257417  7671 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260501 13:59:30.141139 10120 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.184005  7753 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:30.267728  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:30.119544 10128 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4.
I20260501 13:59:30.205019  8376 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:30.204370  7745 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:30.235953 10087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.004s	sys 0.007s
I20260501 13:59:30.232398  7678 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.197576  7674 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:30.263559  7671 pending_rounds.cc:85] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 13:59:30.276927  7671 pending_rounds.cc:107] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260501 13:59:30.277242  7671 raft_consensus.cc:2889] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:30.020140  9731 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.158612 10094 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:30.277117  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 154227us
W20260501 13:59:30.231585  7675 consensus_meta.cc:287] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.005s
I20260501 13:59:30.277892  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.269202  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:30.275810  7745 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.280205  7675 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:30.281037  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 125145us
I20260501 13:59:30.281985  7745 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:30.196715 10072 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.285048  8380 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:30.235874  9881 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.270174 10093 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:30.279191  9919 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.264676 10122 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.289223  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.233088 10082 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.307561  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:30.236198 10064 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.233927 10022 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.312444  7675 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.233734 10071 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.239063 10033 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.314241  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.314272  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38240 (request call id 1241) took 1002 ms. Trace:
I20260501 13:59:30.321375  7675 rpcz_store.cc:276] 0501 13:59:29.311877 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.386315 (+ 74438us) service_pool.cc:224] Handling call
0501 13:59:30.314195 (+927880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:30.309913 10093 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:30.236845 10133 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.292410  9937 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.274770  9820 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.279374 10068 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260501 13:59:30.324194  7644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.014s	sys 0.040s
I20260501 13:59:30.328449  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:30.338096  7644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.040s
I20260501 13:59:30.335489  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1556) took 1054 ms. Trace:
I20260501 13:59:30.328574  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.328210  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.325326  7677 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260501 13:59:30.309103 10128 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.279064 10129 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.351680  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.321972 10139 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.328116 10142 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:30.329041 10132 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260501 13:59:30.339102  7746 rpcz_store.cc:276] 0501 13:59:29.280954 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.282223 (+  1269us) service_pool.cc:224] Handling call
0501 13:59:29.282553 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:29.678759 (+396206us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:29.678790 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:29.682412 (+  3622us) log.cc:844] Serialized 26 byte log entry
0501 13:59:30.224398 (+541986us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:30.224453 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:30.224553 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:30.335164 (+110611us) raft_consensus.cc:1685] finished
0501 13:59:30.335195 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:30.335384 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3498,"raft.queue_time_us":111754,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":11768,"thread_start_us":876579,"threads_started":2,"wal-append.queue_time_us":630888}
W20260501 13:59:30.326098 10136 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 13:59:30.336249 10150 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.322328  9919 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.376154 10071 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.376605  9919 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.368741 10140 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.377486 10094 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:30.377341 10140 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:30.378489 10002 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.001s
I20260501 13:59:30.369305 10093 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.380173  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1242) took 1068 ms. Trace:
I20260501 13:59:30.381253 10152 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.380542  7676 rpcz_store.cc:276] 0501 13:59:29.312872 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.393457 (+ 80585us) service_pool.cc:224] Handling call
0501 13:59:29.410697 (+ 17240us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:29.411176 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:29.411219 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:29.443359 (+ 32140us) log.cc:844] Serialized 26 byte log entry
0501 13:59:29.651868 (+208509us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:29.651918 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:29.651987 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:30.379950 (+727963us) raft_consensus.cc:1685] finished
0501 13:59:30.379974 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:30.380111 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":14543,"thread_start_us":98951,"threads_started":1,"wal-append.queue_time_us":301036}
I20260501 13:59:30.381814 10152 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.368964 10139 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.332806 10141 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.365837 10128 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.384133 10141 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.385816  9919 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.386171 10128 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.279503 10120 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.386502  9919 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.387310 10033 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:30.319891 10065 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.388489 10120 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.374537 10150 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.388751  9919 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.373760  7748 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:30.371696 10129 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.379513 10140 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.384341 10139 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.331187 10144 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.390424 10150 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.332573 10082 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.326583 10146 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.180s
I20260501 13:59:30.373389 10142 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.335439 10147 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:30.386171 10141 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.329963 10064 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.406427  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:30.349927  9937 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.397668  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:30.391516 10069 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:30.446177  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 178546us
W20260501 13:59:30.449853  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 52312us
I20260501 13:59:30.452371  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.453258  7675 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:30.404228 10094 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:30.456604  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:30.462886  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56563.7us
I20260501 13:59:30.410220 10152 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.466325  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:30.410926 10099 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.428345 10142 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:30.441920 10147 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.468122  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:30.473507  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:30.456691 10150 raft_consensus.cc:2764] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260501 13:59:30.482789  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:30.473482 10156 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260501 13:59:30.469905 10082 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:30.489516  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.492962  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:30.459970 10141 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260501 13:59:30.478361 10147 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:30.481487 10064 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:30.501772  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.502801  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.501016  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.486907 10152 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:30.489391 10139 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:30.492062  9881 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.506162 10157 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:30.512171  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.471097 10094 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.519973 10161 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:30.520426 10094 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.520552 10161 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.474699 10099 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:30.522429 10011 consensus_meta.cc:287] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.058s	user 0.011s	sys 0.000s
I20260501 13:59:30.522881 10161 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.523097 10011 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:30.523519 10099 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:30.528093  7745 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:30.426431 10144 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.523478 10011 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.549345  7679 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260501 13:59:30.550419  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.501690 10072 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.554369  8376 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260501 13:59:30.501454  9820 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:30.555732  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.548585 10011 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:30.557765  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 64919.7us
I20260501 13:59:30.562418  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1249) took 1108 ms. Trace:
I20260501 13:59:30.564298 10158 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:30.562956  7672 rpcz_store.cc:276] 0501 13:59:29.454139 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.593546 (+139407us) service_pool.cc:224] Handling call
0501 13:59:29.614890 (+ 21344us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:30.260481 (+645591us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:30.260525 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:30.273084 (+ 12559us) log.cc:844] Serialized 26 byte log entry
0501 13:59:30.473341 (+200257us) raft_consensus.cc:1645] Marking committed up to 1
0501 13:59:30.473388 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:30.473459 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:30.562153 (+ 88694us) raft_consensus.cc:1685] finished
0501 13:59:30.562183 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:30.562342 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10081,"raft.queue_time_us":47369,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":18329,"thread_start_us":809367,"threads_started":2,"wal-append.queue_time_us":272531}
I20260501 13:59:30.564509  7678 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260501 13:59:30.567552 10145 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260501 13:59:30.500628 10118 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260501 13:59:30.569646 10118 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:30.513417 10139 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:30.570080 10118 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:30.570396 10139 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:30.525861  9937 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:30.510848 10151 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260501 13:59:30.513931 10064 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:30.570995 10022 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.604317  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.371146  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:30.605612  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1251) took 1151 ms. Trace:
I20260501 13:59:30.571194 10118 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.606051  7677 rpcz_store.cc:276] 0501 13:59:29.454589 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:30.139747 (+685158us) service_pool.cc:224] Handling call
0501 13:59:30.158975 (+ 19228us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:30.342347 (+183372us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:30.605317 (+262970us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540019cb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:30.605529 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381717248}
I20260501 13:59:30.606802 10118 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:30.607384  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.573900  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.644784  7675 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:30.577646  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.579931 10133 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.612076 10158 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:30.498927 10096 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.554924  8376 pending_rounds.cc:85] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 4
I20260501 13:59:30.614768 10142 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.616806  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.617467  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.619019  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.620707  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.659533  7679 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:30.580215  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1253) took 1125 ms. Trace:
I20260501 13:59:30.621222  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.584395  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:30.661437  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:30.662009  7745 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:30.662461  7745 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:30.663436  7745 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.664760  7745 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:30.585914 10064 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.623946  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.625917  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.628871  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.630797  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:30.633062  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.637396  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:30.637850  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:30.638832  7824 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:30.679349  7820 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:30.589270  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.596202  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:30.680434  7746 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:30.680894  7746 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:30.600310  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.602797  7753 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260501 13:59:30.645419  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 135286us
I20260501 13:59:30.648885  8376 pending_rounds.cc:107] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260501 13:59:30.683220  8376 raft_consensus.cc:2889] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:30.660128  7674 rpcz_store.cc:276] 0501 13:59:29.455001 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:30.141577 (+686576us) service_pool.cc:224] Handling call
0501 13:59:30.141852 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:30.276780 (+134928us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:30.579947 (+303167us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b54003f3754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:30.580151 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127631232}
I20260501 13:59:30.685129  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.686187  7674 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:30.687161  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:30.649631  7670 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.651336  7677 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:30.654285  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:30.691000  7826 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:30.655242  7671 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:30.694332  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.694805  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.695277  7822 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:30.695987  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.658201  7676 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:30.697647  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:30.704834  7576 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 7, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:30.707775  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:30.726049  7746 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.727150  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38240 (request call id 1239) took 1377 ms. Trace:
I20260501 13:59:30.727373  7746 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:30.727566  7670 rpcz_store.cc:276] 0501 13:59:29.311096 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.380414 (+ 69318us) service_pool.cc:224] Handling call
0501 13:59:30.595128 (+1214714us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54000c0b54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6d8e1d 00007fb2ff6b7390 00007fb2f8c2e3b4 00007fb2f8c2e342 00007fb2f8c2e271 00007fb2f8c2e1ec 00007fb2f8c2d4a2 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:30.688354 (+ 93226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164753792}
I20260501 13:59:30.556257 10002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60254 (request call id 610) took 4050 ms. Trace:
I20260501 13:59:30.764222  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:30.767916  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60246.9us
I20260501 13:59:30.768569  8381 raft_consensus.cc:2368] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6.
I20260501 13:59:30.766284  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45436 (request call id 389) took 1314 ms. Trace:
I20260501 13:59:30.718051  7576 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 4, now has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:30.769496  7825 rpcz_store.cc:276] 0501 13:59:29.412520 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.412686 (+   166us) service_pool.cc:224] Handling call
0501 13:59:30.589080 (+1176394us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:30.726602 (+137522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56650112}
I20260501 13:59:30.778859  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.588701 10144 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:30.779738  7822 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:30.780160  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:30.786624  7821 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:30.775563  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:30.694186 10133 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:30.678406 10082 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:30.786015  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.795606  7643 leader_election.cc:400] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6.
W20260501 13:59:30.795845  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:30.796051  7643 leader_election.cc:403] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:30.726449 10098 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:30.626531 10147 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.793496  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.648399 10011 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.775305  8371 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:30.820545  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:30.804906  7745 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
W20260501 13:59:30.821242  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:30.808597  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:30.808676  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.821976  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 286) took 8020 ms. Trace:
I20260501 13:59:30.822683  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.728310 10078 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:30.763000  8372 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:30.787432  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.824782  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.825189  7826 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:30.825883  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:30.812651  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 251665us
I20260501 13:59:30.826400  7825 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:30.763355  7749 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:30.829514  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.831017  7822 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:30.830818 10158 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.832180 10162 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 13:59:30.807078 10065 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260501 13:59:30.840170  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:30.787153 10150 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260501 13:59:30.849748  7821 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:30.850745  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.852363  7746 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
W20260501 13:59:30.852458  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:30.822340  7577 rpcz_store.cc:276] 0501 13:59:22.801179 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:22.801376 (+   197us) service_pool.cc:224] Handling call
0501 13:59:30.821903 (+8020527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:29.204196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:29.204782 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:29.204812 (+    30us) write_op.cc:435] Acquired schema lock
0501 13:59:29.204831 (+    19us) tablet.cc:662] Decoding operations
0501 13:59:29.205152 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:29.205234 (+    82us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:29.205262 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:29.205447 (+   185us) tablet.cc:701] Row locks acquired
0501 13:59:29.205464 (+    17us) write_op.cc:260] PREPARE: finished
0501 13:59:29.205612 (+   148us) write_op.cc:270] Start()
0501 13:59:29.205724 (+   112us) write_op.cc:276] Timestamp: P: 1777643969205556 usec, L: 0
0501 13:59:29.205752 (+    28us) op_driver.cc:348] REPLICATION: starting
0501 13:59:29.206461 (+   709us) log.cc:844] Serialized 533 byte log entry
0501 13:59:29.475913 (+269452us) op_driver.cc:464] REPLICATION: finished
0501 13:59:29.739723 (+263810us) write_op.cc:301] APPLY: starting
0501 13:59:29.739853 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:29.739963 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:29.740093 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:29.781050 (+ 40957us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:29.781309 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:29.781381 (+    72us) write_op.cc:312] APPLY: finished
0501 13:59:29.781676 (+   295us) log.cc:844] Serialized 23 byte log entry
0501 13:59:29.782747 (+  1071us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:29.782863 (+   116us) write_op.cc:454] Released schema lock
0501 13:59:29.782920 (+    57us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:29.783370 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:29.783398 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":131855,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":263477,"apply.run_cpu_time_us":5761,"apply.run_wall_time_us":43645,"num_ops":1,"prepare.queue_time_us":108679,"prepare.run_cpu_time_us":2611,"prepare.run_wall_time_us":2610,"replication_time_us":228514,"thread_start_us":246682,"threads_started":2}]]}
I20260501 13:59:30.808272 10072 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 6
I20260501 13:59:30.882001  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.870863  8380 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:30.796978 10099 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260501 13:59:30.883268  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.806455 10133 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.888679  7824 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:30.870190  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:30.863178 10144 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:30.902913  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:30.813782 10082 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.867920  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.904934  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.877386 10033 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:30.908026  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.843708 10139 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:30.947963  7819 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:30.958587  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:30.954469  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.955101  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:30.828428 10098 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.963646  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:30.976133  7753 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:30.948666  8375 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:30.997680  7825 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:31.009756  7746 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:31.013893  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.015622  7752 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
W20260501 13:59:31.028983  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:31.025787  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:31.036131  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 353215us
I20260501 13:59:30.974929  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:31.040944  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.041908  7752 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:31.047509  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:31.010763 10173 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260501 13:59:30.954389 10144 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:30.962538 10033 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.011988 10174 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:31.051350  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.063930  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.030053 10142 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.063107  7745 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:31.025930 10096 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.082111  7752 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:31.057240  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.090375 10125 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.090473  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.091022 10125 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:31.091483 10177 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260501 13:59:31.092900  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:31.093139 10125 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.093519  7821 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:31.093689 10086 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:31.094554  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.059592 10146 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:31.095175 10146 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:31.095542 10146 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:31.095371 10174 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.096136  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 394) took 1179 ms. Trace:
I20260501 13:59:31.096540  7827 rpcz_store.cc:276] 0501 13:59:29.916849 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:30.613181 (+696332us) service_pool.cc:224] Handling call
0501 13:59:30.613599 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:30.613998 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:30.614026 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:30.614560 (+   534us) log.cc:844] Serialized 26 byte log entry
0501 13:59:30.788487 (+173927us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:30.788538 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:30.788613 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:31.095906 (+307293us) raft_consensus.cc:1685] finished
0501 13:59:31.095931 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:31.096076 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1316,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":173518,"threads_started":1,"wal-append.queue_time_us":262527}
I20260501 13:59:31.097671 10174 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.098956 10098 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.099893  7749 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 13:59:31.100284  7749 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:31.101162  7749 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.102375  7749 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 1 FOLLOWER]: Advancing to term 2
I20260501 13:59:31.094296 10086 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.105439 10086 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.105996 10139 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.106069  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:31.108290 10175 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:31.108716 10175 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.109086 10175 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:30.775321 10002 rpcz_store.cc:276] 0501 13:59:26.478538 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:26.478677 (+   139us) service_pool.cc:224] Handling call
0501 13:59:26.495351 (+ 16674us) log.cc:844] Serialized 494 byte log entry
0501 13:59:30.497867 (+4002516us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30067,"raft.run_cpu_time_us":888,"raft.run_wall_time_us":888,"thread_start_us":76999,"threads_started":1,"wal-append.queue_time_us":152405,"wal-append.run_cpu_time_us":7872,"wal-append.run_wall_time_us":1020848}
I20260501 13:59:31.112111 10011 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:31.112890  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:31.050215 10007 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:31.107668  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:31.113700 10007 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.116080  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 1f875366331345f08d2e236a76c1c71d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:59:31.117098 10144 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.089553 10151 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:31.052312  8372 raft_consensus.cc:1813] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Handling vote request from an unknown peer ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.118075 10151 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.118889  8372 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:31.119814  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.082964  7823 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:31.121119  7828 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:31.128126  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.128909  7820 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:31.136857  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.137389  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.138954  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.140265  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.142741  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.039705  9981 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
I20260501 13:59:31.136735  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:31.142817  7821 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:31.149564  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.151077  7824 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:31.152745  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:31.153349  7752 raft_consensus.cc:606] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.122541 10007 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.153775  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.154567  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.154897  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.131155 10118 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:31.157153  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.143293  9937 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.143456 10147 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.162564  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.148953 10164 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:31.157759  9914 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:31.152902 10023 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.131593 10011 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260501 13:59:31.176326 10082 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.159478 10118 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.177363 10118 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:31.169405 10189 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.087s	user 0.002s	sys 0.006s
I20260501 13:59:31.182425 10011 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:31.182433 10188 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:31.183241 10011 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:31.184258 10164 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:31.169512  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.170928  7749 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:31.185109 10184 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:31.165472 10162 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.185263 10164 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.181785  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.187698 10011 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.183251 10188 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.188627 10133 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.185847 10184 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.190006 10072 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6.
I20260501 13:59:31.173449 10002 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:31.190924 10002 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.166256 10092 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:31.173230 10149 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260501 13:59:31.192030  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.192739 10184 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.194015  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.194559 10002 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.195060  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.195468 10151 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.195796 10188 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.200729  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:31.201431  7749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:31.202243  7749 raft_consensus.cc:606] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.202819  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.210741  9981 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.208581 10011 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:31.153283 10146 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.216291 10146 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.215917 10011 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:31.217168  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:31.217782  7751 raft_consensus.cc:606] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:31.217867  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 397474us
I20260501 13:59:31.220644  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.222781  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.219954 10078 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:31.228993  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.229657  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.229398 10078 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.232079  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:31.232511  7754 raft_consensus.cc:2368] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:31.234119  7754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:31.234789  7754 raft_consensus.cc:606] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.232002 10068 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.239144  9981 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:31.243062  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:31.244200  9919 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.244784  9919 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.246579 10129 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:31.246941  9919 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:31.247301  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:31.247455  9919 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.239975 10071 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.250945 10165 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.249153 10150 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.252543 10069 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.249246 10158 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.254055 10068 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.254626 10138 raft_consensus.cc:476] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Not starting pre-election -- already a leader
I20260501 13:59:31.285136  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.254712  8375 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 2.
I20260501 13:59:31.256668  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.257341  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:31.288296  7828 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:31.289086  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.257989 10175 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.258459  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.259608 10137 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.261201  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.261777  7673 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:31.289947  7676 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:31.266832  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.274962 10023 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.272681  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.275393  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.281816  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.283249  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.269815  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:31.294697  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:31.295235  7824 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:31.297226 10078 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:31.305754  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 148714us
I20260501 13:59:31.306591  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.278391  9919 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.307767 10064 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:31.297191  9981 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:31.285485 10158 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.308486 10114 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:31.309171  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.287693 10068 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.310045 10158 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.311988  7679 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:31.285130 10069 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.309937 10064 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:31.314159 10069 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.315460  7824 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:31.317435  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:31.318480  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.319176  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.298924 10002 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260501 13:59:31.280978 10165 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.324710 10165 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.297421 10137 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.327193 10137 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.284250 10150 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.327992 10033 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:31.328941  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:31.329217 10150 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.278587 10071 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.330776 10152 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:31.331496 10071 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.311653 10068 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.321875  9919 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.335656 10129 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:31.336511  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.337548  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:31.338512  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:31.331306 10152 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:31.376492  7670 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:31.347285  7754 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:31.349496  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:31.340636  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.385511  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.345707  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.346961  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.377884  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:31.389758  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49216.8us
I20260501 13:59:31.340991  7674 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:31.400353  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:31.401988 10187 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.209s	user 0.004s	sys 0.000s
I20260501 13:59:31.424749  9919 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:31.425195  9731 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:31.345893 10002 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:31.426970 10002 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:31.425307  9919 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:31.427774 10002 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.428510  9919 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:31.429014 10002 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:31.432132 10175 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:31.432667 10152 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.433126 10068 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:31.432178  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:31.436795  7826 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:31.440282  7792 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:31.441725 10171 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:31.443091  9914 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:31.446249 10071 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:31.446846 10071 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:31.447749 10071 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.425858  9731 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.339651 10078 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.618113  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:31.620864  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:31.620656  7822 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260501 13:59:31.484805 10186 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260501 13:59:31.627043  7747 raft_consensus.cc:606] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.627836  7747 raft_consensus.cc:614] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:31.389546 10150 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:31.634240  7822 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:31.634078  7643 leader_election.cc:400] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:31.635875  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:31.638931  7643 leader_election.cc:403] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260501 13:59:31.394506 10129 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:31.503336  9914 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.646939  8371 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260501 13:59:31.465093 10191 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:31.647779 10146 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:31.649546 10122 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:31.607244  9731 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:31.639377 10068 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader election won for term 2
I20260501 13:59:31.657693  7670 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:31.524631 10171 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:31.646852  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:31.672508  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.674860  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.680156  7747 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:31.685669  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.653055 10150 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:31.686946  7826 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:31.684595  9914 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.688549  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.668246  8371 pending_rounds.cc:85] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 6
I20260501 13:59:31.640298  9919 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.680759 10191 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:31.872776 10191 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:31.874084  8372 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:31.875629  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:31.832615  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.801275  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:31.877666  9914 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:31.877173  7671 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:31.695955  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260501 13:59:31.872025  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 157433us
W20260501 13:59:31.702930 10118 consensus_meta.cc:287] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260501 13:59:31.878077  8371 pending_rounds.cc:107] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260501 13:59:31.885212  8371 raft_consensus.cc:2889] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:31.885100 10118 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.886193  7820 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:31.880878  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:31.886408  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:31.668921 10129 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.757665 10138 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:31.690693  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:31.889022  8375 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:31.888656 10138 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.787237 10139 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:31.890846 10139 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.763589  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.756141  7824 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:31.893046  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 129553us
I20260501 13:59:31.888322 10118 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:31.894948 10146 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.895797 10146 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:31.898787 10146 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:31.901985  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:31.894153  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:31.769496 10133 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:31.914168 10133 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.917366 10133 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:31.918586  8375 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:31.919872 10114 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.925179  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:31.925997  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:31.928457 10175 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:31.930073  7678 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:31.939365  7748 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:31.931602  9919 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:31.933777  7673 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
W20260501 13:59:31.948526  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54518.5us
I20260501 13:59:31.956770  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:31.932826 10137 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:31.973964  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.076150  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 102278us
I20260501 13:59:31.969482 10161 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:31.969283 10064 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:32.076339 10152 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:32.081238  7673 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:32.079089  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.090098  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:31.978777 10171 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:31.957011 10175 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.106600 10175 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:32.024717 10068 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:32.107754 10068 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.093616 10086 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:32.112349 10086 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:32.113235 10086 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.114290 10086 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.094237 10064 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:32.090487 10098 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:32.094902 10191 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:31.946698 10114 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.087227 10188 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:32.086192 10116 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260501 13:59:32.122072 10094 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:32.135831 10094 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:32.136200 10094 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:32.089032 10152 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:32.137032 10152 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:32.097788  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.139230  7673 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:32.140029 10139 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.121673 10064 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:32.142720 10064 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:32.102246  9919 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:32.104204 10150 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.116647  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:32.125339  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.147996 10098 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.150178 10098 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.129501 10114 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.152292 10139 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:32.152498  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 54833.1us
I20260501 13:59:32.089402 10138 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.121802 10171 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:32.134455 10200 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260501 13:59:32.135142 10082 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:32.154560  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.157334 10082 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:32.162715  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.180478  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.157622 10171 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:32.162690  9919 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:32.197219  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 423751us
I20260501 13:59:32.187079 10098 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:32.153290 10188 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.189587 10138 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:32.205595  7825 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:32.207032  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.199740 10114 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:32.321429  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.334522  7826 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
W20260501 13:59:32.334729  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 244732us
I20260501 13:59:32.336299  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:32.337071  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.207484  9731 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:32.343185  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.347968  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1277) took 1009 ms. Trace:
I20260501 13:59:32.338361 10133 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260501 13:59:32.348367  7676 rpcz_store.cc:276] 0501 13:59:31.338165 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:31.338748 (+   583us) service_pool.cc:224] Handling call
0501 13:59:31.339065 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:31.344499 (+  5434us) raft_consensus.cc:1534] Early marking committed up to index 3
0501 13:59:31.359499 (+ 15000us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:31.360611 (+  1112us) log.cc:844] Serialized 26 byte log entry
0501 13:59:31.641778 (+281167us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:31.641819 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:31.641886 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:32.133899 (+492013us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:32.339788 (+205889us) raft_consensus.cc:1685] finished
0501 13:59:32.339829 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:32.347898 (+  8069us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7761,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":10832256,"thread_start_us":109628,"threads_started":1,"wal-append.queue_time_us":383937}
I20260501 13:59:32.205258  9919 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.357177  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:32.345818  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.500s (SENT) [suppressed 25 similar messages]
I20260501 13:59:32.344808 10080 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260501 13:59:32.339427 10086 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:32.348698 10137 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:32.376574  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.377848  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.378569  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.379842 10158 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:32.380194 10002 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:32.380640 10002 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:32.213274 10082 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.381208 10188 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.381589 10082 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:32.381433 10002 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.341714 10114 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.382702 10002 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.384141 10114 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:32.353560  9731 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.402148  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:32.403848 10129 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:32.404259 10129 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:32.404592 10129 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.406142  9919 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.406013 10064 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.374996 10086 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.409226  9731 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.410873 10086 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.345273 10151 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260501 13:59:32.413112 10129 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.413484 10151 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:32.413954 10094 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.414415 10151 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:32.415982  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.415498 10151 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.358374 10139 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:32.422230  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44464.4us
W20260501 13:59:32.422438  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 74811us
I20260501 13:59:32.423064  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:32.424409  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:32.428195  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.373096 10011 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:32.437552  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.440578  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.437686 10011 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.418900 10098 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:32.374774 10137 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:32.490216  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:32.499692  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 53850.2us
I20260501 13:59:32.443583  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.450904  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.454504  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.501863  7822 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260501 13:59:32.432538 10203 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260501 13:59:32.432848 10211 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260501 13:59:32.431586 10198 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.025s	sys 0.055s
W20260501 13:59:32.432076 10205 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260501 13:59:32.421200 10082 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:32.459774  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.505620  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.447340  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.431905 10212 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:32.429587 10022 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:32.525957  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.429884 10138 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.532130  8381 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:32.508143  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.508066  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.433037 10155 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:32.513338  7822 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260501 13:59:32.431794 10208 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.438519 10151 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:32.432367 10201 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260501 13:59:32.536206 10072 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:32.544344 10072 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.545217  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.546518 10072 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.520468 10130 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:32.547207 10130 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.548276  7823 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:32.514611  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.474517  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:32.515610  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 112514us
I20260501 13:59:32.516831  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.518257  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:32.555627  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.556416  7824 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 13:59:32.558748  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.559556  7824 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:32.442144 10191 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.563211 10130 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.523552 10078 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:32.573084  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.502808 10137 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.500212 10122 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:32.445645 10098 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:32.524623  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.612203  7823 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:32.442977  9919 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:32.503726 10184 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:32.515283 10086 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:32.533892  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 188097us
I20260501 13:59:32.515128 10081 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:32.535682  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.526430 10022 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:32.538906  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:32.538815  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.539243  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.540274  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.541700  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.511313 10161 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260501 13:59:32.520239  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.434733 10064 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.522188 10094 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.578755  8381 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:32.579782  7750 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:32.586145  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.549835 10155 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:32.431900 10110 consensus_queue.cc:1175] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca8dd10afb304b4c96cfcec7e2309947" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260501 13:59:32.530516 10212 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.534271 10082 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.588912  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:32.588924  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.589763  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.591305  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.672734  7745 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:32.673899  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:32.618782 10078 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260501 13:59:32.598347  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:32.605854  7824 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 13:59:32.609844  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.678797  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 69001.4us
I20260501 13:59:32.680160  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.618592  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55338.1us
I20260501 13:59:32.621897  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.577914 10152 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.564323 10146 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:32.646847  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:32.620102 10098 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.648406  7677 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:32.651032 10022 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.666617  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.670580  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:32.674685  7745 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:32.596091  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:32.670248 10209 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260501 13:59:32.618949 10122 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.676155  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.621202 10138 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260501 13:59:32.677175  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:32.650166 10081 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.686936  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.708317  7754 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 13:59:32.711989  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.683188  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.697743  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.691881  7746 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:32.647985 10086 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.664870 10129 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.633050 10184 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.705395  8375 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260501 13:59:32.715390  7750 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:32.684084 10133 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:32.697655  7751 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:32.675158 10094 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260501 13:59:32.720316  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.696640 10072 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:32.702131 10011 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.730988  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.714355  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.726797  7753 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:32.697388  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.734400  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:32.737766  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.715859 10165 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:32.739413  7748 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260501 13:59:32.736982  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.749191  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 139325us
I20260501 13:59:32.751096  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.754791  8376 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:32.756280  8376 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:32.723556 10116 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:32.695788 10146 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.762338  8379 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:32.763080  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.739127 10129 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.741369 10133 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.770159  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:32.748782 10130 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:32.755040 10069 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:32.775734  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.777320 10068 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260501 13:59:32.778503 10227 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260501 13:59:32.788684 10184 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.788766 10212 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.778803 10078 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:32.789373 10158 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:32.789497 10078 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:32.790001 10078 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:32.771294 10165 consensus_queue.cc:1059] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260501 13:59:32.789901 10158 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.790799 10165 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:32.791157 10165 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:32.779008 10086 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.781960  7826 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:32.781934  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.782075  7820 raft_consensus.cc:2410] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260501 13:59:32.783736  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.783186  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.795042  7676 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 2.
I20260501 13:59:32.807042  7828 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
W20260501 13:59:32.819643  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 159227us
I20260501 13:59:32.821023  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:32.822732  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 110824us
I20260501 13:59:32.771203 10208 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.824676  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.829044  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2208) took 1143 ms. Trace:
I20260501 13:59:32.828667  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.832209 10033 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260501 13:59:32.832458 10228 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260501 13:59:32.833472  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:32.830925  7672 rpcz_store.cc:276] 0501 13:59:31.685712 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:31.686235 (+   523us) service_pool.cc:224] Handling call
0501 13:59:31.688867 (+  2632us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:31.702116 (+ 13249us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:31.702164 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:31.773276 (+ 71112us) log.cc:844] Serialized 582 byte log entry
0501 13:59:32.163681 (+390405us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:32.163722 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:32.163792 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:32.623741 (+459949us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:32.779909 (+156168us) raft_consensus.cc:1685] finished
0501 13:59:32.779933 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:32.828979 (+ 49046us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45862,"raft.queue_time_us":23306,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13319,"spinlock_wait_cycles":258585344,"thread_start_us":306664,"threads_started":1,"wal-append.queue_time_us":549466}
I20260501 13:59:32.835045  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.836472  8375 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:32.830924  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.838459  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:32.832612  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.842361  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.824967 10222 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260501 13:59:32.844535 10099 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:32.850422 10208 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:32.851260 10208 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.853945 10208 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:32.854889 10171 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.000s
I20260501 13:59:32.854959 10208 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:32.841468 10011 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260501 13:59:32.857864  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:32.858150  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.858455  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.859249 10208 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.833910 10158 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:32.863379 10206 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.524s	user 0.000s	sys 0.003s
I20260501 13:59:32.769412 10116 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.865423  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2301) took 1486 ms. Trace:
I20260501 13:59:32.866533 10116 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.828851 10086 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:32.865803  7749 rpcz_store.cc:276] 0501 13:59:31.378887 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:31.384278 (+  5391us) service_pool.cc:224] Handling call
0501 13:59:31.659378 (+275100us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800062798. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:31.659548 (+   170us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:31.660020 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:31.660052 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:31.660538 (+   486us) log.cc:844] Serialized 26 byte log entry
0501 13:59:32.088410 (+427872us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:32.117796 (+ 29386us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:32.124971 (+  7175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:32.775052 (+650081us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:32.865196 (+ 90144us) raft_consensus.cc:1685] finished
0501 13:59:32.865218 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:32.865360 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1776,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"spinlock_wait_cycles":36701312,"thread_start_us":329744,"threads_started":1,"wal-append.queue_time_us":531895}
I20260501 13:59:32.867404 10086 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.869598 10086 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.792104 10165 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.871366 10122 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.871666 10155 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:32.843350 10002 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:32.872761 10082 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.840987 10133 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:32.874166 10146 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.874434 10133 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.875296 10081 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.859169  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.876359 10133 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.877122 10152 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:32.877338 10133 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:32.878976  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.880272 10233 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:32.880805  9864 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 13:59:32.886795  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.859153  7672 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260501 13:59:32.888890  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44956.2us
I20260501 13:59:32.889652  7749 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260501 13:59:32.889966  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53461.2us
I20260501 13:59:32.890961  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.895797  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:32.836797 10130 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:32.846215 10072 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:32.888051 10068 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 13:59:32.905300  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 60863.5us
I20260501 13:59:32.891400 10158 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.843546 10231 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260501 13:59:32.855553 10171 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.911110  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 293) took 1120 ms. Trace:
I20260501 13:59:32.892858 10233 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:32.915302  7678 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:32.916627  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:32.910708 10137 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:32.899251 10081 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:32.933833  7822 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260501 13:59:32.922237  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:32.918771 10185 raft_consensus.cc:993] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:32.923525 10242 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:32.924456 10146 raft_consensus.cc:993] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:32.927134  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:32.928576 10233 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.932039  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.916045  7679 rpcz_store.cc:276] 0501 13:59:31.790325 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:31.887084 (+ 96759us) service_pool.cc:224] Handling call
0501 13:59:31.887412 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:32.194472 (+307060us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:32.194547 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:32.206591 (+ 12044us) log.cc:844] Serialized 26 byte log entry
0501 13:59:32.440642 (+234051us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:32.440698 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:32.440785 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:32.910879 (+470094us) raft_consensus.cc:1685] finished
0501 13:59:32.910902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:32.911043 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53380,"raft.queue_time_us":175048,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":12071,"thread_start_us":486759,"threads_started":2,"wal-append.queue_time_us":302122}
I20260501 13:59:32.949247 10081 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:32.955240 10151 raft_consensus.cc:1081] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:32.956089 10146 raft_consensus.cc:1081] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:32.957733 10081 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:32.959122 10081 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.961839  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:32.963250  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.961956  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:32.963804 10238 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:32.937141 10191 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260501 13:59:32.965513 10185 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:32.965947 10185 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:32.966379 10185 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:32.933768  9914 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:32.936084  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:32.938515  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:32.980093  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 44092.4us
W20260501 13:59:32.942317 10219 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.370s	user 0.002s	sys 0.000s
I20260501 13:59:32.944960  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:32.950384  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:32.970085  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:32.990176  7825 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:32.990332  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:32.991223  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 46344.7us
I20260501 13:59:32.987057  9864 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:32.941803 10137 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:33.002126  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:32.998202  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:32.998775  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:33.007577  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:33.000718  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:33.001812  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:32.972143  7828 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260501 13:59:33.009837  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:33.002564  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:33.012028  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:33.012667  7828 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:33.007259  9914 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:33.015947  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:33.016323  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.016948 10171 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:33.017493  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.018610  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.019114  7672 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:33.020008 10155 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:33.020591  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:33.021095 10138 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:33.016065  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.023289  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:33.061980  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:33.073185  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 61406.4us
I20260501 13:59:33.073884  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.074612  7673 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 13:59:33.078794  7828 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:33.020864 10098 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:33.081614  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.000756 10068 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:33.121479  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:33.121765  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 98568.3us
I20260501 13:59:33.016034  9914 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:33.125352  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 43828.4us
I20260501 13:59:33.125759  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:32.987236 10078 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.023113  9864 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:33.028172 10171 consensus_queue.cc:1059] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260501 13:59:33.223258  7671 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:33.254369  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:33.276959  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:33.126098  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:33.279946  7828 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:33.123751 10011 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:33.280381 10022 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.001s
I20260501 13:59:33.342212  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.124617 10033 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:33.220635 10129 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:33.339424  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.339423  7676 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:33.181852 10152 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260501 13:59:33.286135 10250 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260501 13:59:33.124970 10231 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:33.123690 10139 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.225s
I20260501 13:59:33.285166  9914 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:33.229547 10155 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:33.278405 10098 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:33.229159  9731 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:33.182113 10164 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:33.349169  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.344480  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.330555 10116 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260501 13:59:33.370436 10158 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260501 13:59:33.392241 10246 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260501 13:59:33.367321  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.345448 10011 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:33.348557 10022 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.126591 10240 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:33.500725  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:33.697695  7673 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:33.699083  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.699167 10188 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:33.700016  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:33.393028  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:33.702575  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:33.753203  7679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:33.753849  7679 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:33.754200  7679 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:33.639297  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:33.351390 10233 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:33.756392 10223 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 1.217s	user 0.004s	sys 0.000s
I20260501 13:59:33.697216  7672 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
W20260501 13:59:33.501618  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:33.758023  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 413491us
I20260501 13:59:33.758719 10165 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:33.758970 10086 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:33.759963  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.760736 10086 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:33.761176  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.758955 10164 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.763767  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 492) took 1173 ms. Trace:
I20260501 13:59:33.421775  9731 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.743971 10064 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:33.768736  7754 rpcz_store.cc:276] 0501 13:59:32.590422 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.711711 (+121289us) service_pool.cc:224] Handling call
0501 13:59:32.712210 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:32.781305 (+ 69095us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:32.781338 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:32.781390 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:32.781421 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.763467 (+982046us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b5400106dd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:33.763525 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:33.763694 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158425344}
I20260501 13:59:33.769904 10064 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.770290  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:33.770869  7754 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:33.721031  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:33.757164  7678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 13:59:33.456351 10247 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:33.773057 10072 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.861s	user 0.011s	sys 0.001s
I20260501 13:59:33.761993 10086 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:33.773629 10072 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:33.446137  9864 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.772516  7678 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
W20260501 13:59:33.564874  7745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.034s
I20260501 13:59:33.776026  7678 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:33.776106  7745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.009s	sys 0.040s
I20260501 13:59:33.777686  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:33.421571 10155 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.778831  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:33.723979  7823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.006s	sys 0.011s
I20260501 13:59:33.676811 10210 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:33.677047 10080 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:33.756186 10233 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:33.744082 10161 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:33.766814  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1278) took 1232 ms. Trace:
I20260501 13:59:33.699752  7673 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 2.
I20260501 13:59:33.746534  7748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1599) took 1163 ms. Trace:
I20260501 13:59:33.767742  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1596) took 1185 ms. Trace:
W20260501 13:59:33.761376 10185 consensus_meta.cc:287] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.002s
I20260501 13:59:33.779798  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:33.794813 10064 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:33.795364  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:33.796147  7754 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:33.762455  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:33.706934  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 581224us
I20260501 13:59:33.799224  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:33.780195  7823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.007s	sys 0.012s
I20260501 13:59:33.799257  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.801061  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:33.785416  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 294) took 1249 ms. Trace:
I20260501 13:59:33.801926  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.803298  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:33.785050  7748 rpcz_store.cc:276] 0501 13:59:32.583014 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.589005 (+  5991us) service_pool.cc:224] Handling call
0501 13:59:32.589272 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:32.748828 (+159556us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.746157 (+997329us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003aded4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:33.746446 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331750656}
I20260501 13:59:33.804813  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:33.802188  8381 rpcz_store.cc:276] 0501 13:59:32.536135 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.735865 (+199730us) service_pool.cc:224] Handling call
0501 13:59:32.736607 (+   742us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:32.750543 (+ 13936us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:32.750574 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:32.771909 (+ 21335us) log.cc:844] Serialized 582 byte log entry
0501 13:59:32.905892 (+133983us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:32.905948 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:32.906026 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:33.785185 (+879159us) raft_consensus.cc:1685] finished
0501 13:59:33.785206 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:33.785337 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14686,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":71409,"threads_started":1,"wal-append.queue_time_us":219792}
I20260501 13:59:33.809026  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1598) took 1226 ms. Trace:
I20260501 13:59:33.787801  7751 rpcz_store.cc:276] 0501 13:59:32.582029 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.585833 (+  3804us) service_pool.cc:224] Handling call
0501 13:59:33.767526 (+1181693us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54001068d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:33.767657 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84257536}
I20260501 13:59:33.784373  7671 rpcz_store.cc:276] 0501 13:59:32.534838 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.535007 (+   169us) service_pool.cc:224] Handling call
0501 13:59:32.535276 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:33.276263 (+740987us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.766489 (+490226us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54003606d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:33.766736 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581763968}
I20260501 13:59:33.810618  7746 rpcz_store.cc:276] 0501 13:59:32.582717 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.588565 (+  5848us) service_pool.cc:224] Handling call
0501 13:59:33.808831 (+1220266us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b54000adf54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:33.808958 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45984640}
I20260501 13:59:33.810963  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.813696  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.814863  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:33.815907  7678 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.817754  7678 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:33.688966 10251 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260501 13:59:33.822480  7677 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260501 13:59:33.822669  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.821691  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:33.821595  7746 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260501 13:59:33.824244  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.825361  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:33.360924 10129 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.827719  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:33.572464 10033 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:33.831387  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:33.792201 10261 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:33.813036 10086 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260501 13:59:33.808669 10082 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:33.833578 10139 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:33.835274  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 550370us
I20260501 13:59:33.529713  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:33.586292 10078 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:33.839349  7746 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:33.827147 10064 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:33.792366 10155 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:33.704087 10238 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:33.782166 10011 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:33.784776 10233 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:33.783108 10069 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:33.789753  9731 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:33.854835  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:33.856354  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:33.812723 10092 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:33.882663  8380 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:33.819679 10072 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:33.821346 10130 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:33.828105 10002 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:33.780797 10210 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.773061 10247 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.823930 10150 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:33.865746  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 494) took 1274 ms. Trace:
I20260501 13:59:33.792528 10185 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:33.839627 10137 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:33.836027 10138 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:33.874042  7746 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:33.874388  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1453) took 1323 ms. Trace:
I20260501 13:59:33.922386  7746 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.924170  7746 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:33.699831 10188 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.857169 10110 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:33.783841 10161 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:33.880541  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.007s
W20260501 13:59:33.959571  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.007s
I20260501 13:59:33.838409 10164 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:33.837188 10214 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260501 13:59:33.782529 10080 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.859401 10263 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:33.828480  9914 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.867393 10139 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:33.860715  7745 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:33.890779  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:33.892155  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.059767  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1612) took 1037 ms. Trace:
I20260501 13:59:34.060328  7745 rpcz_store.cc:276] 0501 13:59:33.022670 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.795079 (+772409us) service_pool.cc:224] Handling call
0501 13:59:34.059666 (+264587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:33.878175 10064 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:33.894122  7674 raft_consensus.cc:2410] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260501 13:59:33.901172  7752 rpcz_store.cc:276] 0501 13:59:32.591167 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.776720 (+185553us) service_pool.cc:224] Handling call
0501 13:59:33.767687 (+990967us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:33.767932 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:33.767964 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:33.768013 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:33.768047 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.768111 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:33.865518 (+ 97407us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54001068d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:33.865663 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278062976}
I20260501 13:59:33.918795  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:33.861126 10151 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260501 13:59:33.920547  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 117282us
I20260501 13:59:33.921898  7822 rpcz_store.cc:276] 0501 13:59:32.542027 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.542144 (+   117us) service_pool.cc:224] Handling call
0501 13:59:32.542437 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:32.936916 (+394479us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.864601 (+927685us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54002eac54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:33.864902 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899312896}
I20260501 13:59:33.886093 10155 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:33.885499 10092 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:33.894938 10098 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:33.859066 10261 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:33.887770 10082 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:34.018587  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.047230 10263 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:33.924212 10137 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:34.041884  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 205052us
I20260501 13:59:33.960016 10217 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:34.045745  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:33.885342 10069 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:33.956434  8373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 422) took 1378 ms (client timeout 1639 ms). Trace:
I20260501 13:59:33.895942 10258 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260501 13:59:33.883884 10238 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:34.072449  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 188852us
W20260501 13:59:34.073024  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 182318us
I20260501 13:59:34.077778  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.134285  7745 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:34.134689  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:34.084136  7679 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.103008  7746 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:34.107501  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1601) took 1523 ms. Trace:
I20260501 13:59:34.137255  7753 rpcz_store.cc:276] 0501 13:59:32.583655 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.589531 (+  5876us) service_pool.cc:224] Handling call
0501 13:59:34.107229 (+1517698us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54003ac5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:34.107401 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125545856}
I20260501 13:59:34.062824 10139 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:34.044617 10150 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.110064  7751 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:33.894465 10094 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.122032  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:34.092270 10155 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:34.092322 10185 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.096817 10092 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:33.900147 10255 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.159s
I20260501 13:59:34.119424 10263 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:34.156551  7679 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.114532 10082 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:34.120496 10137 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:34.231750  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 109816us
I20260501 13:59:34.244947 10080 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.246544 10069 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.248878  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:34.251109  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:34.139716 10068 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:34.108808 10098 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.252420  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:34.252992  7822 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:34.253649 10098 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.255407  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 499) took 1260 ms. Trace:
W20260501 13:59:34.256374 10257 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
W20260501 13:59:34.257413 10248 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.917s	user 0.004s	sys 0.000s
W20260501 13:59:34.257865 10254 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260501 13:59:34.259045  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 306) took 1250 ms. Trace:
I20260501 13:59:34.259363  7675 rpcz_store.cc:276] 0501 13:59:33.008703 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.008816 (+   113us) service_pool.cc:224] Handling call
0501 13:59:33.048219 (+ 39403us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:33.048773 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:33.048815 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:33.081140 (+ 32325us) log.cc:844] Serialized 26 byte log entry
0501 13:59:33.392911 (+311771us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:33.392953 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.393027 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.258836 (+865809us) raft_consensus.cc:1685] finished
0501 13:59:34.258859 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.258988 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24294,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":43038,"thread_start_us":169560,"threads_started":1,"wal-append.queue_time_us":759437}
W20260501 13:59:34.260471 10270 log.cc:927] Time spent T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260501 13:59:34.233104 10171 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:34.262108 10252 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260501 13:59:34.262034 10171 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.263404  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 424) took 1254 ms. Trace:
I20260501 13:59:34.126498 10217 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.263746  7819 rpcz_store.cc:276] 0501 13:59:33.009478 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.009598 (+   120us) service_pool.cc:224] Handling call
0501 13:59:33.016382 (+  6784us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:33.081046 (+ 64664us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:33.081085 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:33.124134 (+ 43049us) log.cc:844] Serialized 26 byte log entry
0501 13:59:33.469464 (+345330us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:33.469508 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.469611 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.261385 (+791774us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:34.263122 (+  1737us) raft_consensus.cc:1685] finished
0501 13:59:34.263144 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.263340 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105927,"raft.queue_time_us":104527,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3101,"spinlock_wait_cycles":5680000,"thread_start_us":342638,"threads_started":1,"wal-append.queue_time_us":752080}
I20260501 13:59:34.265810 10217 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:34.227175 10155 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:34.268285 10262 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260501 13:59:34.269392  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 422) took 1269 ms. Trace:
I20260501 13:59:34.241482 10276 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:34.270061 10276 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:34.271483 10253 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260501 13:59:34.143592 10129 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.273450 10064 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.269804  7823 rpcz_store.cc:276] 0501 13:59:32.999844 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.999961 (+   117us) service_pool.cc:224] Handling call
0501 13:59:33.000318 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:33.001730 (+  1412us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:33.001761 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:33.012984 (+ 11223us) log.cc:844] Serialized 26 byte log entry
0501 13:59:33.802043 (+789059us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:33.802101 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.802179 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.269190 (+467011us) raft_consensus.cc:1685] finished
0501 13:59:34.269212 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.269324 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1001,"raft.queue_time_us":6795,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":7267,"spinlock_wait_cycles":18816,"thread_start_us":772542,"threads_started":1,"wal-append.queue_time_us":882707}
I20260501 13:59:34.277109 10175 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:34.277561 10175 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:34.279338 10275 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:34.280028 10275 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:34.281971 10275 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.282778  7574 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 5, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:34.284478  7574 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:32.837862  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:34.285845  7574 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 5, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:34.287400  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1285) took 1278 ms. Trace:
I20260501 13:59:34.297189  7674 rpcz_store.cc:276] 0501 13:59:33.009326 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.009487 (+   161us) service_pool.cc:224] Handling call
0501 13:59:34.287113 (+1277626us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b540037e6d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:34.287317 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031047040}
I20260501 13:59:34.121754 10022 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.288748 10165 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:34.289319 10072 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.291043 10078 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:34.291498  9919 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.255764  7749 rpcz_store.cc:276] 0501 13:59:32.995180 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.995318 (+   138us) service_pool.cc:224] Handling call
0501 13:59:34.110865 (+1115547us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:34.111135 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:34.111172 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:34.111235 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:34.111281 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:34.111363 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.255229 (+143866us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003ac5d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:34.255339 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2564690304}
I20260501 13:59:34.287250  7574 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 5, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:34.092540 10259 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:34.298736  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:34.232261  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:34.316160  8380 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:34.316396  7822 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:34.320362  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1457) took 1528 ms. Trace:
I20260501 13:59:34.335916  7824 rpcz_store.cc:276] 0501 13:59:32.792138 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.793170 (+  1032us) service_pool.cc:224] Handling call
0501 13:59:32.793514 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:32.793864 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:32.793893 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:32.826706 (+ 32813us) log.cc:844] Serialized 26 byte log entry
0501 13:59:33.280871 (+454165us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b1800349de0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 13:59:33.702862 (+421991us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:33.702902 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:33.702972 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.303901 (+600929us) raft_consensus.cc:1685] finished
0501 13:59:34.303931 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.320260 (+ 16329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24468,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11830,"spinlock_wait_cycles":15319424,"thread_start_us":421783,"threads_started":1,"wal-append.queue_time_us":1036326}
I20260501 13:59:34.295313 10082 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:34.271212 10276 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.234637 10150 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.360024 10264 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:34.360638 10264 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.362771 10264 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.364780  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1607) took 1480 ms. Trace:
I20260501 13:59:34.365237  7747 rpcz_store.cc:276] 0501 13:59:32.884665 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.761296 (+876631us) service_pool.cc:224] Handling call
0501 13:59:33.761682 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:33.762057 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:33.762102 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:33.762772 (+   670us) log.cc:844] Serialized 26 byte log entry
0501 13:59:34.017292 (+254520us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:34.017549 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:34.017841 (+   292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.364543 (+346702us) raft_consensus.cc:1685] finished
0501 13:59:34.364568 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.364713 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2005,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":253374,"threads_started":1,"wal-append.queue_time_us":359106}
I20260501 13:59:34.242549 10094 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:34.123867  8373 rpcz_store.cc:269] 0501 13:59:32.532320 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.535202 (+  2882us) service_pool.cc:224] Handling call
0501 13:59:33.529333 (+994131us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:33.900100 (+370767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17236352}
W20260501 13:59:34.386402  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 300071us
I20260501 13:59:34.351603  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 429) took 1452 ms. Trace:
I20260501 13:59:34.353806 10258 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:34.328773 10133 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260501 13:59:34.329569 10165 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.334554 10078 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.398332  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.415180  7745 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:34.329411 10072 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:34.432005  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 297364us
I20260501 13:59:34.373013 10214 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.440960  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:34.367772 10238 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:34.446066  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:34.439991  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.446431  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.369663 10094 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:34.456532  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.389125 10130 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.449100  7748 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:34.341375  9919 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.391081 10188 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.472487  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.473196  7745 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:34.474009  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.474527  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:34.475394  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.476671  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.471130 10283 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:34.419603 10116 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:34.401337 10161 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:34.492405  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 199594us
I20260501 13:59:34.493510  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:34.495312  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:34.399389 10110 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.460999 10133 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:34.498879  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.502385  7824 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:34.510161  7824 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:34.478334 10022 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:34.512324  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 369151us
I20260501 13:59:34.486778 10151 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:34.485775 10185 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:34.523993  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:34.528647  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.495630 10150 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.528522  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.533228  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.536263  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:34.533869  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.507550 10133 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:34.479154 10130 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.540973  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.545900  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.445189 10258 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.546657  8380 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:34.548640  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:34.550323  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:34.551681  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.552367  8381 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:34.562211  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.460168 10214 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.510834 10110 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.575173 10110 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.547683 10208 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:34.576610 10208 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:34.577210 10208 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:34.578393 10208 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:34.581236 10278 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260501 13:59:34.583741 10281 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260501 13:59:34.562963  8375 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:34.497756 10116 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.569769 10284 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.530603 10210 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.570551 10130 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:34.570931 10282 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260501 13:59:34.531884 10289 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.497781 10283 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:34.605844  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55537.5us
I20260501 13:59:34.609048  7750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 498) took 1614 ms. Trace:
I20260501 13:59:34.661685  8377 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260501 13:59:34.659199  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:34.658987  7750 rpcz_store.cc:276] 0501 13:59:32.994513 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.994676 (+   163us) service_pool.cc:224] Handling call
0501 13:59:33.809624 (+814948us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:33.809992 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:33.810021 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:33.821231 (+ 11210us) log.cc:844] Serialized 26 byte log entry
0501 13:59:34.018209 (+196978us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:34.040378 (+ 22169us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:34.040463 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.314200 (+273737us) raft_consensus.cc:1685] finished
0501 13:59:34.314233 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.608633 (+294400us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54000adf50. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:34.608958 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7216,"raft.queue_time_us":489,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":10176,"spinlock_wait_cycles":1858972544,"thread_start_us":154016,"threads_started":1,"wal-append.queue_time_us":201119}
I20260501 13:59:34.665066  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:34.601675  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.616638 10261 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:34.615658 10258 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.615932  9919 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.616590 10247 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.617633 10072 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.530296 10151 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.618726 10185 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:34.525920 10022 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.562048 10129 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:34.544878 10011 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:34.559592 10080 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:34.551671 10002 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:34.650928  7754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.006s	sys 0.014s
I20260501 13:59:34.705719  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1613) took 1417 ms. Trace:
I20260501 13:59:34.608572  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:34.671219  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 175986us
I20260501 13:59:34.557021 10188 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260501 13:59:34.675940  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:34.651075 10133 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.397679  8374 rpcz_store.cc:276] 0501 13:59:32.894809 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:32.895002 (+   193us) service_pool.cc:224] Handling call
0501 13:59:32.895406 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:32.913395 (+ 17989us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:32.913450 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:33.737814 (+824364us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b2c0001ced8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 13:59:33.738539 (+   725us) log.cc:844] Serialized 26 byte log entry
0501 13:59:34.017239 (+278700us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:34.017509 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:34.017897 (+   388us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:34.296430 (+278533us) raft_consensus.cc:1685] finished
0501 13:59:34.313292 (+ 16862us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.346682 (+ 33390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15686,"raft.queue_time_us":23864,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":3868416,"thread_start_us":277748,"threads_started":1,"wal-append.queue_time_us":501069}
I20260501 13:59:34.694128 10185 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:34.696717 10283 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.664409 10272 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.670651 10212 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:34.670825 10110 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:34.706261  7754 rpcz_store.cc:276] 0501 13:59:33.287849 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.825109 (+537260us) service_pool.cc:224] Handling call
0501 13:59:33.825520 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:33.825803 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 13:59:34.069473 (+243670us) log.cc:844] Serialized 14 byte log entry
0501 13:59:34.705233 (+635760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:34.705314 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:34.705377 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:34.705469 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:34.705639 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11881,"prepare.queue_time_us":446092,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":136429,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":829675,"threads_started":3,"wal-append.queue_time_us":273025}
I20260501 13:59:34.652390 10284 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.677896 10078 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:34.715631  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 107282us
I20260501 13:59:34.690026 10165 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.720284  7677 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:34.718562 10130 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 13:59:34.664093 10289 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.711952 10122 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:34.770358 10122 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:34.762837  9731 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:34.731058  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:34.737753  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:34.771312 10122 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.772208  7674 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:34.772490 10122 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:34.705333 10080 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.773226 10080 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:34.774192 10002 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:34.747962 10296 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:34.748699 10072 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:34.749202 10240 consensus_meta.cc:287] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.004s
I20260501 13:59:34.705530 10011 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:34.751426 10137 consensus_meta.cc:287] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.006s
I20260501 13:59:34.744740 10129 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:34.728549  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:34.767943  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:34.762682 10092 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.002s
I20260501 13:59:34.723757 10191 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:34.749307  9919 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.739807 10212 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.799398 10212 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:34.790480 10116 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:34.783207  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.791131 10092 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.781873  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.739665 10110 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.802382 10110 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:34.804879  9919 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.767045 10130 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.781929  7828 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:34.783628 10139 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.008s
I20260501 13:59:34.763579 10078 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:34.798277  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 69893.7us
I20260501 13:59:34.780083 10022 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.764236 10214 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.801891  7746 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:34.776122 10296 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:34.809175  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:34.827358  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:34.828336  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.829525  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.833618  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.841369  7747 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 2.
I20260501 13:59:34.841470  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.835258  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.758224 10272 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.842350  7750 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:34.843952 10272 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.824754 10275 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:34.826543 10130 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:34.798144 10255 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:34.841511  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.837538  7746 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:34.881491  7746 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.883111  7746 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:34.884155  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.857583  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 267) took 5661 ms. Trace:
I20260501 13:59:34.888168  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.890762  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.891646  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.894948  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.901125  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.784474 10072 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.908919  8380 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:34.888952  8376 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:34.910213  7822 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:34.910893  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.789387 10137 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.920640  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:34.855111 10092 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.837874 10191 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:34.841763 10151 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:34.928988  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 332718us
I20260501 13:59:34.928871  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:34.931265  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.947568  7750 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:34.948340  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.933631  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.933836  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.950482  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.950837  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.952550 10175 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.940805 10256 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260501 13:59:34.959945 10155 consensus_meta.cc:287] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.010s
I20260501 13:59:34.960239 10256 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:34.960707 10256 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:34.960456 10155 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:34.962155 10251 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260501 13:59:34.963356 10155 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:34.945986  9919 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.964033  7821 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:34.964323  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.964524 10289 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.920806 10276 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:34.966648  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.838922 10078 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:34.968389 10191 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.969611 10078 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:34.970110  7675 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:34.971057 10137 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.835071 10139 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.937307  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.938439  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.938746  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.888233  7576 rpcz_store.cc:276] 0501 13:59:29.196237 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:29.196449 (+   212us) service_pool.cc:224] Handling call
0501 13:59:34.857497 (+5661048us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:31.092245 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:31.092861 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:31.092905 (+    44us) write_op.cc:435] Acquired schema lock
0501 13:59:31.092923 (+    18us) tablet.cc:662] Decoding operations
0501 13:59:31.093413 (+   490us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:31.093467 (+    54us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:31.093501 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0501 13:59:31.093781 (+   280us) tablet.cc:701] Row locks acquired
0501 13:59:31.093803 (+    22us) write_op.cc:260] PREPARE: finished
0501 13:59:31.093960 (+   157us) write_op.cc:270] Start()
0501 13:59:31.094080 (+   120us) write_op.cc:276] Timestamp: P: 1777643971093915 usec, L: 0
0501 13:59:31.094101 (+    21us) op_driver.cc:348] REPLICATION: starting
0501 13:59:31.094832 (+   731us) log.cc:844] Serialized 1222 byte log entry
0501 13:59:31.801316 (+706484us) op_driver.cc:464] REPLICATION: finished
0501 13:59:32.385123 (+583807us) write_op.cc:301] APPLY: starting
0501 13:59:32.385238 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:32.385361 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:32.385500 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:32.385889 (+   389us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:32.386074 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0501 13:59:32.386116 (+    42us) write_op.cc:312] APPLY: finished
0501 13:59:32.386315 (+   199us) log.cc:844] Serialized 29 byte log entry
0501 13:59:32.386500 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:32.386598 (+    98us) write_op.cc:454] Released schema lock
0501 13:59:32.386639 (+    41us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:32.518766 (+132127us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:32.521628 (+  2862us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40419,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":583502,"apply.run_cpu_time_us":1898,"apply.run_wall_time_us":1899,"num_ops":2,"prepare.queue_time_us":310408,"prepare.run_cpu_time_us":77190,"prepare.run_wall_time_us":223816,"raft.queue_time_us":373193,"raft.run_cpu_time_us":81354,"raft.run_wall_time_us":729225,"replication_time_us":706993,"thread_start_us":1223275,"threads_started":4,"wal-append.queue_time_us":331119,"wal-append.run_cpu_time_us":28763,"wal-append.run_wall_time_us":1964267}]]}
I20260501 13:59:34.939868  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:34.907325 10263 consensus_meta.cc:287] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.004s
I20260501 13:59:34.884688 10214 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:34.861115 10275 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:34.876583 10011 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:34.878468 10255 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.934839 10208 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:34.936224  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:34.973279  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:34.980535  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:34.980094  8380 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:34.951627 10072 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:34.989130  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.987906  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.997996  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:34.946650  7746 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:34.931941 10272 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.992630 10255 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:35.004159  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:35.005939  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:34.992507  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:34.995946  7826 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:34.927736 10161 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260501 13:59:34.979075 10002 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:34.982964 10214 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:34.986776  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:34.984539 10263 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:34.990554 10287 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:35.012706  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.014531  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.099699  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:35.111196  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 182452us
I20260501 13:59:35.078994  7746 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:35.122223  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.100942  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:35.127630  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:35.133683  7750 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:35.134532  8381 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
W20260501 13:59:35.142650  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 160392us
I20260501 13:59:35.144914  7675 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:35.152571  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 373523us
W20260501 13:59:35.110185 10082 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.754s	user 0.013s	sys 0.002s
I20260501 13:59:35.014266 10092 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:34.999606 10155 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:35.156015  7674 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:35.157042  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:35.158756  7674 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:35.156988  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.159847  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:35.160671  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.161226  7674 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:35.076107  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:35.164716  7820 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:35.138334 10214 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:34.989761 10118 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
I20260501 13:59:35.168740  7748 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:35.142176 10287 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:34.998920 10011 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260501 13:59:35.180998  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.181488  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:35.182109  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.088014 10284 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.009804 10272 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.010638 10208 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.182227  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.376083  7670 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:35.376374  7625 placement_policy_util.cc:244] tablet a769b271cb04497eb1cb86169399ceb2: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260501 13:59:35.380419 10315 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.277s	user 0.000s	sys 0.002s
I20260501 13:59:35.382807 10188 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:35.383253 10188 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:35.387295 10307 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.597s	user 0.000s	sys 0.004s
I20260501 13:59:35.184201  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:35.390187  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:35.171438 10155 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.377562  9914 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.390551 10188 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.391682 10188 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:35.378767  7672 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:35.390898  8372 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:35.398275 10099 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:35.369525 10072 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:35.369468 10252 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260501 13:59:35.399544 10072 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.401854 10072 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.147116 10275 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.405853  8373 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260501 13:59:35.165307 10092 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:35.408959 10263 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.409765 10094 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:35.402770 10130 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.403053 10133 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:35.225620  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:35.227587  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58456.4us
W20260501 13:59:35.414583  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.343364 10276 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:35.477663  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 427) took 1586 ms. Trace:
W20260501 13:59:35.482772  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.163928 10171 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:35.367883 10080 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.011s
W20260501 13:59:35.324939 10257 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260501 13:59:35.171082 10240 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:35.167277 10082 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:35.456458  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:35.550999  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.455103  7671 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:35.416483 10002 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:35.483982  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.478302  7820 rpcz_store.cc:276] 0501 13:59:33.891203 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:33.891339 (+   136us) service_pool.cc:224] Handling call
0501 13:59:33.891527 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:35.168175 (+1276648us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:35.477288 (+309113us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002ea254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:35.477568 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910098816}
I20260501 13:59:35.549453  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.425221 10287 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:35.492871  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:35.525960 10110 consensus_meta.cc:287] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.008s
I20260501 13:59:35.526117 10304 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:35.526986  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.434139 10092 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:35.541962  7752 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:35.428382 10086 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:35.326505 10296 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:35.545068  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.487989 10139 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.445052 10094 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:35.171257 10185 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.436903 10155 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:35.612406  7747 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:35.547878 10240 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:35.608829 10171 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:35.628391  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.628203 10171 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.629168  7750 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:35.630821 10171 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:35.631661 10324 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:35.548228 10080 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.639991  7745 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:35.658456  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.641052 10080 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.662317 10130 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.666179  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.529139 10276 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.564973 10304 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:35.632609 10240 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:35.682716 10311 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.462s	user 0.000s	sys 0.003s
W20260501 13:59:35.683236 10212 consensus_meta.cc:287] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.883s	user 0.007s	sys 0.010s
I20260501 13:59:35.683678 10212 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.707612 10212 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.568686 10110 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.639376 10324 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.719601 10208 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.722043 10324 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.717214 10238 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260501 13:59:35.724509 10238 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
W20260501 13:59:35.724705 10122 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.952s	user 0.010s	sys 0.005s
I20260501 13:59:35.725018 10238 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:35.725596  7754 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:35.726203 10238 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:35.727437  9731 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.951s	user 0.011s	sys 0.004s
I20260501 13:59:35.602658 10086 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.674516 10175 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:35.748234  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.749014  7670 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:35.749918  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.751008  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:35.751524  7670 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:35.752171  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.752997  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:35.753254  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.753598  7676 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:35.753937  7672 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:35.754693  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.755158  7672 raft_consensus.cc:1813] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Handling vote request from an unknown peer ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:35.759145  7679 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:35.761895 10318 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:35.755692  7672 raft_consensus.cc:2410] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260501 13:59:35.565616 10002 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.737205 10276 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.740510 10272 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.730611 10238 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:35.779219  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:35.745410 10082 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.762667 10318 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.778545 10110 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.735615 10086 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:35.787135  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.791296  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:35.781437 10208 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:35.810472  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.780679 10304 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.793974 10272 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:35.769174  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:35.814826  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45782.4us
I20260501 13:59:35.817363  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.818415  7754 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:35.782858  7671 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
W20260501 13:59:35.788401 10256 consensus_meta.cc:287] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.821s	user 0.013s	sys 0.000s
I20260501 13:59:35.812588  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:35.825466  7677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.060s	sys 0.160s
I20260501 13:59:35.812551 10138 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:35.822377 10208 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:35.825837  7677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.060s	sys 0.160s
I20260501 13:59:35.829841  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.832124  7674 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:35.833663  7670 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:35.823493 10171 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:35.845237  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:35.846081  7672 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:35.803074 10318 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.853477  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.851239 10295 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:35.861747 10185 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:35.869895  7671 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:35.728569 10094 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.827416 10138 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:35.844278 10002 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:35.823904 10256 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.866426 10304 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:35.805188 10092 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.865868 10276 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:35.813058 10240 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:35.893327 10094 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:35.894330 10214 consensus_meta.cc:287] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.001s
I20260501 13:59:35.844123 10171 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:35.873515  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.900748 10138 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:35.920207  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.920423  7670 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:35.923636  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:35.924823  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.015s	sys 0.046s
W20260501 13:59:35.925239  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.015s	sys 0.046s
W20260501 13:59:35.926023  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 666567us
W20260501 13:59:35.931960  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.919854 10171 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:35.928035  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:35.937291  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.938719  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:35.941591  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.944146  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:35.948989  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:35.949837  7746 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:35.953722  7747 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:35.878718 10295 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:35.958840  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:35.959444  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:36.139091  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:35.933027 10191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.012s	sys 0.042s
I20260501 13:59:35.914907 10276 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.050698  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:36.118830  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.176762  7820 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:35.922308 10214 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:35.998133  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.017s	sys 0.033s
I20260501 13:59:36.014097  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:35.957096 10324 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:35.997102  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:36.037331  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:35.956669 10155 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260501 13:59:35.960774  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:36.149109  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.191005  7750 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:36.140829  7674 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
W20260501 13:59:36.153904 10191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.012s	sys 0.043s
I20260501 13:59:36.146996  7747 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:36.193161  7747 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:36.147531  7745 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:36.144052  7752 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:36.197279  7822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.000s	sys 0.042s
I20260501 13:59:36.197798  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:36.142112  7672 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:36.161295  7746 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:36.161405  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:36.197777  7822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.000s	sys 0.042s
I20260501 13:59:36.140420  7676 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:36.162271  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:36.163424  8377 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:36.153043  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:36.166162 10276 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:36.168689 10175 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.169485 10238 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:36.171141  7825 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
W20260501 13:59:36.187579  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.020s	sys 0.040s
W20260501 13:59:36.204427  7749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.293s	user 0.000s	sys 0.034s
I20260501 13:59:36.204556  7752 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:36.212042  7749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.001s	sys 0.035s
I20260501 13:59:36.201058  7672 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260501 13:59:36.216180  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:36.217203  7672 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:36.206012  7676 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:36.208801  8375 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
W20260501 13:59:36.125854 10305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.023s	sys 0.052s
W20260501 13:59:36.230737 10287 consensus_meta.cc:287] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.005s
I20260501 13:59:36.231315  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1489) took 1161 ms. Trace:
I20260501 13:59:36.232055  7825 rpcz_store.cc:276] 0501 13:59:35.069991 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.070144 (+   153us) service_pool.cc:224] Handling call
0501 13:59:36.231005 (+1160861us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001f2054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:36.231225 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381774208}
I20260501 13:59:36.233388  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 857) took 1348 ms. Trace:
I20260501 13:59:36.233804  8375 rpcz_store.cc:276] 0501 13:59:34.885127 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:34.885290 (+   163us) service_pool.cc:224] Handling call
0501 13:59:34.935712 (+ 50422us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:36.219250 (+1283538us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:36.233153 (+ 13903us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540051e5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:36.233328 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927229312}
I20260501 13:59:36.211474 10175 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.237752 10175 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:36.194583 10324 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:36.238613 10324 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:36.217013 10255 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 1.148s	user 0.011s	sys 0.004s
I20260501 13:59:36.207175 10271 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.252256  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:36.240231 10305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.024s	sys 0.053s
I20260501 13:59:36.231323 10287 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.254680  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:36.257957  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:36.267040  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.265642 10240 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:36.266880 10191 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.300976 10327 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:36.302620  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.010s	sys 0.021s
I20260501 13:59:36.273603 10256 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:36.303136  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.010s	sys 0.022s
I20260501 13:59:36.279673 10092 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:36.306725  7675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.019s	sys 0.009s
W20260501 13:59:36.308602  7675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.019s	sys 0.009s
W20260501 13:59:36.308665  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.270927 10138 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.263266 10271 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.263041 10255 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.318320  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.301805 10327 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.326948  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.320838  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.327785  7828 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:36.322769  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.325387  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.329026  7670 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:36.327668  7821 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:36.329456  7826 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
W20260501 13:59:36.330788  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.332129  7823 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:36.328399  7820 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:36.335075  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.336817  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.335701  7823 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:36.337761  7819 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260501 13:59:36.339259  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:36.302613 10191 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.340044  7823 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:36.313711 10210 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:36.323359 10092 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:36.327711 10272 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.352169  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1311) took 1192 ms. Trace:
I20260501 13:59:36.334988 10214 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:36.352574  7677 rpcz_store.cc:276] 0501 13:59:35.160040 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.160642 (+   602us) service_pool.cc:224] Handling call
0501 13:59:35.160932 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:35.161373 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:35.161413 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:35.162005 (+   592us) log.cc:844] Serialized 26 byte log entry
0501 13:59:35.835989 (+673984us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:35.836030 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:35.836098 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:36.351958 (+515860us) raft_consensus.cc:1685] finished
0501 13:59:36.351981 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:36.352104 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157085,"raft.queue_time_us":104,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7325,"spinlock_wait_cycles":11520,"thread_start_us":673615,"threads_started":1,"wal-append.queue_time_us":1088009}
I20260501 13:59:36.336623 10295 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:36.340786 10208 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:36.380265  7671 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
W20260501 13:59:36.353545 10133 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.006s
W20260501 13:59:36.376780 10275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.013s	sys 0.009s
I20260501 13:59:36.397011  7673 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260501 13:59:36.375150 10266 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:36.349915 10210 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:36.415205  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.375583 10272 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.365250 10092 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.424144 10332 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:36.425871  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.435294 10324 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.405184 10287 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.462658 10155 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:36.461544 10332 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.467903 10155 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:36.400959 10275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.013s	sys 0.010s
I20260501 13:59:36.412858 10266 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.477754  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2226) took 1317 ms. Trace:
W20260501 13:59:36.470044 10319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.007s	sys 0.034s
W20260501 13:59:36.479238 10304 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.005s
I20260501 13:59:36.480053  7673 rpcz_store.cc:276] 0501 13:59:35.160860 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.162001 (+  1141us) service_pool.cc:224] Handling call
0501 13:59:36.477526 (+1315525us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001ecb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:36.477680 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347859712}
W20260501 13:59:36.469515 10288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.037s	sys 0.021s
I20260501 13:59:36.475373 10255 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.497488  7678 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:36.488183 10327 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.493563 10191 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.506470 10276 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:36.496964 10138 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:36.492730 10319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.007s	sys 0.034s
W20260501 13:59:36.511082  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.024s	sys 0.049s
I20260501 13:59:36.513795  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1305) took 1359 ms. Trace:
W20260501 13:59:36.518061  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.025s	sys 0.049s
I20260501 13:59:36.517367  7678 rpcz_store.cc:276] 0501 13:59:35.154066 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.154459 (+   393us) service_pool.cc:224] Handling call
0501 13:59:35.154718 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:36.508928 (+1354210us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:36.513513 (+  4585us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540004c9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:36.513732 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3087384960}
I20260501 13:59:36.515035 10276 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.528323  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:36.537672  7753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.015s	sys 0.053s
W20260501 13:59:36.541664  7753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.015s	sys 0.053s
I20260501 13:59:36.519508 10332 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:36.560310  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.566807  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 514) took 1653 ms. Trace:
I20260501 13:59:36.534847 10260 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:36.569384  7753 rpcz_store.cc:276] 0501 13:59:34.913820 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:34.914231 (+   411us) service_pool.cc:224] Handling call
0501 13:59:34.914585 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:34.914894 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 7
0501 13:59:34.920854 (+  5960us) log.cc:844] Serialized 14 byte log entry
0501 13:59:35.426972 (+506118us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b1800395020. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:35.448634 (+ 21662us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b1800395020. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fa6d9440 00007fb2fa6ebaf6 00007fb2fa6fc667 00007fb2fa6fc5e8
0501 13:59:36.566325 (+1117691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:36.566418 (+    93us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:36.566473 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:36.566561 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:36.566736 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4323,"prepare.queue_time_us":5069,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":34538,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":77165056,"thread_start_us":1093302,"threads_started":1}
W20260501 13:59:36.555909 10171 consensus_meta.cc:287] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.597s	user 0.016s	sys 0.000s
I20260501 13:59:36.535375 10271 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:36.525759 10155 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:36.520675 10288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.037s	sys 0.021s
I20260501 13:59:36.528018 10210 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:36.553427 10138 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:36.577225 10151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.029s	sys 0.043s
I20260501 13:59:36.553069 10272 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:36.538333 10080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.019s	sys 0.016s
I20260501 13:59:36.578199 10175 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:36.576679 10260 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.585700 10266 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:36.590579 10080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.019s	sys 0.021s
I20260501 13:59:36.578788 10171 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:36.593014  9731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.045s	sys 0.030s
I20260501 13:59:36.593003 10175 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:36.595679  7751 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.008s	sys 0.036s
W20260501 13:59:36.641252  7751 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.009s	sys 0.036s
I20260501 13:59:36.637295  7827 raft_consensus.cc:2368] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6.
W20260501 13:59:36.636405  9731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.045s	sys 0.031s
I20260501 13:59:36.646106 10175 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:36.650990 10171 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:36.638352 10266 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:36.652587 10266 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.654505 10266 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:36.656504  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.594565 10092 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:36.658128 10260 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:36.585912 10138 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.664619 10138 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.634630 10324 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.634071 10240 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:36.691447 10240 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.693773 10240 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.644496 10276 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:36.585052 10151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.029s	sys 0.043s
W20260501 13:59:36.595062  7679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.012s	sys 0.023s
W20260501 13:59:36.695770  7679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.012s	sys 0.023s
I20260501 13:59:36.697188 10324 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.697975 10324 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:36.699514  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:36.707741  7754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.025s	sys 0.063s
W20260501 13:59:36.708329  7754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.026s	sys 0.063s
W20260501 13:59:36.714224  7792 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.024s	sys 0.071s
W20260501 13:59:36.715154  7792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.025s	sys 0.072s
W20260501 13:59:36.715531  7822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.022s
W20260501 13:59:36.716073  7822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.009s	sys 0.022s
W20260501 13:59:36.715970  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 757169us
I20260501 13:59:36.719434  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1482) took 1777 ms. Trace:
I20260501 13:59:36.722216  7822 rpcz_store.cc:276] 0501 13:59:34.941779 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:34.951309 (+  9530us) service_pool.cc:224] Handling call
0501 13:59:34.951591 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:34.951810 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0501 13:59:35.076264 (+124454us) log.cc:844] Serialized 14 byte log entry
0501 13:59:36.718917 (+1642653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:36.719004 (+    87us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:36.719071 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:36.719177 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:36.719353 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41438,"prepare.queue_time_us":144021,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":32717,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":1642197,"threads_started":2,"wal-append.queue_time_us":1347716}
I20260501 13:59:36.738797  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.713479 10324 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.744048 10276 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.744949 10276 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.748060 10092 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:36.752597  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.754061  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:36.754185  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.755142  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:36.762751  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.748140 10276 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:36.766538  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.764066 10171 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:36.749333  9731 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260501 13:59:36.770965  7674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.021s
W20260501 13:59:36.790546  7674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.013s	sys 0.021s
W20260501 13:59:36.790840  7749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.034s
W20260501 13:59:36.791327  7749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.003s	sys 0.034s
W20260501 13:59:36.784226  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:36.799213  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.766829 10175 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:36.773571  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.764146 10266 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 13:59:36.815519  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.765069 10092 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260501 13:59:36.821641  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48187.6us
I20260501 13:59:36.773507 10334 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:36.827328  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.024s
W20260501 13:59:36.827651  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:36.836052  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.024s
W20260501 13:59:36.837455  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:36.822253 10092 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:36.843732  8380 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:36.853513  7675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.023s	sys 0.012s
I20260501 13:59:36.856534  8376 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:36.857743  7675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.023s	sys 0.012s
I20260501 13:59:36.858750  8377 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:36.825356 10175 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:36.855413  8375 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:36.862560  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1299) took 1719 ms. Trace:
W20260501 13:59:36.862808  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.023s	sys 0.014s
W20260501 13:59:36.863739  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.023s	sys 0.014s
I20260501 13:59:36.869726 10327 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260501 13:59:36.871793 10342 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:36.872191 10327 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:36.872785 10327 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:36.863018  7675 rpcz_store.cc:276] 0501 13:59:35.143861 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.144049 (+   188us) service_pool.cc:224] Handling call
0501 13:59:35.144467 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:35.144747 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 13:59:35.437395 (+292648us) log.cc:844] Serialized 14 byte log entry
0501 13:59:36.858642 (+1421247us) log.cc:844] Serialized 14 byte log entry
0501 13:59:36.860218 (+  1576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:36.860292 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:36.860372 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:36.860449 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:36.862479 (+  2030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10823,"prepare.queue_time_us":420449,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":15673,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3778,"thread_start_us":1407064,"threads_started":2,"wal-append.queue_time_us":1161093}
I20260501 13:59:36.869481 10324 consensus_queue.cc:1059] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260501 13:59:36.873778 10327 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.874776 10324 raft_consensus.cc:3055] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:36.875253 10324 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:36.875399 10327 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:36.868881 10328 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260501 13:59:36.876955 10191 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:36.844256  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:36.877461 10191 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:36.878916 10191 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.880407 10191 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:36.880381 10324 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.882167 10324 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:36.837494  7792 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.884872 10171 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:36.886001  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48616us
I20260501 13:59:36.886945  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.887977 10171 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:36.889686  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:36.897245  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:36.856588 10336 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:36.900660  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:36.911965  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 584999us
W20260501 13:59:36.924335  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 54734.5us
I20260501 13:59:36.860183 10092 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:36.932593 10138 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:36.933324  7753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:36.912923  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:36.908058  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:36.935402  7825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.023s	sys 0.085s
I20260501 13:59:36.898583 10336 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.952747  7753 raft_consensus.cc:606] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:36.956825  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:36.969255  7753 raft_consensus.cc:614] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:36.969738  7752 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:36.960250  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:36.966782  7825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.023s	sys 0.092s
I20260501 13:59:36.872545 10342 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.971102  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:36.930616 10171 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:36.916414 10338 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:36.981452  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:36.988336  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:36.989218  7750 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:36.980836 10210 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:37.008129 10276 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:37.008481 10210 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:37.008718 10276 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:36.997061 10338 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.010905 10276 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.010953 10338 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.011752 10171 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.013111 10171 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:36.983019  8373 raft_consensus.cc:1813] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Handling vote request from an unknown peer ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:36.990398 10255 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:37.023694  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1642) took 1080 ms. Trace:
W20260501 13:59:37.029486  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 438828us
I20260501 13:59:37.029551  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2240) took 1283 ms. Trace:
I20260501 13:59:37.030442  7679 rpcz_store.cc:276] 0501 13:59:35.746299 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.758567 (+ 12268us) service_pool.cc:224] Handling call
0501 13:59:35.758831 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:35.759027 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 13:59:35.859733 (+100706us) log.cc:844] Serialized 14 byte log entry
0501 13:59:37.028876 (+1169143us) log.cc:844] Serialized 14 byte log entry
0501 13:59:37.029125 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:37.029191 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:37.029259 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:37.029362 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:37.029490 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44464,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":483,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":1156884,"threads_started":2,"wal-append.queue_time_us":987020}
I20260501 13:59:37.036280  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:37.036748  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 69250.5us
I20260501 13:59:37.037021  7748 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:37.045219  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.046072  7746 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:37.048453 10191 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:37.047876  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:37.056386  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.058653  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:37.066067  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.042485 10260 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:37.060006  8373 raft_consensus.cc:2410] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260501 13:59:37.054056 10350 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:37.027410 10255 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.051607 10347 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.069660 10260 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.084189  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.025681  7754 rpcz_store.cc:276] 0501 13:59:35.942798 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.945318 (+  2520us) service_pool.cc:224] Handling call
0501 13:59:35.945623 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:35.945895 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 3
0501 13:59:36.708828 (+762933us) log.cc:844] Serialized 14 byte log entry
0501 13:59:37.023238 (+314410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:37.023305 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:37.023357 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:37.023442 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:37.023613 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":880823,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":3301,"raft.queue_time_us":187,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1378,"thread_start_us":881855,"threads_started":2}
I20260501 13:59:37.086277 10272 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:37.086472 10342 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:37.086907  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.108807  7748 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:37.091617  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.097795  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1628) took 2200 ms. Trace:
I20260501 13:59:37.110911  7749 rpcz_store.cc:276] 0501 13:59:34.897466 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:34.897676 (+   210us) service_pool.cc:224] Handling call
0501 13:59:34.898110 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:36.212450 (+1314340us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:36.212479 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:36.213028 (+   549us) log.cc:844] Serialized 26 byte log entry
0501 13:59:36.792029 (+579001us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:36.792101 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:36.792215 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:37.097523 (+305308us) raft_consensus.cc:1685] finished
0501 13:59:37.097546 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:37.097705 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3871,"raft.queue_time_us":33881,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":29341,"thread_start_us":1830571,"threads_started":2,"wal-append.queue_time_us":765502}
I20260501 13:59:37.064638 10346 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:37.103133  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44634.7us
I20260501 13:59:37.114965  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:37.051759 10328 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260501 13:59:37.107191  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55595.7us
I20260501 13:59:37.078939 10350 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:37.113771  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.119724  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.105373 10155 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.104635 10272 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:37.144209 10334 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:37.144816 10334 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.126823 10266 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:37.099270 10191 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:37.136049 10332 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:37.109081  9731 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:37.156216  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.162956  7746 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3.
I20260501 13:59:37.117767  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.164322  7749 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:37.168776  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 315) took 1359 ms. Trace:
I20260501 13:59:37.169251  7674 rpcz_store.cc:276] 0501 13:59:35.809931 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:36.192312 (+382381us) service_pool.cc:224] Handling call
0501 13:59:36.227873 (+ 35561us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:36.228225 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 6
0501 13:59:36.791039 (+562814us) log.cc:844] Serialized 14 byte log entry
0501 13:59:37.168345 (+377306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:37.168418 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:37.168473 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:37.168566 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:37.168710 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512129,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":932199,"threads_started":2}
W20260501 13:59:37.157037 10340 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260501 13:59:37.144709 10272 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.114899 10347 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.159320 10332 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:37.183501 10332 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.185384  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2357) took 1611 ms. Trace:
I20260501 13:59:37.118944 10346 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:37.186887  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.133963  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.185936  7751 rpcz_store.cc:276] 0501 13:59:35.574386 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:35.577353 (+  2967us) service_pool.cc:224] Handling call
0501 13:59:35.577718 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:36.702060 (+1124342us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:36.702109 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:36.704445 (+  2336us) log.cc:844] Serialized 26 byte log entry
0501 13:59:37.078743 (+374298us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:37.078783 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:37.078867 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:37.185060 (+106193us) raft_consensus.cc:1685] finished
0501 13:59:37.185091 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:37.185305 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84905,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":1489070,"threads_started":2,"wal-append.queue_time_us":469876}
W20260501 13:59:37.190342  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 72856.1us
I20260501 13:59:37.161085 10336 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.145090 10260 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.147807 10155 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.211699  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:37.212546  7751 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:37.213064  7751 raft_consensus.cc:614] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:37.214187  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.199746 10240 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260501 13:59:37.205701  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 224398us
W20260501 13:59:37.217785  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.202294 10272 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:37.194675  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60857.6us
I20260501 13:59:37.220618  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.230707  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.240813 10191 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.241417 10191 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:37.244385 10359 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260501 13:59:37.251245 10327 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:37.251654  8372 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260501 13:59:37.252094 10346 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.253715 10334 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.255875  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.194628  9731 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260501 13:59:37.258778  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.265404  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:37.266247  7746 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:37.266785  7746 raft_consensus.cc:614] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:37.219415 10240 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:37.273765  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.277400  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.260177 10069 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:37.278596  7748 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:37.279872 10240 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:37.286641  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.198541 10350 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.262955 10138 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:37.257483 10327 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:37.278268  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.270921 10334 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:37.270582 10260 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.276153 10338 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:37.270840 10255 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.278935 10275 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:37.300598  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.311071  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:37.312062  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:37.312743  7748 raft_consensus.cc:606] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:37.309221 10275 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:37.314690 10275 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:37.310949  8371 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:37.320446  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:37.321171  7748 raft_consensus.cc:606] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.321566  7748 raft_consensus.cc:614] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:37.323365  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:37.325556  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:37.326617  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:37.301169 10350 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.303560 10155 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.304105 10342 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.305199 10327 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.282866 10069 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.270442 10364 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260501 13:59:37.282902 10354 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:37.296569 10138 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.296890 10334 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.288719 10288 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:37.327771 10347 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.328049 10080 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:37.365262 10080 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:37.365753 10080 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:37.373629 10275 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.379117 10275 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.380543 10175 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.376169  7576 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.385221  7576 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:37.393038  7576 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 2 to 4, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:59:37.398805  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.333583 10327 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:37.333784 10069 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:37.332854 10342 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:37.348822 10138 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:37.353199 10288 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:37.348526 10354 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:37.412448 10288 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:37.412556 10354 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.349718 10334 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:37.363937  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.363615  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 177) took 6571 ms. Trace:
I20260501 13:59:37.360029 10338 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:37.427709 10338 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.428797 10334 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:37.430296  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.424324  7574 rpcz_store.cc:276] 0501 13:59:30.792360 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:30.792501 (+   141us) service_pool.cc:224] Handling call
0501 13:59:37.363534 (+6571033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:35.406439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:35.524823 (+118384us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:35.524868 (+    45us) write_op.cc:435] Acquired schema lock
0501 13:59:35.524889 (+    21us) tablet.cc:662] Decoding operations
0501 13:59:35.525669 (+   780us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:35.525741 (+    72us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:35.525783 (+    42us) tablet.cc:685] Acquiring locks for 4 operations
0501 13:59:35.526276 (+   493us) tablet.cc:701] Row locks acquired
0501 13:59:35.526292 (+    16us) write_op.cc:260] PREPARE: finished
0501 13:59:35.526487 (+   195us) write_op.cc:270] Start()
0501 13:59:35.526620 (+   133us) write_op.cc:276] Timestamp: P: 1777643975526424 usec, L: 0
0501 13:59:35.526636 (+    16us) op_driver.cc:348] REPLICATION: starting
0501 13:59:35.538748 (+ 12112us) log.cc:844] Serialized 1674 byte log entry
0501 13:59:37.136369 (+1597621us) op_driver.cc:464] REPLICATION: finished
0501 13:59:37.337178 (+200809us) write_op.cc:301] APPLY: starting
0501 13:59:37.337299 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:37.337482 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:37.337639 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:37.338305 (+   666us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:37.338566 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0501 13:59:37.338619 (+    53us) write_op.cc:312] APPLY: finished
0501 13:59:37.338904 (+   285us) log.cc:844] Serialized 41 byte log entry
0501 13:59:37.339103 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:37.339242 (+   139us) write_op.cc:454] Released schema lock
0501 13:59:37.339301 (+    59us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:37.339710 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:37.339745 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1879915,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":172010,"apply.run_cpu_time_us":2587,"apply.run_wall_time_us":2587,"num_ops":4,"prepare.queue_time_us":493624,"prepare.run_cpu_time_us":45767,"prepare.run_wall_time_us":1127466,"raft.queue_time_us":389514,"raft.run_cpu_time_us":25813,"raft.run_wall_time_us":129425,"replication_time_us":1609544,"thread_start_us":1603122,"threads_started":4,"wal-append.queue_time_us":1205112}]]}
I20260501 13:59:37.331590 10332 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.443054 10332 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.451484  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.452028 10332 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.452309  7825 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:37.452672 10332 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.454785  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.455070 10332 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.455777  7819 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:37.456467  7825 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260501 13:59:37.458081  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.459050  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:37.459721  7819 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.461822 10069 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.464464 10069 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.458125 10138 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.467552 10354 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:37.473160  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 422597us
I20260501 13:59:37.480083  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.487599  7825 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:37.480544  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.481285  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:37.483081  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 253472us
I20260501 13:59:37.489120  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:37.489329  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 2.012s (SENT) [suppressed 4 similar messages]
I20260501 13:59:37.490231  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.484592  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:37.492156  7822 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:37.485970  7819 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:37.398882  7576 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 3 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.490979  7820 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:37.496958  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.497942 10266 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:37.498710 10138 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.504189  7820 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 13:59:37.505710  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.505939  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:37.507526  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:37.508580  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.508298  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.509845  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.509966  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.510305  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.510980  7823 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:37.495338  7576 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 4 to 5, term changed from 3 to 4, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to <none>, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.511225  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.515004  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.446175 10191 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.517478  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.519012  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.519381  7753 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:37.520633  7754 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:37.522827  7751 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:37.520964  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.526172  7822 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:37.521569  7576 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 4 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.521754  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.528184  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:37.527964  7576 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 5 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.532388  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.537597  7822 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:37.535631  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.501313 10266 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.538661  7576 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.540251  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.425961 10092 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.541175  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.542126 10370 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:37.512683 10324 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:37.540786  7576 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 4 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.524806 10327 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:37.501240 10328 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260501 13:59:37.551041  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:37.553889  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.565237  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:37.565341  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 287876us
I20260501 13:59:37.549036 10370 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.551754  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.512909 10369 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260501 13:59:37.562633  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.561107  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.567874  7827 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:37.541051 10266 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:37.566406  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.568053  7576 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.571476  7823 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:37.550287 10155 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:37.575891  7576 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.579258  7576 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:37.582052  7576 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.583745  7576 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:37.585867  7576 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 1 to 2, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.587690  7576 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 5 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:37.586889  7643 leader_election.cc:400] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6.
I20260501 13:59:37.581029  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.589078  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.593568  7643 leader_election.cc:403] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:37.572491 10171 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:37.571218 10334 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:37.593792  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.602909  7753 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:37.602910  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.594184 10175 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:37.607360  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:37.608000  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.594374 10171 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.616601 10210 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:37.617044  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.617394 10210 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.617970 10364 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:37.569814 10069 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260501 13:59:37.584703 10155 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:37.624404 10155 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.597565  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.598037 10328 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:37.598584 10275 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 6
I20260501 13:59:37.600100  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.571688 10370 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:37.609031  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.629046  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.566831 10327 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.630249  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.631415  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.610693  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:37.632556  8380 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.578168 10138 raft_consensus.cc:2764] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260501 13:59:37.611450  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:37.612099 10369 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:37.636637 10092 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.637885  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:37.639322  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.640386 10366 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:37.640805 10366 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:37.642649 10080 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.640656  8374 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:37.619463  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.606624 10324 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260501 13:59:37.644351 10272 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.626536 10328 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:37.645884  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.646739 10272 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:37.646682 10328 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.647790 10175 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.648101 10328 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:37.648973 10175 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.618284  7751 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:37.612425  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:37.613225  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.661108  8375 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:37.613547  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.612113  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.662886  7748 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:37.614732  7753 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 13:59:37.615986 10372 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:37.664767 10372 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.667398 10372 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:37.616663 10171 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:37.596431  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.672204  7750 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:37.613250  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.621835  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:37.622155 10354 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.622644 10210 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:37.617403  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:37.609881  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:37.631892 10327 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.654282  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:37.652149  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.602569 10334 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.620085 10240 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.656652 10191 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.663326 10288 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.687232 10332 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:37.691198  8380 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:37.699055  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44875.6us
W20260501 13:59:37.703193  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 79155.1us
I20260501 13:59:37.671139 10366 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.713250  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.704433 10334 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:37.704254 10324 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:37.715478  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:37.712044  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.717885 10080 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:37.716542 10255 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.721637 10255 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.721925  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.722658 10255 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:37.723150  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.724718  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.709810 10332 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:37.726595  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.726192 10365 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.732702 10155 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.734858 10365 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.727794 10379 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.002s
I20260501 13:59:37.728711 10288 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.729137 10255 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:37.736369 10155 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:37.718691 10324 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.737231 10324 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:37.737783 10347 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:37.738207 10347 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.739128 10347 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.739955 10332 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:37.717051 10191 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260501 13:59:37.730232  8372 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:37.730463 10240 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.740688 10370 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.741465 10369 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 13:59:37.741895 10347 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:37.742774 10370 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.731657 10275 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6.
I20260501 13:59:37.744102 10366 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.749601  8373 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:37.753577 10266 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.753585 10324 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.754410 10332 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.773500 10332 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:37.719533 10171 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.775877 10171 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.770249 10334 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.773504 10266 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.778182 10324 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.652462  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:37.676201  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 78719.8us
W20260501 13:59:37.659463  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.760902  8371 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:37.830910 10288 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:37.813586  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 160925us
I20260501 13:59:37.831622 10288 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:37.832324 10288 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.832705  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.822064  7823 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:37.820637  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 104152us
I20260501 13:59:37.821287  7822 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:37.842729  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:37.845978  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:37.848438 10171 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260501 13:59:37.855733  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.857897  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.858990  7750 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.861780  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.863451 10332 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:37.864113 10332 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.864722 10332 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:37.862347  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:37.871580  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.871923 10275 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.875630 10240 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:37.857959 10171 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:37.779673 10334 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:37.890607  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.891907 10240 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:37.892349 10240 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:37.892784 10240 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:37.884757 10266 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260501 13:59:37.885113 10171 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.895336 10171 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.897617 10171 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:37.885367  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:37.901312 10275 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 13:59:37.908188  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46257.4us
I20260501 13:59:37.906793 10240 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.909286 10334 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:37.916687  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.917807 10347 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:37.918393 10347 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:37.919068 10080 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:37.919920 10080 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:37.921473 10080 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:37.925643 10240 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:37.930380  7753 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260501 13:59:37.934875  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:37.936152  7748 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:37.943962  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:37.945055  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.950889  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.955905 10338 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:37.956441 10338 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.956892 10338 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:37.959090  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:37.952201 10347 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:37.962399 10347 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:37.964666  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.970559 10240 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:37.971072 10240 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:37.971524 10240 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:37.981837  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:37.984174  7750 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:37.992249  7748 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:37.991989  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:38.016522  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.020419 10347 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260501 13:59:38.020870  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 105857us
W20260501 13:59:38.024225  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 120363us
I20260501 13:59:38.026324  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:38.028815 10354 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:38.035779  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49830.6us
I20260501 13:59:38.015527 10240 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.042917 10240 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.010943 10338 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.048439 10332 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.050954 10332 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.052227 10275 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:38.053166 10240 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:38.053686 10240 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:38.054127 10240 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:38.054944  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:38.056038 10275 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:38.056428 10275 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:38.056850 10275 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:38.064152 10171 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:38.065846 10347 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:38.066236 10347 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:38.067101  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 85939.2us
I20260501 13:59:38.069372 10347 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.070698 10332 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:38.072721 10388 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:38.071533 10347 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.073199 10388 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:38.074632 10388 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.076373 10388 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:38.079938 10338 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:38.086490  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.088201  7750 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:38.089984  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.090416  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.091355  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.094125  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.094786  7753 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:38.096436  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.096948  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.097205  7746 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:38.097695  7823 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:38.102555  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.103463  7750 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:38.106526  7749 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:38.106873  7751 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:38.107023  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 52298.9us
I20260501 13:59:38.107172  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.108289 10354 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:38.111462 10354 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
W20260501 13:59:38.111956  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.112215 10354 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:38.113368 10354 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.114977 10354 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.117486 10324 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 13:59:38.120101 10366 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:38.120512 10366 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:38.121591 10366 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.123010 10366 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:38.034821 10288 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.125748 10288 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.126926  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:38.129384  7750 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:38.130934 10324 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:38.136526  7754 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:38.138106  7748 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:38.132763 10324 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:38.140482  9731 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:38.146040  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:38.149660  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47635.4us
I20260501 13:59:38.151015  9731 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.154153  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.160837  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:38.161266 10350 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
W20260501 13:59:38.167452  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.167518 10328 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:38.169412  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:38.180894  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.180405 10350 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:38.177634 10369 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 13:59:38.182165 10369 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:38.182551  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.182621 10369 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:38.182328 10350 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.183387 10171 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:38.183503  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.183938 10171 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:38.183658 10369 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.184329 10171 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:38.179745  9731 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:38.181346  7823 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:38.172497  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.187525  7819 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260501 13:59:38.187453  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 75618.8us
I20260501 13:59:38.188961 10334 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:38.193380  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.194093  8371 raft_consensus.cc:2376] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6. Re-sending same reply.
I20260501 13:59:38.194250  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.195416  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.202661  7819 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260501 13:59:38.191866 10334 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:38.204811 10334 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.161590 10275 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.207039  7753 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:38.209904 10240 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.210836 10288 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:38.212173 10210 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:38.196794 10324 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.238128  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.196921  9731 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260501 13:59:38.233881  7746 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:38.239362  7823 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 4: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:38.236248  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.246974  8374 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260501 13:59:38.248365 10369 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.252151  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.252983  7825 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:38.256315 10275 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.257414  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.258160 10266 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:38.258333  7819 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:38.258803 10266 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.266603 10266 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.268612 10266 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:38.285426  9731 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:38.285820 10347 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:38.286032  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.287209 10347 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:38.287614 10347 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.288892 10240 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.288635 10347 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.291492 10347 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.287209  9731 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:38.296597  7825 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
W20260501 13:59:38.302548  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 78900.7us
I20260501 13:59:38.288933 10171 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.297961  8374 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260501 13:59:38.297650  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.297237 10260 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:38.323130 10260 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.324999 10260 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.343339  7819 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:38.309513  9731 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.367544  7673 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:38.353680  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.372449  7678 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:38.373685  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.373919  9731 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.376119 10171 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:38.378032  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.378358 10275 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:38.378835 10275 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:38.379881 10275 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.381515 10275 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.386019  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.386883  7677 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:38.374444  7674 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:38.388991  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.390129  7671 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.391466  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.392354  7670 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.392378  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.392668  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.393352 10171 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:38.398734 10171 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.393601  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.401721 10171 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:38.394078  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.402949  7673 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.394527  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.403865  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.404256  7672 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:38.394781  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.404690  7675 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:38.406025  7674 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:38.406234  7679 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:38.353081 10334 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.410022 10334 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:38.410137  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.415120  9731 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:38.417580  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.418193  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.418815  7673 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:38.420166  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.420744  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.421451  7670 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.422003  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.422394  7670 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:38.423470  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.424103  7672 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:38.421310  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.426609  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.427788  7678 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:38.419690  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.428640  7673 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.440061  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.440925  7675 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:38.450750  7676 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:38.453523  8371 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
W20260501 13:59:38.456588  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:38.460182  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 174289us
I20260501 13:59:38.461952  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.464583  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.466169 10399 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:38.466578 10260 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:38.466933 10399 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.467151 10260 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:38.468096  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.467123  7577 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:38.468022 10399 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.469446 10260 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:38.476116  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 167337us
I20260501 13:59:38.476306  7675 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:38.478693 10327 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 13:59:38.477691  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 185847us
I20260501 13:59:38.479377 10327 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.480047  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:38.481472  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.481810 10327 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:38.482645  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.483400  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:38.487670  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.489444  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.490623  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.491791  8371 raft_consensus.cc:2410] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260501 13:59:38.493010 10327 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:38.493685 10327 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.495760 10327 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.496042 10347 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:38.496234 10240 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:38.496888 10240 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.498374  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.499075  7746 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:38.499981 10240 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:38.496888 10347 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.501596  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.502296  7827 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:38.502883  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:38.505509  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:38.507899  7746 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:38.508427  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.508977  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.509922  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.510051 10400 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:38.510170  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.510509 10400 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:38.510946  7674 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.511251  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.510639  7675 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:38.512019  7676 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:38.511976  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.511894  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.512949  7746 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:38.515480  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.516222  7677 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:38.501633 10347 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.516429  7746 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.524760 10260 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 13:59:38.526847  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:38.516912 10240 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:38.527707 10260 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:38.528216 10260 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.526333  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.530435  7676 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:38.520692  7753 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:38.510962 10400 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:38.520960  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.533610  7679 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:38.535080  7746 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:38.522225  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.523267  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.530366 10260 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.518962  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:38.538735 10240 raft_consensus.cc:2764] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260501 13:59:38.531975  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.540141 10327 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:38.540586 10327 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:38.541050 10327 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:38.540603  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:38.542126 10240 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:38.543437  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:38.544337 10240 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:38.544889 10240 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:38.545892 10240 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:38.550082  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.553179  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:38.558105 10390 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:38.558647 10390 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:38.559521 10390 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.560355  7574 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:38.561499  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:38.562666  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.565181  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:38.562393  7574 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:38.566100 10388 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:38.566287  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:38.566797 10388 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:38.575263 10388 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.567121 10266 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260501 13:59:38.578969  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.579735 10369 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:38.580345  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.580410 10369 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.581509  7675 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.583333 10369 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.556033  7672 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:38.570189  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.586613  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.586434  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.569330  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.578555  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.589231  7677 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:38.591275  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23c164f5975a45b495c25c9e99b628d3. This is attempt 1: this message will repeat every 5th retry.
I20260501 13:59:38.632328  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.634378 10240 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:38.636783 10266 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:38.638602 10324 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:38.639283 10324 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.641783 10324 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.643249 10240 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:38.644964  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.661603  7677 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:38.645481 10266 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:38.646463  7679 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:38.647112  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.651265  7676 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260501 13:59:38.664309  7672 raft_consensus.cc:2376] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:38.644393  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:38.665899 10266 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.655058  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.656314  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.657061  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.678202  7675 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260501 13:59:38.678381  7678 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:38.657517  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.635586 10369 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:38.680757  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.680796 10369 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.683110 10369 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.652791 10327 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.667662 10240 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.668419  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.669791  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.691737  7827 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:38.670527  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.693197  7679 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:38.671089  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.694562  7670 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:38.671630  7676 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:38.672477  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.696230  7677 raft_consensus.cc:2376] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 3. Re-sending same reply.
I20260501 13:59:38.673252  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:38.673892  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:38.697394  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.658812 10400 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.673789  7573 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 3 to 4, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 4 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:38.673755  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.676606  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:38.706837  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.712435 10369 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:38.726691  8371 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:38.727432 10275 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:38.817731  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.852041  7748 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:38.773852  7573 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 5 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:38.857879  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.858986  7748 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:38.858840  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.852681  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:38.860076  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.862560  7675 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:38.860319 10400 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:38.860733  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.858107  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:38.828923  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 298) took 6951 ms. Trace:
I20260501 13:59:38.860914  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f875366331345f08d2e236a76c1c71d with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50946
I20260501 13:59:38.860891  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.864710  7750 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:38.727984 10327 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:38.863814  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:38.868134 10275 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.870813 10275 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:38.730938 10388 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:38.872263 10388 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:38.873180  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:38.873327  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.874032  7750 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:38.874698 10388 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:38.874964  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.875674  7819 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:38.876995  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:38.878780  7823 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:38.878836  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.879668  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.880827  7825 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:38.880883  7826 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:38.774555  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 268) took 1638 ms. Trace:
I20260501 13:59:38.882339  7822 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260501 13:59:38.883040  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.874158  8372 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 3: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:38.883687  7573 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 5 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:38.888351  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.864009  7577 rpcz_store.cc:276] 0501 13:59:31.860256 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:31.860425 (+   169us) service_pool.cc:224] Handling call
0501 13:59:32.549585 (+689160us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:38.811313 (+6261728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:38.482415 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:38.483010 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:38.483054 (+    44us) write_op.cc:435] Acquired schema lock
0501 13:59:38.483073 (+    19us) tablet.cc:662] Decoding operations
0501 13:59:38.483422 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:38.483483 (+    61us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:38.483517 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:38.483726 (+   209us) tablet.cc:701] Row locks acquired
0501 13:59:38.483743 (+    17us) write_op.cc:260] PREPARE: finished
0501 13:59:38.483902 (+   159us) write_op.cc:270] Start()
0501 13:59:38.484013 (+   111us) write_op.cc:276] Timestamp: P: 1777643978483855 usec, L: 0
0501 13:59:38.484034 (+    21us) op_driver.cc:348] REPLICATION: starting
0501 13:59:38.484676 (+   642us) log.cc:844] Serialized 538 byte log entry
0501 13:59:38.486914 (+  2238us) op_driver.cc:464] REPLICATION: finished
0501 13:59:38.487411 (+   497us) write_op.cc:301] APPLY: starting
0501 13:59:38.487491 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:38.487609 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:38.487698 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:38.487959 (+   261us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:38.488121 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:38.488181 (+    60us) write_op.cc:312] APPLY: finished
0501 13:59:38.488383 (+   202us) log.cc:844] Serialized 23 byte log entry
0501 13:59:38.488537 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:38.488621 (+    84us) write_op.cc:454] Released schema lock
0501 13:59:38.488665 (+    44us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:38.489026 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:38.489055 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1767261,"reported_tablets":37,"spinlock_wait_cycles":999991168,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":1584,"apply.run_wall_time_us":1583,"num_ops":1,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":2550,"prepare.run_wall_time_us":2550,"replication_time_us":2734}]]}
W20260501 13:59:38.889639  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.889803  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.892664  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.894544  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.895702  7753 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:38.896179 10334 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:38.897028 10334 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:38.900115 10334 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:38.902715  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.904172  7827 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:38.941221  7753 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260501 13:59:38.922873  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.917310  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.922308  7746 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:38.946642  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.947600  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:38.920692  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:38.881699  7576 rpcz_store.cc:276] 0501 13:59:37.135671 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:37.135865 (+   194us) service_pool.cc:224] Handling call
0501 13:59:37.291306 (+155441us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:38.774281 (+1482975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:37.931454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:37.932414 (+   960us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:37.932479 (+    65us) write_op.cc:435] Acquired schema lock
0501 13:59:37.932533 (+    54us) tablet.cc:662] Decoding operations
0501 13:59:37.934935 (+  2402us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:37.935062 (+   127us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:37.935105 (+    43us) tablet.cc:685] Acquiring locks for 17 operations
0501 13:59:37.962386 (+ 27281us) tablet.cc:701] Row locks acquired
0501 13:59:37.962444 (+    58us) write_op.cc:260] PREPARE: finished
0501 13:59:37.962651 (+   207us) write_op.cc:270] Start()
0501 13:59:37.962825 (+   174us) write_op.cc:276] Timestamp: P: 1777643977962592 usec, L: 0
0501 13:59:37.962896 (+    71us) op_driver.cc:348] REPLICATION: starting
0501 13:59:37.963637 (+   741us) log.cc:844] Serialized 6745 byte log entry
0501 13:59:38.164432 (+200795us) op_driver.cc:464] REPLICATION: finished
0501 13:59:38.366988 (+202556us) write_op.cc:301] APPLY: starting
0501 13:59:38.367136 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:38.367534 (+   398us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:38.367707 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:38.370124 (+  2417us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:38.370551 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0501 13:59:38.370603 (+    52us) write_op.cc:312] APPLY: finished
0501 13:59:38.371070 (+   467us) log.cc:844] Serialized 119 byte log entry
0501 13:59:38.375276 (+  4206us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:38.375495 (+   219us) write_op.cc:454] Released schema lock
0501 13:59:38.375580 (+    85us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:38.376053 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:38.376097 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70167,"reported_tablets":25,"spinlock_wait_cycles":276515072,"child_traces":[["op",{"apply.queue_time_us":186893,"apply.run_cpu_time_us":5103,"apply.run_wall_time_us":11563,"num_ops":17,"prepare.queue_time_us":88481,"prepare.run_cpu_time_us":7999,"prepare.run_wall_time_us":61117,"replication_time_us":195569,"thread_start_us":172733,"threads_started":2}]]}
I20260501 13:59:38.913196 10334 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260501 13:59:38.956669  7826 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260501 13:59:38.957935  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:38.891701 10399 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260501 13:59:38.960049  7825 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:38.960664  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:38.950611  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:38.960892  7822 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:38.965425  7819 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:38.968708  7825 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:38.970382 10415 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:59:38.973598 10346 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:38.975085  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:38.978096  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:38.978737  8372 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:38.973073  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:38.968130 10390 raft_consensus.cc:2764] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260501 13:59:38.975122 10346 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260501 13:59:38.966826 10334 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:38.988231  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:38.997134  7826 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260501 13:59:38.996868  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:38.999733  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.000445  7827 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:39.001870  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.004207  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:39.007058  7753 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260501 13:59:39.008412  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:39.009580  7750 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:39.004983  7748 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:39.013758  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:39.014832  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.004484 10390 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:39.019733  8371 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:39.003474  7825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:39.028539  7825 raft_consensus.cc:606] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.028748  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:39.054760  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 81794.4us
I20260501 13:59:39.056502  7718 leader_election.cc:400] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:39.056835  7718 leader_election.cc:403] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260501 13:59:38.996840 10334 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:39.060781  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:39.066283  7819 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:39.067664  7750 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:39.066762 10275 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.071216 10275 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.073604  7747 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:39.077420  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:39.078225  7748 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:39.078277  7753 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:39.080504  7754 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260501 13:59:39.084247  7826 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:39.065508 10347 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:39.066987  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2610104880000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260501 13:59:39.080771  7577 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 6, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:39.088900  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1926104880000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260501 13:59:39.089540  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1089104879999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260501 13:59:39.089854  7643 connection.cc:254] RPC call timeout handler was delayed by -1.094510487999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260501 13:59:39.090773  7577 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:39.094102  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.102952 10347 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.104718 10415 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 13:59:39.102942  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:39.086293 10275 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:39.111495  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:39.091863 10080 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:39.105598 10347 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:39.133268  7754 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:39.092631  7577 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 5 to 4, term changed from 4 to 5, leader changed from <none> to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) added, now has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:39.138211  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:39.100431 10422 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:39.141213  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.140882  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.120256 10399 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.107081 10388 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260501 13:59:39.140167  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:39.145630  7748 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:39.146456  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:39.137965  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:39.148608  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.133179 10275 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:39.116024 10240 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260501 13:59:39.156862  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 66490.2us
I20260501 13:59:39.158018  7745 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:39.144747 10080 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 13:59:39.163762  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:39.164824  8371 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:39.165067 10334 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.166694 10334 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:39.168006 10415 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260501 13:59:39.163956  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 73677.9us
I20260501 13:59:39.173305  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.173650 10260 raft_consensus.cc:993] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:39.174283 10260 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:39.174726 10260 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:39.175096 10260 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:39.175210 10421 raft_consensus.cc:1081] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:39.145557 10324 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:39.176052 10324 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.176446 10324 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:39.148758 10399 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.151593 10327 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:39.179582 10327 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.179976 10327 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:39.180500 10399 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:39.151980 10422 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.183173 10422 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.175274  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.217201  7822 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:39.216871 10422 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.214823 10415 ts_tablet_manager.cc:1916] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:59:39.231600 10260 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.234041 10260 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:39.231621  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 56469.3us
I20260501 13:59:39.237898  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.238314 10275 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:39.239436 10424 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:39.239928 10424 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:39.240867 10424 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.244232 10260 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:39.245608 10424 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:39.246323 10260 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:39.248349  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.248580  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:39.251364 10275 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:39.252830  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.256922 10260 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:39.257748 10260 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:39.258685 10260 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.259371  7821 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:39.264658 10275 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:39.265307  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.267731 10324 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.268309 10422 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:39.269095 10327 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.269440 10275 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:39.270038 10324 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.271171 10327 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.271682  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:39.278995  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.280387  7745 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
W20260501 13:59:39.280619  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 169224us
I20260501 13:59:39.282258  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.286405  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.288369  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:39.290704  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 140587us
I20260501 13:59:39.291695  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.296823  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.293031 10388 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:39.291365 10334 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.300364 10421 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:39.289585 10429 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:39.301519 10347 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:39.297773 10275 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:39.309098  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:39.318328  7748 raft_consensus.cc:606] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.318711  7748 raft_consensus.cc:614] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:39.305110  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.324951  7749 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:39.311570 10388 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:39.325515 10324 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.332690 10400 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.333443 10400 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.334236  7748 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:39.333477 10388 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.333760  8371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 13:59:39.335636  8371 raft_consensus.cc:606] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.336050 10400 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.337203  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260501 13:59:39.338825  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260501 13:59:39.341950  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 70399.5us
I20260501 13:59:39.312479 10429 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:39.347903  7748 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260501 13:59:39.312053 10421 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.303637 10433 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260501 13:59:39.362591 10421 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:39.357079 10426 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:39.365002  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:39.365932 10275 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:39.349620 10080 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260501 13:59:39.361526  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.376602  7821 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:39.308887 10334 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.333416 10324 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.378408  7822 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 13:59:39.312423 10347 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.388962  7577 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:39.326552 10327 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260501 13:59:39.398458 10433 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:39.398859  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.399101 10433 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.400652  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:39.401247 10324 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.401484 10433 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.349169 10429 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.398115  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:39.408818  7821 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:39.395205  7577 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:39.410019  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:39.417307  7577 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 5, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:39.391891 10347 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.419483  7577 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:39.428369  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:39.428853  8373 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:39.429075  7821 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:39.432395  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.433547  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:39.438549  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.424621  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:39.424141  7577 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 2 to 3, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 3 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:39.444051  7577 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:39.445281  7821 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:39.448987  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:39.449417  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.450420  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.451016  7819 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:39.426645 10433 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.468515  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:39.472563  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.475006  8380 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:39.473549  7752 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:39.486936 10433 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.494782  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:39.422098 10427 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260501 13:59:39.476715  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.496302 10324 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.513258 10324 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.515515 10324 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.504405 10427 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:39.519590 10427 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:39.529021  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 116598us
I20260501 13:59:39.502734  8374 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260501 13:59:39.495765 10433 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.547199  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.548421  7747 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 13:59:39.556217  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.558538  7676 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:39.542062 10427 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:39.561623  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 136598us
I20260501 13:59:39.563958  7675 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:39.572706  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.573736  7672 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:39.574838  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.577123  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.579695  7676 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.580368  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.577101  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.582504  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.583132  7673 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:39.589064 10446 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:39.589581 10446 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.589926 10446 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.590154  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.591178  7675 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:39.595155  7752 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:39.597218  7678 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:39.600490 10439 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260501 13:59:39.562400 10334 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.602842 10334 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:39.563280 10388 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:39.608031 10388 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.619019  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.623025  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.625994  7673 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
W20260501 13:59:39.627552  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47731.1us
I20260501 13:59:39.635865  7678 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:39.636168  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.639719  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.640596  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.641320  7675 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:39.641353  7671 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:39.642395  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.643656  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.644940  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.645656  7679 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:39.644650  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.648353  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.656522  7679 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:39.657020  7674 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:39.649704  7675 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:39.657575  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:39.644960  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.658279  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.664106  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.665910  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.667670 10400 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:39.668731  8380 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:39.669265  7679 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:39.659246  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.670147  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.672430  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.672926  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:39.671927  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.671200  7675 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:39.679641  7676 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:39.681982  7671 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:39.683130  7679 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:39.683704  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.684522  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:39.685515 10443 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:39.685967  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:39.686844 10443 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:39.687206 10443 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.687523 10443 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.686414  7675 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:39.658878  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:39.660401  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:39.699491  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.699973  7675 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:39.700330  7678 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:39.699676  7679 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:39.722986  7678 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260501 13:59:39.729180 10435 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.183s	user 0.003s	sys 0.001s
I20260501 13:59:39.709239 10388 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:39.764375  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.718652  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:39.782094  7673 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:39.729735 10416 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:39.695736 10424 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260501 13:59:39.711143 10369 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:39.800688  7670 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:39.740471  8371 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:39.788082 10416 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 13:59:39.797557  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 158627us
I20260501 13:59:39.790439 10369 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:39.692274 10275 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:39.822113  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 134038us
I20260501 13:59:39.806370 10433 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.831928  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.820482 10369 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:39.842783  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 170418us
I20260501 13:59:39.824548  9731 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:39.824137 10324 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:39.851925  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.824365 10275 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.840783 10421 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.868122  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.869859  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:39.870847  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.873047  8373 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:39.873886  8377 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:39.875630 10266 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260501 13:59:39.878571  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.857328  9731 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.886062  7674 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
W20260501 13:59:39.888723  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:39.850811 10433 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.905791  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:39.906476  7826 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:39.853256 10324 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.908635  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:39.911175  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:39.912473  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48677.3us
I20260501 13:59:39.911262  7751 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:39.916052 10447 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:39.916256 10448 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:39.916927 10458 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:39.917009 10463 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260501 13:59:39.881626 10443 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.917658 10458 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.919335 10443 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.920085 10462 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:39.924360  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:39.925271  8371 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:39.925781 10347 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.926393 10464 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:39.927529 10464 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:39.880327 10416 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.928224 10464 consensus_queue.cc:1243] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260501 13:59:39.928360  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:39.929699  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:39.930007 10422 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:39.930495 10426 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:39.931833  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.905228 10400 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:39.951467 10324 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.952153  8372 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260501 13:59:39.938189 10449 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260501 13:59:39.937955 10465 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:39.960711 10465 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:39.934001 10426 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:39.961735 10465 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.962277 10426 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:39.937243 10459 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.935787 10427 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260501 13:59:39.962999 10459 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.919683 10458 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.938695 10462 consensus_queue.cc:1243] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:39.938231 10463 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:39.965503 10458 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:39.965946 10458 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:39.965751 10463 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.938480 10443 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:39.957674 10467 ts_tablet_manager.cc:933] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.968441 10443 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:39.958360 10451 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.290s	user 0.003s	sys 0.000s
W20260501 13:59:39.960091 10454 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.176s	user 0.003s	sys 0.000s
I20260501 13:59:39.965256 10459 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.934471 10448 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:39.967056 10458 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:39.947655 10266 raft_consensus.cc:2764] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260501 13:59:39.984339 10400 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:39.986665 10458 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.989701  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:39.990799 10080 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:39.991174 10080 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:39.991555 10080 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:39.948755 10347 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:39.942396 10424 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:39.975013 10463 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.978657  9731 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:39.939240 10421 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:39.981946  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50194.1us
I20260501 13:59:39.998711  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:40.000026  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.000627  7746 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 9
I20260501 13:59:39.994132 10424 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:40.011204  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.002362 10433 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:39.969743 10443 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.003803 10240 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:39.992151 10448 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.022358 10324 raft_consensus.cc:993] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:40.020071 10388 consensus_queue.cc:1059] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260501 13:59:40.011651 10460 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:40.023207 10388 consensus_queue.cc:1243] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer bc1b0a0a152e46fea4bd4934ba9976ed log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260501 13:59:40.024178 10460 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:40.023598 10433 raft_consensus.cc:1081] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:40.023053 10448 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.017051  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:40.025540 10460 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.026818 10448 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:40.027305 10448 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.028182 10448 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.033728 10447 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:40.034243 10447 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:40.035162 10447 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.036717 10447 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.038154 10446 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.039863  7672 raft_consensus.cc:2368] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6.
I20260501 13:59:40.040480 10443 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:40.027489 10460 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.016254 10275 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.048296  7746 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:40.015487 10467 tablet_copy_client.cc:323] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 13:59:40.053169 10421 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260501 13:59:40.062917 10369 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:40.066891  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:40.074280  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 172891us
I20260501 13:59:40.076787  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.078274  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.078974 10240 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:40.079438 10240 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:40.079799 10240 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.086113 10388 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:40.086724 10465 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.088217 10415 ts_tablet_manager.cc:1929] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260501 13:59:40.088770 10415 log.cc:1199] T 1f875366331345f08d2e236a76c1c71d P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/1f875366331345f08d2e236a76c1c71d
I20260501 13:59:40.090963  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.080830 10458 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260501 13:59:40.097900 10416 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:40.100085  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.076424 10429 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260501 13:59:40.102200 10429 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:40.102591 10429 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:40.102756 10458 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:40.102727 10469 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:40.100358 10416 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.103554 10458 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:40.107551 10458 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.108345 10446 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.056614 10424 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.113143 10424 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.112004 10458 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.110544  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:40.114986  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.092633  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.116883  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.118002  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.118981  7746 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:40.106881  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.124356  7573 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:40.124972  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.124910  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.134027  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:40.125305 10347 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:40.122066 10400 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:40.123859 10446 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:40.123063 10416 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.127149 10266 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.131280 10388 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:40.103637 10429 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.136585 10464 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:40.136036 10421 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:40.142071 10469 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:40.141855 10346 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:40.148973 10421 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.155618 10421 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.143357 10347 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:40.157840  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:40.157840  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:40.145017 10388 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:40.164546 10240 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.200585 10388 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:40.202490 10240 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.203012 10429 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:40.165158 10415 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50946 (request call id 1236) took 1305 ms. Trace:
I20260501 13:59:40.203581 10415 rpcz_store.cc:276] 0501 13:59:38.860245 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:38.860612 (+   367us) service_pool.cc:224] Handling call
0501 13:59:38.969840 (+109228us) ts_tablet_manager.cc:1151] Deleting tablet 1f875366331345f08d2e236a76c1c71d
0501 13:59:38.969959 (+   119us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0501 13:59:39.517129 (+547170us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:40.088049 (+570920us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:40.165047 (+ 76998us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111568,"tablet-delete.queue_time_us":103858,"thread_start_us":87588,"threads_started":1}
I20260501 13:59:40.206089  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 1f875366331345f08d2e236a76c1c71d (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:59:40.165768 10369 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.166183 10080 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.166824 10473 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260501 13:59:40.209559 10080 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.160140 10260 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:40.211021 10260 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.153015 10464 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:40.212986 10464 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.214098 10260 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:40.145928 10266 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.174397  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:40.174938  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:40.216122  8381 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:40.216434 10369 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:40.216846 10369 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.217165 10369 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.176599  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:40.217947  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:40.218231  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.218936  7749 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:40.220366  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.221621 10324 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:40.222054 10324 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.222424 10324 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:40.217181 10266 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.223491 10266 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:40.146864 10446 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:40.223879 10266 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.224315 10266 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.224558 10446 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.225275 10466 raft_consensus.cc:2955] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:40.177613 10347 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.186161  8374 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:40.159322 10346 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.191294 10433 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:40.191978  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:40.324446  8380 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:40.325089  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 167317us
I20260501 13:59:40.325883  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:40.197422 10426 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.198495  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:40.199968 10422 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:40.215309  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.230705  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.230983  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.183108 10448 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.335050  7749 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:40.335121  7746 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
W20260501 13:59:40.276901  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 131520us
I20260501 13:59:40.326700  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:40.324702  7792 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.528s (SENT)
W20260501 13:59:40.336545  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.264299 10275 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 13:59:40.340549  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.336316  7748 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:40.343312  7826 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:40.343194  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.324316 10459 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.344527  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.350728  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.339301 10433 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.334512 10473 consensus_queue.cc:1243] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260501 13:59:40.352941  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.357573  7822 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:40.360154  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:40.360811  7826 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:40.361414  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.363763  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.344121 10465 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.367295  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 23c164f5975a45b495c25c9e99b628d3 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 13:59:40.351179 10460 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:40.353793 10459 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.382432  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:40.385082  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60410.5us
I20260501 13:59:40.392112  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:40.375211 10388 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.397959  7751 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.400411 10080 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:40.381410 10433 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.404553 10459 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.404757 10448 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.408095  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 23c164f5975a45b495c25c9e99b628d3 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-23c164f5975a45b495c25c9e99b628d3
I20260501 13:59:40.408572 10469 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:40.409580  8372 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:40.383694 10465 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.408471  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.409606 10469 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:40.412560 10465 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.412992 10469 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.413575 10465 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:40.414393 10469 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
W20260501 13:59:40.415727  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.416482 10433 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.420475 10426 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:40.418998  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.384423 10473 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:40.423022 10443 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:40.417251 10388 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.419950 10460 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:40.418794 10400 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:40.428433  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.438217  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:40.443746  7792 leader_election.cc:336] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.650s (SENT)
I20260501 13:59:40.446415  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.419415 10266 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.450888  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 13:59:40.460059  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 134046us
I20260501 13:59:40.461531  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.468971  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.469434  7825 raft_consensus.cc:2368] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
W20260501 13:59:40.473049  7792 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.673s (SENT)
I20260501 13:59:40.476572  8344 leader_election.cc:400] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 13:59:40.477150  8344 leader_election.cc:403] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:40.478426  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:40.479065  8380 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:40.459259 10460 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:40.483839  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.456877 10388 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260501 13:59:40.476491  7576 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 5 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:40.486019  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:40.485001  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.488387  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.491385  7745 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
W20260501 13:59:40.535970  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.536134 10487 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.540220 10400 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:40.541712 10400 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:40.542102 10400 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.542443 10400 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.544754 10324 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.546959 10324 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.549207 10369 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.489578 10260 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:40.489044 10346 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:40.552549 10346 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.552280 10260 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.553067 10346 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.554539 10260 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:40.551548 10369 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:40.479967 10416 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:40.530282  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:40.566993  8380 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:40.531131  7748 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 13:59:40.476994 10462 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:40.532474  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.570940  7826 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:40.555150 10346 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:40.572419  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.566627 10416 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.573282 10416 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.557979 10490 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:40.558349 10266 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.560963  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:40.583863  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 49358.3us
I20260501 13:59:40.477896 10459 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260501 13:59:40.592311 10459 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:40.592773 10459 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:40.593802 10459 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.595271 10459 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.578935 10490 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:40.564242  7764 tablet_copy_source_session.cc:215] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 13:59:40.565320 10421 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.569218  7751 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:40.573362  7672 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:40.576346  7674 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260501 13:59:40.488219  7825 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:40.576429  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.605696  7674 pending_rounds.cc:85] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 4
I20260501 13:59:40.606379  7670 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:40.576946  7678 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.577416  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.585336  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.585908 10483 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:40.607476  7675 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:40.586997 10429 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:40.588124  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.613452  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.613955  7676 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:40.614058  7675 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:40.588887  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.589520  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.614868  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.614915  7677 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:40.615056  7671 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:40.616207  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.616888  7671 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:40.616627  7577 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:40.617669  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.618229  7671 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:40.608328  7673 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:40.619467  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:59:40.620095  7673 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:40.620433  7673 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.620952  7577 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:40.606014  7674 pending_rounds.cc:107] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260501 13:59:40.626264  7674 raft_consensus.cc:2889] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:40.626995  7679 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:40.629431  7675 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:40.624387 10429 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:40.631970 10388 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:40.631857 10429 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:40.633594 10429 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:40.622998  7577 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:40.638201  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.638458  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.639191  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.640285  7819 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:40.643034  7673 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.643682  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.644335  7672 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.644706 10421 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.645339  7673 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.599279 10490 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.646692  7674 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:40.647372 10490 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.647743  7673 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:40.648766  7676 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
W20260501 13:59:40.649174  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 88290.4us
I20260501 13:59:40.649622  7677 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:40.649972  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.639359  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.654160  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.656038  7674 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:40.656201  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.656802  7748 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:40.657181  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.657889  7745 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.648665  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.651616  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.665156  7577 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:40.668313  7577 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 5, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:40.674177 10266 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.629511 10483 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.686743 10487 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 13:59:40.696803  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.697451  7748 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.698400  7577 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 5, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:40.691454  7671 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:40.693905  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 207936us
W20260501 13:59:40.695549  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 58279.5us
W20260501 13:59:40.695971  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44478.2us
I20260501 13:59:40.703933  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.707132 10447 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:40.708752 10447 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:40.709218 10447 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:40.709770  7678 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:40.710299 10447 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:40.707572 10240 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:40.706851  7718 leader_election.cc:400] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:40.717893  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.718286  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.713862  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.714468  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:40.717031  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:40.722496  7670 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:40.724633  7672 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:40.726405  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.730695  7826 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:40.726748  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.732474  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.733079  7749 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.728904  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.727721  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:40.734519  7577 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 6, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:40.737650  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:40.738421  7819 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.745759  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:40.746547  7825 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:40.748224  7748 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:40.751545  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.752465  7825 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:40.754186  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.754228  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.754796  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:40.755650  7825 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:40.755736  7748 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 5
I20260501 13:59:40.757205  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:40.757855  7747 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.757813  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.758626  7826 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:40.758664  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:40.761132  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54444.3us
I20260501 13:59:40.700712 10422 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260501 13:59:40.765156  7822 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:40.726930 10369 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:40.784008 10369 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.784502 10369 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:40.785964 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c164f5975a45b495c25c9e99b628d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 13:59:40.767519  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:40.701444 10266 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.750403 10324 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:40.744556 10421 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:40.771272 10479 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:40.772414 10483 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.801862  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.773691 10422 consensus_queue.cc:1243] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer 91854d93e96c4756834efe8b2ef59fce log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 13:59:40.776847  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.779381  7748 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:40.779076 10416 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.768318 10447 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:40.790822  7749 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:40.795526  7745 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
W20260501 13:59:40.804841  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.812490  7825 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:40.804898  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.808259  7819 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:40.809094  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:40.818897  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.803s (SENT)
I20260501 13:59:40.819597 10399 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:40.812682 10426 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:40.822446 10481 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:40.816422 10347 raft_consensus.cc:2764] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260501 13:59:40.797852 10421 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:40.830145 10416 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.809098 10483 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:40.830677 10369 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.813017 10388 raft_consensus.cc:2764] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260501 13:59:40.837491  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:40.840564  7746 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 13:59:40.842640  7718 leader_election.cc:400] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:40.809690 10324 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:40.816967 10479 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:40.843714 10421 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:40.843538 10426 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:40.867328  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:40.870651  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51831.4us
I20260501 13:59:40.871985  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.874580  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:40.845696 10429 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260501 13:59:40.867096 10422 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:40.887603  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45173.7us
I20260501 13:59:40.892446 10240 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:40.897153  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:40.899780  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:40.904731  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.909257  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:40.919534  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:40.910624 10485 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:40.920964 10485 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:40.922004 10485 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.917164 10494 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260501 13:59:40.924569 10400 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.917315 10327 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:40.926002 10327 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:40.926419 10327 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:40.927383 10400 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:40.896981 10481 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260501 13:59:40.928474  8344 leader_election.cc:400] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6.
I20260501 13:59:40.931298  8376 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:40.911303 10422 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:40.943396  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.896521 10483 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260501 13:59:40.950845  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.951545  7678 raft_consensus.cc:2376] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6. Re-sending same reply.
I20260501 13:59:40.930419 10399 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:40.976562  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 60038.5us
W20260501 13:59:40.953806  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.948s (SENT)
I20260501 13:59:40.931924 10080 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:40.961190  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.954535  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:40.988842  7676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:46596
I20260501 13:59:40.989375  7678 raft_consensus.cc:2376] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6. Re-sending same reply.
W20260501 13:59:40.957369  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:40.980806  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.990216  7679 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:40.990314  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.991097  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:40.991402  7678 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:40.991701  7679 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:40.992532  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:40.993695  7679 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:40.981642  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:40.917657 10490 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260501 13:59:40.948305 10462 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.989596  7676 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:41.000288  7676 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:41.000658  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.001399  7670 raft_consensus.cc:2368] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6.
I20260501 13:59:40.994364  7671 raft_consensus.cc:2376] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7. Re-sending same reply.
I20260501 13:59:41.002825  7678 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:40.995877  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.001187  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:41.004172  7674 raft_consensus.cc:2376] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3. Re-sending same reply.
I20260501 13:59:40.941802 10266 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.983022 10460 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:40.980427 10487 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:41.007006 10505 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260501 13:59:41.014168  7827 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:41.014881  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:41.001930 10500 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260501 13:59:40.980427 10469 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.007509  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:41.042205  7748 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:41.007876  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:41.043944  7749 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:41.008577 10498 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:41.020193  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:40.931712 10324 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.022218  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:41.015727  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:41.010864  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:41.024410  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 70620.4us
I20260501 13:59:40.985491 10400 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260501 13:59:41.012665  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:41.071906  8381 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:41.072127  7820 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:41.036712 10369 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.076184  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:41.077118  7823 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:41.038287 10460 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.079236 10460 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.004923 10240 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260501 13:59:40.998412 10399 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.083292 10346 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:40.987417 10429 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260501 13:59:41.084684 10399 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:40.939800 10426 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:40.986382 10424 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.059710  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:41.088230 10424 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.083699 10346 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:41.089287  8371 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:41.089993 10346 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.090583 10424 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:41.090955  7827 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:41.091125 10346 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:41.035247 10487 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:41.092090 10487 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:41.096187  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.036193  7826 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.037637  7670 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:40.899663 10479 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.067921 10469 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.102639  7747 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:41.067122  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:41.008849 10446 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260501 13:59:41.111554  8372 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:41.065788  7676 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.101779  7673 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:41.113391  7748 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 13:59:41.114223  7671 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:41.110040  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:41.116776  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 153546us
W20260501 13:59:41.118621  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 47409.2us
I20260501 13:59:41.126610  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:41.128005  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:41.129727  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:41.145730  7676 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:41.149689  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:41.109117 10460 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:41.108775 10498 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.176440  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:41.177489  7828 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:41.068162 10433 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260501 13:59:41.177327 10498 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.181931 10460 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.178800 10400 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:41.012037 10462 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.116601 10369 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
W20260501 13:59:41.171298  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:41.206250  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 80276.4us
I20260501 13:59:41.181164  7826 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
W20260501 13:59:41.202330  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 217298us
I20260501 13:59:41.150626 10494 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260501 13:59:41.213340  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.223523  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.167563  8373 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:41.229192  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:41.215806  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.959s (SENT)
I20260501 13:59:41.184635 10446 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:41.151443 10422 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:41.152261 10399 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.220589  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:41.232264  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:41.184031 10460 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:41.238361  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:41.236336  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.244819  8376 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 13:59:41.212194 10505 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.206312 10369 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.176538 10466 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 13:59:41.184145 10400 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.233188 10446 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:41.240185 10324 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:41.234090 10516 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:41.240362 10508 raft_consensus.cc:2764] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260501 13:59:41.265028  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 137093us
I20260501 13:59:41.228821 10421 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.248292 10460 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.240487 10429 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260501 13:59:41.240787 10399 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.305552 10422 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.306334 10080 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 13:59:41.306774  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 91012.7us
I20260501 13:59:41.263978  8373 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260501 13:59:41.307873  7828 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260501 13:59:41.316407  7749 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:41.246899 10514 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:41.263653 10426 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:41.313575  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:41.347575  7821 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:41.321180  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.321722  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.289215 10466 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.356670  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.355778  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:41.357586  7679 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 3: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:41.357815  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:41.324123  7676 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:41.351157  7675 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:41.352655  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:41.353986  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:41.354192  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:41.258071 10505 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:41.362763  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45976.3us
I20260501 13:59:41.380506  7672 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:41.382211  7822 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:41.382404  7746 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:41.383652  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:41.309125 10324 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.385412  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:41.388780  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:41.384783  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:41.385665  7823 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260501 13:59:41.385265  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 146236us
I20260501 13:59:41.389822  8372 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:41.389442  7820 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:41.384714  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:41.359421  8376 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.387102  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.387293  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:41.388695  7678 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:41.390985  8381 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:41.391750  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:41.392038  7819 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:41.393447  7819 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:41.387473  7821 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 13:59:41.399935 10327 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.401978 10327 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:41.405498  7827 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260501 13:59:41.406098  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:41.392946 10516 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:41.406803 10516 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:41.406985  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:41.407200 10516 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:41.298671 10462 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.407984 10514 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:41.408288 10462 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:41.408408 10514 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:41.408699 10462 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:41.408833 10514 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.409133 10462 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:41.410334 10522 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:41.410877 10522 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:41.411761 10522 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.412093 10400 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.411765 10466 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.308591 10460 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.420784  7677 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:41.421932  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:41.425655 10512 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:41.425652  8344 leader_election.cc:400] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6.
I20260501 13:59:41.426442 10512 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:41.426887 10512 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:41.429381  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:41.397387  7819 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.432695  8376 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:41.432926  7819 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.386760 10448 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.308239 10369 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.380165 10481 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260501 13:59:41.394456 10506 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.393644 10424 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:41.438995  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:41.393617 10469 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.416254 10493 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:41.430470 10416 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:41.465366  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:41.469336  7822 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:41.462997  7819 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:41.435454  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:41.384821 10446 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:41.480437 10521 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260501 13:59:41.483224 10421 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:41.483850  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:41.475768 10495 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260501 13:59:41.485620 10505 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:41.488211 10494 consensus_queue.cc:1059] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:41.451954 10448 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.490934 10448 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:41.462463 10506 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:41.434665 10266 consensus_queue.cc:1175] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "91854d93e96c4756834efe8b2ef59fce" responder_term: 5 status { last_received { term: 5 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 5 index: 8 } }
I20260501 13:59:41.464061 10493 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:41.451457 10327 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260501 13:59:41.448719 10260 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260501 13:59:41.509895 10487 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.511225 10460 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.511498 10446 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.501672 10416 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.499415  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:41.474385 10469 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:41.508280 10479 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:41.454075 10508 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260501 13:59:41.454438 10240 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260501 13:59:41.478361  8371 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Stepping down as leader of term 2
I20260501 13:59:41.516351  7824 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:41.512784 10416 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:41.530063  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:41.518771  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 89468.7us
I20260501 13:59:41.532742  8381 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260501 13:59:41.534013  8376 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260501 13:59:41.535161  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 69926.3us
W20260501 13:59:41.535903  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 98010.2us
I20260501 13:59:41.537629  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:41.535230  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:41.543725  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:41.546372  7821 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:41.513710 10493 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:41.547282  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.548027  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.522338 10469 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:41.548869  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:41.549727  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.551038  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.574572  7670 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:41.551237  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.551620  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.575731  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:41.576484  7670 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:41.577410  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.552795  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:41.554587  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:41.580065  7747 raft_consensus.cc:2368] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
I20260501 13:59:41.580164  7675 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:41.555588  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.580925  7745 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:41.556699  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.558565  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.560595  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:41.561928  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:41.587105  7821 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:41.562770  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:41.563256  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:41.564571  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:41.565419  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:41.569371  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.591367  7678 raft_consensus.cc:2376] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4. Re-sending same reply.
I20260501 13:59:41.591936  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:41.592756  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:41.584115  7749 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:41.594229  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.535981  8371 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:41.603533  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:41.604461  7676 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:41.605629  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:41.607998  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47505.6us
I20260501 13:59:41.545913 10399 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:41.541316 10479 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:41.588389 10505 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:41.589444 10469 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.497745 10324 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.588454 10346 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:41.598541 10424 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:41.567433 10522 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260501 13:59:41.596480 10421 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260501 13:59:41.622198  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.619419 10505 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:41.628525 10424 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:41.652428 10526 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260501 13:59:41.608583 10516 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.633322  7670 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:41.657908 10510 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260501 13:59:41.627445 10399 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260501 13:59:41.648823 10505 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.637568 10240 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260501 13:59:41.649664 10487 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:41.541844 10498 consensus_queue.cc:1175] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca8dd10afb304b4c96cfcec7e2309947" responder_term: 6 status { last_received { term: 4 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: [5.6-5.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260501 13:59:41.677260 10525 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:41.672643 10522 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:41.679908 10528 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260501 13:59:41.680552 10522 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:41.681926 10522 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.648679 10512 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.697402 10516 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.658793 10513 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:41.657255 10424 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.645798  8371 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.745464  8371 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 2 FOLLOWER]: Advancing to term 3
I20260501 13:59:41.749514  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 181) took 1667 ms. Trace:
I20260501 13:59:41.758999  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 291) took 1295 ms. Trace:
I20260501 13:59:41.762136 10429 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.762787 10429 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.763304 10479 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.765048 10429 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.767062 10346 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:41.759545  7576 rpcz_store.cc:276] 0501 13:59:40.464106 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:40.464337 (+   231us) service_pool.cc:224] Handling call
0501 13:59:41.758913 (+1294576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:40.644197 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:40.644779 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:40.644815 (+    36us) write_op.cc:435] Acquired schema lock
0501 13:59:40.644830 (+    15us) tablet.cc:662] Decoding operations
0501 13:59:40.645215 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:40.645267 (+    52us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:40.645297 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:40.645516 (+   219us) tablet.cc:701] Row locks acquired
0501 13:59:40.645528 (+    12us) write_op.cc:260] PREPARE: finished
0501 13:59:40.645663 (+   135us) write_op.cc:270] Start()
0501 13:59:40.645769 (+   106us) write_op.cc:276] Timestamp: P: 1777643980645619 usec, L: 0
0501 13:59:40.645785 (+    16us) op_driver.cc:348] REPLICATION: starting
0501 13:59:40.646422 (+   637us) log.cc:844] Serialized 538 byte log entry
0501 13:59:41.293393 (+646971us) op_driver.cc:464] REPLICATION: finished
0501 13:59:41.490898 (+197505us) write_op.cc:301] APPLY: starting
0501 13:59:41.490986 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:41.491093 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:41.491201 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:41.491457 (+   256us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:41.491662 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:41.491709 (+    47us) write_op.cc:312] APPLY: finished
0501 13:59:41.491933 (+   224us) log.cc:844] Serialized 23 byte log entry
0501 13:59:41.492111 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:41.492196 (+    85us) write_op.cc:454] Released schema lock
0501 13:59:41.492235 (+    39us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:41.492565 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:41.492590 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":264149,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":195298,"apply.run_cpu_time_us":1671,"apply.run_wall_time_us":1670,"num_ops":1,"prepare.queue_time_us":87021,"prepare.run_cpu_time_us":2457,"prepare.run_wall_time_us":2456,"replication_time_us":613680,"thread_start_us":136920,"threads_started":1}]]}
I20260501 13:59:41.779533  7675 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:41.749995  7573 rpcz_store.cc:276] 0501 13:59:40.082307 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:40.092743 (+ 10436us) service_pool.cc:224] Handling call
0501 13:59:41.749432 (+1656689us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:40.564417 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:40.565061 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:40.565099 (+    38us) write_op.cc:435] Acquired schema lock
0501 13:59:40.565119 (+    20us) tablet.cc:662] Decoding operations
0501 13:59:40.565535 (+   416us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:40.565592 (+    57us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:40.565625 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:40.565813 (+   188us) tablet.cc:701] Row locks acquired
0501 13:59:40.565831 (+    18us) write_op.cc:260] PREPARE: finished
0501 13:59:40.566025 (+   194us) write_op.cc:270] Start()
0501 13:59:40.566148 (+   123us) write_op.cc:276] Timestamp: P: 1777643980565934 usec, L: 0
0501 13:59:40.566169 (+    21us) op_driver.cc:348] REPLICATION: starting
0501 13:59:40.643606 (+ 77437us) log.cc:844] Serialized 533 byte log entry
0501 13:59:41.079608 (+436002us) op_driver.cc:464] REPLICATION: finished
0501 13:59:41.308863 (+229255us) write_op.cc:301] APPLY: starting
0501 13:59:41.312165 (+  3302us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:41.354650 (+ 42485us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:41.432230 (+ 77580us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:41.449665 (+ 17435us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:41.468375 (+ 18710us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:41.475040 (+  6665us) write_op.cc:312] APPLY: finished
0501 13:59:41.489692 (+ 14652us) log.cc:844] Serialized 23 byte log entry
0501 13:59:41.489900 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:41.489984 (+    84us) write_op.cc:454] Released schema lock
0501 13:59:41.490031 (+    47us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:41.490444 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:41.490475 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":211899,"apply.run_cpu_time_us":5096,"apply.run_wall_time_us":193671,"mutex_wait_us":3560,"num_ops":1,"prepare.queue_time_us":430548,"prepare.run_cpu_time_us":3341,"prepare.run_wall_time_us":79616,"replication_time_us":513268,"thread_start_us":495851,"threads_started":2}]]}
I20260501 13:59:41.650775 10462 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.763042 10512 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:41.802508  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 205401us
I20260501 13:59:41.777565 10516 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.817906  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:41.818454  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.818899  7677 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:41.781046 10467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:51762 (request call id 332) took 1866 ms. Trace:
I20260501 13:59:41.780825 10533 raft_consensus.cc:2764] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260501 13:59:41.810451 10421 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.838704  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:41.845113  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.846957  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:41.849625  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:41.850364  7748 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:41.861908  7749 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260501 13:59:41.845041 10346 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:41.835078 10512 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260501 13:59:41.844897 10460 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 13:59:41.864481  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 248505us
I20260501 13:59:41.869323  7826 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 2. Current term is 3. Ops: []
I20260501 13:59:41.832959 10516 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.869807  7751 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 13:59:41.869992  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:41.841058 10542 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:41.877044  7823 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:41.843628 10510 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260501 13:59:41.880600  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:41.884073  7748 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:41.844720 10421 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.893323  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:41.893963  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:41.893987  7751 raft_consensus.cc:606] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:41.895270  7751 raft_consensus.cc:614] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:41.902596  7826 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 13:59:41.905432  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:41.909273  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44507.4us
I20260501 13:59:41.877547 10346 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:41.906227 10240 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260501 13:59:41.912148  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:41.911772 10346 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.923620  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:41.929430 10532 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:41.930313  8381 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:41.892814 10542 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:41.932966  7827 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 13:59:41.935891  7824 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260501 13:59:41.916667 10447 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:41.947774  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:41.953575  7821 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:41.936800 10532 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:41.879206 10514 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.887917 10505 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.949215 10519 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260501 13:59:41.921375 10525 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 13:59:41.925884 10240 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260501 13:59:41.969907 10447 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:41.970417 10525 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:41.970856 10525 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:41.971799 10525 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:41.974313 10525 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:41.974575 10506 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:41.975811  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 64867.9us
I20260501 13:59:41.968446 10516 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.968775 10541 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:41.968535 10462 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:41.997520  7824 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:41.935727 10545 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:42.023613  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:42.028308  7822 raft_consensus.cc:606] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:42.028810  7822 raft_consensus.cc:614] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:41.971129 10447 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:41.831364 10467 rpcz_store.cc:276] 0501 13:59:39.853768 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:39.856977 (+  3209us) service_pool.cc:224] Handling call
0501 13:59:39.968702 (+111725us) ts_tablet_manager.cc:934] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
0501 13:59:40.765223 (+796521us) tablet_copy_client.cc:368] Tablet copy session begun
0501 13:59:41.095355 (+330132us) tablet_metadata.cc:665] Metadata flushed
0501 13:59:41.095537 (+   182us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 13:59:41.611036 (+515499us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 13:59:41.643772 (+ 32736us) tablet_replica.cc:206] Creating consensus instance
0501 13:59:41.668685 (+ 24913us) ts_tablet_manager.cc:989] Replica registered.
0501 13:59:41.716771 (+ 48086us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":13178,"tablet-copy.queue_time_us":92568,"thread_start_us":68044,"threads_started":2}
I20260501 13:59:42.038458  7792 leader_election.cc:400] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
I20260501 13:59:42.040323  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.044411  7792 leader_election.cc:403] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260501 13:59:42.046109  7823 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:42.045459  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.052891  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:42.051014  7819 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:42.054207  7748 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:42.056226  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:42.051029 10346 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:41.998636 10459 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260501 13:59:42.057657  7751 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:42.067324  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:42.068150  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.020442 10416 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260501 13:59:42.052675 10426 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
I20260501 13:59:42.058346 10483 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:41.997211 10498 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260501 13:59:42.027594 10240 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260501 13:59:42.070322 10346 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:42.055307 10545 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:42.071343  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539945233a6f4f6589f58e774245669e"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:42.026193 10479 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260501 13:59:42.068011 10459 consensus_queue.cc:1243] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 13:59:42.068236 10388 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:42.116320 10490 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260501 13:59:42.117448 10493 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.004s
I20260501 13:59:42.117309 10426 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:42.118872 10505 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:42.120043  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:42.129664  7746 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:42.078766 10467 tablet_copy_client.cc:806] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 13:59:42.122310 10422 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260501 13:59:42.070155 10513 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:42.179056  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:42.173453  7823 raft_consensus.cc:606] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:42.241693 10426 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:42.173044 10460 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.254779 10483 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:42.281797 10421 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:42.276620 10080 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:42.199172 10487 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260501 13:59:42.296936 10516 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.023620 10541 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.283516 10493 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.318328  7751 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260501 13:59:42.367942  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 276457us
I20260501 13:59:42.414710 10516 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:42.416046 10549 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260501 13:59:42.333253  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:42.290280 10553 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:42.406220  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:42.173228 10346 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:42.301232 10546 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.302722 10467 tablet_copy_client.cc:670] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 13:59:42.413491 10547 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.336956 10536 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:42.413867 10446 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.448899  7824 pending_rounds.cc:85] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 5
I20260501 13:59:42.429883 10553 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.460170  7824 pending_rounds.cc:107] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260501 13:59:42.339975 10539 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.460886  7824 raft_consensus.cc:2889] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:42.461269 10539 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.462085 10553 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:42.340224 10460 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:42.414129 10535 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260501 13:59:42.476066  7745 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 13:59:42.336674 10544 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:42.458585 10483 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:42.460074 10446 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.178447 10545 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.417663 10514 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:42.457803  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 228414us
I20260501 13:59:42.123564 10532 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:42.440621  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:42.463405 10539 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:42.469297  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 413126us
I20260501 13:59:42.417047 10516 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:42.317751 10426 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:42.410260 10388 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:42.412604 10568 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260501 13:59:42.520980  8374 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260501 13:59:42.522688  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.524202 10495 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:42.493153  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:42.526147  7747 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:42.526348  8372 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:42.526580  7747 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:42.484246  7748 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:42.434144 10400 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:42.457626 10546 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.490443  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:42.457644 10080 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.542546  7753 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:42.490744 10260 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.559597  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:42.490396  8373 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260501 13:59:42.554306  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 59437.4us
I20260501 13:59:42.557612  7745 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
W20260501 13:59:42.552265  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.013s	sys 0.021s
W20260501 13:59:42.565181  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.013s	sys 0.021s
W20260501 13:59:42.565493  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 972736us
I20260501 13:59:42.566936  7675 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260501 13:59:42.567660  7673 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260501 13:59:42.568455  7670 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260501 13:59:42.570408  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.527407  7747 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.516074 10512 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.497143 10553 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:42.571758  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.516824 10522 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:42.656545  7747 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:42.657225  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:42.661175  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 110866us
W20260501 13:59:42.572980  8371 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.003s
I20260501 13:59:42.666675  7676 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:42.665894  8372 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
W20260501 13:59:42.650570 10575 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260501 13:59:42.656085 10516 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader election won for term 3
I20260501 13:59:42.670029  8371 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:42.681070 10516 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:42.681474  8371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 460) took 1326 ms. Trace:
W20260501 13:59:42.681770 10574 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260501 13:59:42.681964  8371 rpcz_store.cc:276] 0501 13:59:41.354742 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.360030 (+  5288us) service_pool.cc:224] Handling call
0501 13:59:42.681373 (+1321343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:42.682242 10516 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.683422 10563 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260501 13:59:42.684087 10493 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:42.476706 10547 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.686487  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:42.534142 10388 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.478722 10536 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.650974 10260 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:42.665890 10553 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.519790 10544 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.659435 10512 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.572264 10400 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.672464 10514 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 13:59:42.814644  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:42.859964  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.566s (SENT)
W20260501 13:59:42.926908  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:42.736408  7672 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:42.927184  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:42.868786 10525 consensus_meta.cc:287] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.003s
W20260501 13:59:42.859318  7677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2310) took 1189 ms (client timeout 1512 ms). Trace:
I20260501 13:59:42.888696 10460 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:42.915062 10469 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.281s	user 0.007s	sys 0.005s
I20260501 13:59:42.725732 10579 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:42.695595 10421 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.288s
I20260501 13:59:42.690402 10240 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.929980 10514 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:42.723462 10561 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260501 13:59:42.913158 10562 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.931s	user 0.000s	sys 0.005s
W20260501 13:59:42.955299  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 95389.4us
I20260501 13:59:42.862154  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:43.013060  7745 raft_consensus.cc:606] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:42.971931 10563 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:42.864449 10505 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:42.978273  7677 rpcz_store.cc:269] 0501 13:59:41.546892 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.547027 (+   135us) service_pool.cc:224] Handling call
0501 13:59:42.730887 (+1183860us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002d4e54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:42.736037 (+  5150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575868672}
I20260501 13:59:42.981133  7753 raft_consensus.cc:2410] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260501 13:59:42.914378 10558 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260501 13:59:42.912786 10560 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260501 13:59:42.703892  8374 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:42.718909 10582 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:42.913527 10543 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:42.930577  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 358822us
I20260501 13:59:42.673369 10522 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:42.917119 10446 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:42.916498 10080 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:42.912274 10541 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:42.844744  7747 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260501 13:59:42.695379 10494 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260501 13:59:42.955590 10495 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:42.998206 10469 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:42.719411 10565 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260501 13:59:42.845222 10508 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:43.062981  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 142659us
I20260501 13:59:42.987646 10579 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:43.043064  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:43.013093  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.917s (SENT) [suppressed 27 similar messages]
W20260501 13:59:43.065748  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:43.066089  7677 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:43.011749 10514 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:43.049763  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260501 13:59:43.050968  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:42.732578 10584 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.370s
I20260501 13:59:43.035672 10388 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:42.980353 10369 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:43.011271 10240 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.077028  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.078078  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.079212  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:43.105480  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 62558.7us
I20260501 13:59:43.125495  7821 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:43.125818  7822 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:43.108925  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45058.1us
I20260501 13:59:43.131290  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:43.131984  7822 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:43.132632  7821 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260501 13:59:43.058480 10547 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.072659 10541 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:43.064675 10446 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.194520  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.035295 10505 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.193946  7673 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:43.072881 10579 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:43.201503  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:43.078941 10460 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.067840 10546 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.246763  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.217686  7823 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260501 13:59:43.236563  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:43.287074  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.311499  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.312770  7826 raft_consensus.cc:2410] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260501 13:59:43.286013  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:43.217653 10561 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260501 13:59:43.055667 10543 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.313534  7820 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:43.194733 10388 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.319541  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1549) took 1365 ms. Trace:
I20260501 13:59:43.321105  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.322400  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.283458 10600 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.337236  7819 rpcz_store.cc:276] 0501 13:59:41.944160 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.944340 (+   180us) service_pool.cc:224] Handling call
0501 13:59:41.944734 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:42.053790 (+109056us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.309659 (+1255869us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400297054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.309937 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243784448}
I20260501 13:59:43.346159  7822 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
W20260501 13:59:43.349300  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 221581us
W20260501 13:59:43.321538 10426 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.006s
I20260501 13:59:43.073702 10508 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.053884 10582 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:43.366371  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 368) took 1811 ms. Trace:
I20260501 13:59:43.235945 10541 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.368598  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 372) took 1807 ms. Trace:
I20260501 13:59:43.364107 10426 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.379438 10426 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:43.274253 10446 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.285288 10460 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.382697  7819 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 13:59:43.349018 10260 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:43.384189  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:43.347674 10593 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.339227 10536 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.388183 10240 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.366874  7678 rpcz_store.cc:276] 0501 13:59:41.555475 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.592924 (+ 37449us) service_pool.cc:224] Handling call
0501 13:59:41.593203 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:41.841822 (+248619us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:41.841854 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:41.851735 (+  9881us) log.cc:844] Serialized 26 byte log entry
0501 13:59:41.961734 (+109999us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:42.123885 (+162151us) log.cc:844] Serialized 14 byte log entry
0501 13:59:42.124118 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.124230 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.366074 (+1241844us) raft_consensus.cc:1685] finished
0501 13:59:43.366105 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.366272 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":503077,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":91331,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":18578304,"thread_start_us":416808,"threads_started":3,"wal-append.queue_time_us":554147}
I20260501 13:59:43.362051 10516 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.317498 10547 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:43.374485  7674 rpcz_store.cc:276] 0501 13:59:41.557287 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.611485 (+ 54198us) service_pool.cc:224] Handling call
0501 13:59:41.622902 (+ 11417us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:41.787109 (+164207us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:41.787164 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:41.931326 (+144162us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b2c000014c8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 13:59:41.931793 (+   467us) log.cc:844] Serialized 26 byte log entry
0501 13:59:42.071452 (+139659us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:42.071661 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.072015 (+   354us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.348141 (+1276126us) raft_consensus.cc:1685] finished
0501 13:59:43.348176 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.364291 (+ 16115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59262,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":73728896,"thread_start_us":263075,"threads_started":2,"wal-append.queue_time_us":190910}
I20260501 13:59:43.363858 10400 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:43.396185 10598 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260501 13:59:43.335531 10546 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260501 13:59:43.352433 10388 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.388331 10446 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.365162 10512 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:43.389156 10424 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.608s	user 0.014s	sys 0.002s
W20260501 13:59:43.441958  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 428894us
I20260501 13:59:43.382465 10587 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.400857  8374 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260501 13:59:43.384925 10553 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.432106  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:43.469556  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 116991us
I20260501 13:59:43.472321  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.477535  7745 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:43.430799 10586 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.481289  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.476656  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.486061  7748 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:43.486650  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:43.459640 10601 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260501 13:59:43.480754  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.018s
W20260501 13:59:43.500432  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.013s	sys 0.018s
I20260501 13:59:43.457182 10547 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.459879 10446 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.375910 10544 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.461741 10522 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.509549  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:43.528437  7748 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:43.368155 10600 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.507506 10260 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.482151 10469 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.465752 10587 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:43.516919 10605 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260501 13:59:43.475287 10400 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260501 13:59:43.475996 10563 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.520063 10594 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.520640 10599 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260501 13:59:43.521382 10606 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:43.521991 10483 consensus_meta.cc:287] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.002s	user 0.010s	sys 0.000s
I20260501 13:59:43.525414  7823 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:43.526477  7821 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:43.475530 10553 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.475772 10512 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.367936 10495 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.448477 10516 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.499809 10080 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:43.513023 10592 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.550544  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.589830  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:43.591398  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:43.556746  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:43.507731 10546 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.517457 10582 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.460112 10424 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.523671 10506 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.578451 10543 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.580356 10587 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.580586 10460 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.535058 10446 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.527854 10547 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.583951 10505 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:43.632958 10585 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260501 13:59:43.630014 10506 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:43.584893 10584 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.586788 10614 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.634856 10584 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.634954 10614 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.601156 10532 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.636293 10532 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.637157 10584 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.586911 10080 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:43.637897 10080 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:43.638542 10532 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.587534 10512 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.584841 10541 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.589880  7820 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:43.560890 10610 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.596700  7748 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:43.579618 10600 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.612403 10588 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.653664 10588 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.614317 10603 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.589576 10592 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.541716 10604 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.278s
I20260501 13:59:43.576759 10594 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.662979 10424 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.622400 10546 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.616984  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.665792  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.585836 10553 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:43.617553 10602 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260501 13:59:43.619374  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1375) took 1049 ms. Trace:
I20260501 13:59:43.557574 10590 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.299s
I20260501 13:59:43.672895 10546 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.676406 10588 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.678925 10592 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.680728 10516 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.682008 10388 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.683192  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2486) took 1184 ms. Trace:
I20260501 13:59:43.685477  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2484) took 1487 ms. Trace:
I20260501 13:59:43.683728  7749 rpcz_store.cc:276] 0501 13:59:42.498663 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.498822 (+   159us) service_pool.cc:224] Handling call
0501 13:59:42.499203 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:42.548451 (+ 49248us) raft_consensus.cc:1534] Early marking committed up to index 6
0501 13:59:42.928056 (+379605us) log.cc:844] Serialized 14 byte log entry
0501 13:59:43.205450 (+277394us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.205979 (+   529us) log.cc:844] Serialized 26 byte log entry
0501 13:59:43.206152 (+   173us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:43.206199 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.206299 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.584661 (+378362us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b1800413620. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:43.682801 (+ 98140us) raft_consensus.cc:1685] finished
0501 13:59:43.682939 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.683094 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":495684,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":299582,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":32872,"spinlock_wait_cycles":6117632,"thread_start_us":547694,"threads_started":3,"wal-append.queue_time_us":406730}
I20260501 13:59:43.685921  7752 rpcz_store.cc:276] 0501 13:59:42.198574 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.198796 (+   222us) service_pool.cc:224] Handling call
0501 13:59:42.290651 (+ 91855us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:42.666591 (+375940us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.666624 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:42.666667 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:42.666697 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.685225 (+1018528us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400115b54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.685287 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.685416 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861252352}
I20260501 13:59:43.686940  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:43.687399  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.573488 10563 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.620534  7671 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:43.689504  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1366) took 1123 ms. Trace:
I20260501 13:59:43.689831  7671 rpcz_store.cc:276] 0501 13:59:42.566037 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.566192 (+   155us) service_pool.cc:224] Handling call
0501 13:59:42.566655 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.688429 (+1121774us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.689270 (+   841us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540036ced4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.689440 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422999936}
W20260501 13:59:43.690490 10369 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260501 13:59:43.673650  7676 rpcz_store.cc:276] 0501 13:59:42.569920 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.688098 (+118178us) service_pool.cc:224] Handling call
0501 13:59:42.688850 (+   752us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:42.984675 (+295825us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.984724 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:42.996606 (+ 11882us) log.cc:844] Serialized 26 byte log entry
0501 13:59:43.211685 (+215079us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:43.211726 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.211866 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.619088 (+407222us) raft_consensus.cc:1685] finished
0501 13:59:43.619113 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.619270 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":327523,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11026,"thread_start_us":462036,"threads_started":2,"wal-append.queue_time_us":319960}
I20260501 13:59:43.621976  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.635558  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 922) took 1200 ms. Trace:
I20260501 13:59:43.588575 10613 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.498474 10586 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.508605 10593 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.700709  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.654290  7754 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260501 13:59:43.574329 10483 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.558542 10260 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.709156 10260 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:43.652958 10610 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.660300  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.576653 10606 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.669476  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.668694 10603 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:43.660024 10595 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.334s	user 0.001s	sys 0.001s
I20260501 13:59:43.672776 10594 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.672887 10547 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.696223 10609 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.690742 10563 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.696696 10446 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.700464 10399 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.647545 10607 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:43.699548 10447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.008s	sys 0.016s
I20260501 13:59:43.655711 10506 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:43.692607  8381 rpcz_store.cc:276] 0501 13:59:42.434753 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.434902 (+   149us) service_pool.cc:224] Handling call
0501 13:59:42.435276 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:42.450300 (+ 15024us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.450349 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:42.477927 (+ 27578us) log.cc:844] Serialized 52 byte log entry
0501 13:59:42.696001 (+218074us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:42.767595 (+ 71594us) log.cc:844] Serialized 14 byte log entry
0501 13:59:42.845868 (+ 78273us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.845955 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.635256 (+789301us) raft_consensus.cc:1685] finished
0501 13:59:43.635277 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.635465 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77913,"prepare.queue_time_us":71340,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":111747,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":19363,"thread_start_us":139748,"threads_started":1,"wal-append.queue_time_us":570223}
I20260501 13:59:43.703524 10600 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.707459  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2479) took 1648 ms. Trace:
I20260501 13:59:43.703994 10584 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.716286  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1374) took 1146 ms. Trace:
I20260501 13:59:43.717278  7750 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:43.718523 10593 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:43.763729  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:43.765806  7746 rpcz_store.cc:276] 0501 13:59:42.058673 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.058814 (+   141us) service_pool.cc:224] Handling call
0501 13:59:43.707190 (+1648376us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b5400116054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:43.707354 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141588224}
I20260501 13:59:43.765303  7673 rpcz_store.cc:276] 0501 13:59:42.569653 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.569788 (+   135us) service_pool.cc:224] Handling call
0501 13:59:42.570118 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:43.234930 (+664812us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.716040 (+481110us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54003f3754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.716219 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434203008}
I20260501 13:59:43.723275  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:43.774075  7749 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:43.739100 10260 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:43.736935 10609 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:43.763079 10447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.008s	sys 0.016s
I20260501 13:59:43.730768  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:43.750355 10266 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:43.781469  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50843.1us
I20260501 13:59:43.783993  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:43.786091  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:43.749840 10596 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:43.794713  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:43.795389  7673 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:43.796321  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:43.797040  7673 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:43.792693 10462 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.797871 10594 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.787194 10460 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.798413 10594 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.798772 10462 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.798957 10460 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.808743  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:43.809726  7677 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260501 13:59:43.802085  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:43.787631 10506 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:43.793152 10563 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:43.818137  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1373) took 1248 ms. Trace:
I20260501 13:59:43.791395 10260 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:43.812222  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:43.822436  7676 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:43.818609  7670 rpcz_store.cc:276] 0501 13:59:42.569355 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.569467 (+   112us) service_pool.cc:224] Handling call
0501 13:59:42.569719 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:42.570049 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.570077 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:42.657536 (+ 87459us) log.cc:844] Serialized 26 byte log entry
0501 13:59:42.999355 (+341819us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:42.999411 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.999518 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.817911 (+818393us) raft_consensus.cc:1685] finished
0501 13:59:43.817933 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.818070 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":284,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":80176,"thread_start_us":263250,"threads_started":1,"wal-append.queue_time_us":384845}
I20260501 13:59:43.778167 10547 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:43.790151 10614 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.815135  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:43.716521 10613 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.813886 10460 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.840844 10429 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:43.775665 10584 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.816351 10553 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.768515 10446 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:43.823438  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:43.793237 10266 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.827010  7673 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:43.799599 10603 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.813007 10347 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:43.810012 10388 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.832429  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:43.805553 10596 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:43.872964  7670 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:43.873526 10596 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:43.838425  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.839041  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.815593  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.840341  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.840646  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1372) took 1272 ms. Trace:
I20260501 13:59:43.779706 10600 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.807747 10594 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.841622  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.763191 10399 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.885073  7820 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:43.841331 10429 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:43.888204  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.778689 10607 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:43.827471 10579 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.539s	user 0.013s	sys 0.000s
I20260501 13:59:43.846398 10618 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:43.807096 10447 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260501 13:59:43.818137 10563 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:43.873106 10586 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.825699  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2480) took 1754 ms. Trace:
W20260501 13:59:43.885540  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 70016.3us
I20260501 13:59:43.891521  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:43.889036  7828 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:43.922288  7751 rpcz_store.cc:276] 0501 13:59:42.071348 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.071547 (+   199us) service_pool.cc:224] Handling call
0501 13:59:42.071957 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:42.415030 (+343073us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.825442 (+1410412us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54001077d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.825632 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565709568}
I20260501 13:59:43.886246  7675 rpcz_store.cc:276] 0501 13:59:42.567759 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.567922 (+   163us) service_pool.cc:224] Handling call
0501 13:59:42.568233 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:42.994257 (+426024us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.994313 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:42.994989 (+   676us) log.cc:844] Serialized 26 byte log entry
0501 13:59:43.008113 (+ 13124us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:43.008173 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.826523 (+818350us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540005a5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.826592 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:43.826660 (+    68us) raft_consensus.cc:1685] finished
0501 13:59:43.826682 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:43.840567 (+ 13885us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2070,"raft.queue_time_us":304903,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":13074,"spinlock_wait_cycles":380702208,"thread_start_us":271428,"threads_started":2,"wal-append.queue_time_us":202541}
W20260501 13:59:43.875094 10346 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.395s	user 0.015s	sys 0.000s
W20260501 13:59:43.889946  8343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.019s	sys 0.041s
W20260501 13:59:43.924067  8343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.020s	sys 0.041s
I20260501 13:59:43.814354 10479 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260501 13:59:43.898461  7676 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:43.924881 10606 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.926056  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:43.881814 10610 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.899140  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:43.919983  7820 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:43.842366 10547 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.926640  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.927070  7676 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:43.898756  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.886560 10582 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:43.896963 10462 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.901413 10347 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:43.957621  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 58556us
I20260501 13:59:43.921200 10563 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:43.845292 10532 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260501 13:59:43.961932  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.852873 10614 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260501 13:59:43.896051 10536 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.969496 10628 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:43.874794 10446 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:43.958411 10621 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.258s	user 0.002s	sys 0.001s
I20260501 13:59:43.900815 10543 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260501 13:59:43.981617 10625 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260501 13:59:43.984072  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 85469.7us
I20260501 13:59:43.984511 10625 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:43.984927 10625 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:43.981257 10446 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.985702  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.901753 10579 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.976601 10613 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.900022 10388 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.967504 10505 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:43.977931  8380 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:43.991273  7670 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:43.991304  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.978751  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:43.979554  8373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 340) took 2448 ms. Trace:
I20260501 13:59:43.927697 10260 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.981212 10547 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.981395 10422 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:43.953023 10513 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:43.975178  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:43.984180 10447 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260501 13:59:43.975224  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.000s	sys 0.022s
I20260501 13:59:43.987038  7676 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260501 13:59:44.007684  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.000s	sys 0.022s
I20260501 13:59:43.923666 10346 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.992401  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:43.997385  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.009413  7825 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:44.010128  7674 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:43.970963 10600 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:43.995496  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:43.964756 10627 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:43.976621 10584 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:43.968909 10582 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:43.936861 10618 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.988050 10628 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:43.990401  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:43.989228 10536 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:43.997572 10505 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:44.010967 10447 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:44.050940  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:44.070864  7822 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:44.039391 10586 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:44.037678 10422 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:44.067759 10505 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:44.029182 10547 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:44.036481 10600 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 13:59:44.000365  7673 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:44.054133 10632 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:44.068595 10399 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:44.073675 10514 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.879s	user 0.008s	sys 0.007s
W20260501 13:59:44.148068  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.034s	sys 0.072s
W20260501 13:59:44.159277  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.034s	sys 0.072s
I20260501 13:59:44.074128 10447 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:44.068018 10629 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:43.996937  8373 rpcz_store.cc:276] 0501 13:59:41.531606 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.534875 (+  3269us) service_pool.cc:224] Handling call
0501 13:59:41.535220 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:42.651931 (+1116711us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:43.979213 (+1327282us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540051d954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:43.979467 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137248000}
I20260501 13:59:44.110895 10586 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:44.258639 10607 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:44.110180 10547 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:44.068176 10628 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:44.289052 10629 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:44.039911 10627 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:44.289835 10629 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:44.017040 10513 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:44.309031 10627 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:44.056052 10347 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:44.221128 10399 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:44.319700  7751 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260501 13:59:44.320343  7751 pending_rounds.cc:85] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 6
I20260501 13:59:44.320606  7751 pending_rounds.cc:107] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260501 13:59:44.320850  7751 raft_consensus.cc:2889] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:44.327338  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.283895 10586 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:44.328178  7670 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:44.291917 10547 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:44.345458  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.346625  7674 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:44.352699  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.353654  7676 raft_consensus.cc:2410] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:44.298390 10607 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:44.220098 10514 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:44.283146 10479 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260501 13:59:44.366572  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:44.959208  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1689) took 1428 ms. Trace:
I20260501 13:59:44.640465  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:44.310815 10628 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:44.433743  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.026s	sys 0.033s
W20260501 13:59:44.401629  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 89274.9us
W20260501 13:59:44.961939  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.034s	sys 0.047s
I20260501 13:59:44.459170  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.406699  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.971375  7670 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:44.510479  7828 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:44.442267  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:44.959194  7748 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:44.960163  7754 rpcz_store.cc:276] 0501 13:59:43.530752 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.530906 (+   154us) service_pool.cc:224] Handling call
0501 13:59:43.653227 (+122321us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.706339 (+ 53112us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:44.958920 (+1252581us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540026f7d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:44.959121 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280368384}
I20260501 13:59:45.003978  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:44.739670 10080 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.101s	user 0.012s	sys 0.003s
I20260501 13:59:44.715165 10467 tablet_copy_client.cc:538] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 13:59:45.021548  7670 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:44.572351 10524 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:44.723289 10603 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:44.723343 10485 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:45.084990  7674 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 13:59:44.512650 10346 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:44.881464 10600 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:45.125072  8372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.004s	sys 0.048s
W20260501 13:59:45.125422  8372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.004s	sys 0.048s
I20260501 13:59:45.075073  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:44.898264 10638 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:44.424655 10579 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:45.078891  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:44.416956 10400 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:44.317618 10459 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.685s
I20260501 13:59:44.367801 10266 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:44.508585  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:44.548118 10632 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:44.422837  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:45.085780  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 374) took 1284 ms. Trace:
I20260501 13:59:45.164464  7674 rpcz_store.cc:276] 0501 13:59:43.801807 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.016672 (+1214865us) service_pool.cc:224] Handling call
0501 13:59:45.084632 (+ 67960us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.085449 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.085701 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.086711  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:45.166447  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1379) took 1133 ms. Trace:
I20260501 13:59:45.166951  7676 rpcz_store.cc:276] 0501 13:59:44.033318 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.003516 (+970198us) service_pool.cc:224] Handling call
0501 13:59:45.166359 (+162843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.073138  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1384) took 1038 ms. Trace:
W20260501 13:59:44.708092  7745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.011s	sys 0.045s
W20260501 13:59:45.168579  7745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.011s	sys 0.056s
I20260501 13:59:45.168395  7670 rpcz_store.cc:276] 0501 13:59:44.034943 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.003597 (+968654us) service_pool.cc:224] Handling call
0501 13:59:45.072989 (+ 69392us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:45.123860  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.009s	sys 0.027s
W20260501 13:59:45.169682  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.009s	sys 0.027s
I20260501 13:59:44.999352 10607 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:45.124761  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.024s	sys 0.028s
W20260501 13:59:45.175648  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.024s	sys 0.028s
I20260501 13:59:45.124953  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260501 13:59:45.127772  7675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.018s	sys 0.035s
W20260501 13:59:45.177241  7675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.018s	sys 0.035s
W20260501 13:59:45.126096  7750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.008s	sys 0.019s
I20260501 13:59:44.761600 10447 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.134300  7828 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:44.351018 10399 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:44.513211 10612 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.618s
I20260501 13:59:44.340708 10422 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:45.163180  7792 connection.cc:254] RPC call timeout handler was delayed by -1.4370202409999138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260501 13:59:45.126873 10543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.025s	sys 0.027s
I20260501 13:59:45.123711  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:45.173629  8379 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:45.124119 10524 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:45.132126 10600 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:45.178349  7750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.009s	sys 0.019s
I20260501 13:59:45.132968 10536 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.078799 10080 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.752408 10399 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.753330  7752 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:45.124861 10485 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.124318 10603 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:45.555676  8381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.560s	user 0.039s	sys 0.025s
I20260501 13:59:45.180524  7670 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:45.210521  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1688) took 1680 ms. Trace:
I20260501 13:59:45.201231  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:45.755702  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.009s	sys 0.000s
W20260501 13:59:45.755548  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.008s	sys 0.008s
I20260501 13:59:45.177809  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:45.819847  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.010s
W20260501 13:59:45.819489  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.011s	sys 0.000s
W20260501 13:59:45.700615  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.003s	sys 0.007s
W20260501 13:59:45.820827  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.003s	sys 0.011s
W20260501 13:59:45.821141  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 1.24513e+06us
W20260501 13:59:45.213053  7825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1540) took 2080 ms (client timeout 2129 ms). Trace:
W20260501 13:59:45.746101  8379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 348) took 1755 ms (client timeout 1894 ms). Trace:
I20260501 13:59:45.740711  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:45.306134  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 376) took 1487 ms. Trace:
W20260501 13:59:45.705214  7749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.005s	sys 0.005s
I20260501 13:59:45.202409 10266 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:45.204888 10635 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260501 13:59:45.359109 10505 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.202s	user 0.014s	sys 0.000s
I20260501 13:59:45.723519 10483 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.734688  7673 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:45.297600  7573 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:45.748875 10600 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.332278 10627 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:45.244864 10388 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.478648 10416 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:45.211189 10540 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 3.093s	user 0.012s	sys 0.015s
I20260501 13:59:45.212610 10643 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:45.258985 10629 consensus_meta.cc:287] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.968s	user 0.008s	sys 0.005s
I20260501 13:59:45.750766  7822 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:45.751055 10514 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:45.572913  7821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.467s	user 0.021s	sys 0.099s
W20260501 13:59:45.856618  7821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.750s	user 0.022s	sys 0.105s
W20260501 13:59:45.850874  8374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.009s
I20260501 13:59:45.489828 10609 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.749749  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 603) took 1416 ms. Trace:
I20260501 13:59:45.860718  7754 rpcz_store.cc:276] 0501 13:59:44.333515 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.122936 (+789421us) service_pool.cc:224] Handling call
0501 13:59:45.749682 (+626746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.237223 10429 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.754410  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 375) took 1952 ms. Trace:
W20260501 13:59:45.818058  8381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.822s	user 0.042s	sys 0.032s
I20260501 13:59:45.863605  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:45.849586 10505 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:45.819480  7792 connection.cc:254] RPC call timeout handler was delayed by -1.3741466599999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260501 13:59:45.864987  7674 rpcz_store.cc:276] 0501 13:59:43.802059 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.180749 (+1378690us) service_pool.cc:224] Handling call
0501 13:59:45.753780 (+573031us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.754003 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:45.754036 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:45.754090 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:45.754136 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.754200 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.754341 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.223047  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:45.822242  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:45.822427  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 377) took 1977 ms. Trace:
I20260501 13:59:45.679574 10632 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.866811  7670 rpcz_store.cc:276] 0501 13:59:43.844899 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.179628 (+1334729us) service_pool.cc:224] Handling call
0501 13:59:45.180102 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.822005 (+641903us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.822335 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:45.755142  7751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.003s	sys 0.008s
W20260501 13:59:45.822449  8379 rpcz_store.cc:269] 0501 13:59:43.990813 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.037908 (+ 47095us) service_pool.cc:224] Handling call
0501 13:59:45.746016 (+1708108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:45.303524 10551 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 3.371s	user 0.006s	sys 0.032s
W20260501 13:59:45.824002  8380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 349) took 1815 ms (client timeout 2192 ms). Trace:
W20260501 13:59:45.868507  7751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.008s	sys 0.008s
I20260501 13:59:45.206027  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1370) took 2638 ms. Trace:
I20260501 13:59:45.356683  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 344) took 1384 ms. Trace:
W20260501 13:59:45.824484  7749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.007s	sys 0.007s
W20260501 13:59:45.824671  7825 rpcz_store.cc:269] 0501 13:59:43.132781 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.133906 (+  1125us) service_pool.cc:224] Handling call
0501 13:59:45.212801 (+2078895us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540025e754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:45.212954 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771685760}
I20260501 13:59:45.823658  7676 rpcz_store.cc:276] 0501 13:59:43.818540 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.180834 (+1362294us) service_pool.cc:224] Handling call
0501 13:59:45.305455 (+124621us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.305691 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:45.305729 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:45.305785 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:45.305830 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.305902 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.306052 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.818498  7745 rpcz_store.cc:276] 0501 13:59:43.530441 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.530584 (+   143us) service_pool.cc:224] Handling call
0501 13:59:43.530907 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.897467 (+366560us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.897516 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.921419 (+ 23903us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.169191 (+1247772us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:45.169252 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.169367 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.210291 (+ 40924us) raft_consensus.cc:1685] finished
0501 13:59:45.210322 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.210455 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53849,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"thread_start_us":1570812,"threads_started":2,"wal-append.queue_time_us":1188762}
W20260501 13:59:45.702937 10260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.005s	sys 0.004s
W20260501 13:59:45.721350 10644 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260501 13:59:45.831634  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45436 (request call id 517) took 1430 ms. Trace:
I20260501 13:59:45.875001  7670 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 13:59:45.832449  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:45.833588 10266 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.834265 10080 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.834290 10645 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:45.835345 10485 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.835690 10610 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:45.838130 10479 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:45.888260 10645 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.888628 10479 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.889514  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2329) took 2094 ms. Trace:
I20260501 13:59:45.890234  7674 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:45.890671 10645 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.137771 10638 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.832459 10623 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260501 13:59:45.741364 10628 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.745s	user 0.005s	sys 0.005s
I20260501 13:59:45.840159 10603 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.848541  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 378) took 1962 ms. Trace:
I20260501 13:59:45.892853 10638 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.893067  7673 rpcz_store.cc:276] 0501 13:59:43.886625 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.733725 (+1847100us) service_pool.cc:224] Handling call
0501 13:59:45.734174 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.848257 (+114083us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.848481 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.889901  7675 rpcz_store.cc:276] 0501 13:59:43.794823 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.954238 (+159415us) service_pool.cc:224] Handling call
0501 13:59:43.954702 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.966002 (+ 11300us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.966070 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.966721 (+   651us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.177658 (+1210937us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:45.202798 (+ 25140us) log.cc:844] Serialized 14 byte log entry
0501 13:59:45.203063 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.203189 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.889273 (+686084us) raft_consensus.cc:1685] finished
0501 13:59:45.889295 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.889447 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4141,"prepare.queue_time_us":711819,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":15711,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":9768,"thread_start_us":1186543,"threads_started":1,"wal-append.queue_time_us":1578908}
I20260501 13:59:45.860237 10643 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.896206  7826 raft_consensus.cc:2410] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260501 13:59:45.896781 10643 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.860018 10629 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:45.897673  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1571) took 2045 ms. Trace:
I20260501 13:59:45.898043  7826 rpcz_store.cc:276] 0501 13:59:43.851783 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.222677 (+1370894us) service_pool.cc:224] Handling call
0501 13:59:45.897474 (+674797us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54002607d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:45.897614 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67488512}
I20260501 13:59:45.899021  7748 raft_consensus.cc:2368] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5.
I20260501 13:59:45.900456  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:45.901563  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:45.901803  7753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 592) took 3342 ms (client timeout 2121 ms). Trace:
I20260501 13:59:45.902123  7748 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:45.902249  7753 rpcz_store.cc:269] 0501 13:59:42.559118 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.559320 (+   202us) service_pool.cc:224] Handling call
0501 13:59:45.901587 (+3342267us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540022b854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:45.901714 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966845312}
I20260501 13:59:45.903172  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2323) took 2110 ms. Trace:
I20260501 13:59:45.903376  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:45.903990  7753 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:45.903613  7671 rpcz_store.cc:276] 0501 13:59:43.793088 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.793227 (+   139us) service_pool.cc:224] Handling call
0501 13:59:43.793619 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.800407 (+  6788us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.800437 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.802950 (+  2513us) log.cc:844] Serialized 26 byte log entry
0501 13:59:44.108560 (+305610us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:44.254788 (+146228us) log.cc:844] Serialized 14 byte log entry
0501 13:59:44.315245 (+ 60457us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:44.315329 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.835437 (+1520108us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b1800417fa0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:45.901254 (+ 65817us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4800030cd8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2ff6191a1 00007fb2ff610237 00007fb2ff6100ca 00007fb2ff70792f 00007fb2ff7075f7 00007fb2ff71bc1c 00007fb2ff71bbc8 00007fb2ff71bb48 00007fb2ff71bb03 00007fb2ff71adac 00007fb2fe643b36
0501 13:59:45.902944 (+  1690us) raft_consensus.cc:1685] finished
0501 13:59:45.902974 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.903093 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165101,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":11190,"raft.queue_time_us":21317,"raft.run_cpu_time_us":40113,"raft.run_wall_time_us":2113047,"spinlock_wait_cycles":24501248,"thread_start_us":303199,"threads_started":1,"wal-append.queue_time_us":960425}
W20260501 13:59:45.220778 10567 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 2.914s	user 0.018s	sys 0.016s
W20260501 13:59:45.201859 10566 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 2.793s	user 0.014s	sys 0.014s
W20260501 13:59:45.761173 10625 consensus_meta.cc:287] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.776s	user 0.010s	sys 0.007s
W20260501 13:59:45.764148 10563 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.789s	user 0.010s	sys 0.005s
W20260501 13:59:45.695933 10586 consensus_meta.cc:287] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.329s	user 0.014s	sys 0.001s
I20260501 13:59:45.140563 10513 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:45.813938 10596 consensus_meta.cc:287] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.940s	user 0.011s	sys 0.005s
W20260501 13:59:45.357844 10547 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.966s	user 0.008s	sys 0.008s
W20260501 13:59:45.206566 10636 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260501 13:59:45.568437 10532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.541s	user 0.034s	sys 0.068s
I20260501 13:59:45.737152 10607 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:45.236913 10581 log.cc:927] Time spent T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 2.502s	user 0.005s	sys 0.015s
W20260501 13:59:45.819840 10543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.803s	user 0.046s	sys 0.049s
W20260501 13:59:45.224340 10634 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260501 13:59:45.746305 10524 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:45.848982  7717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.006s	sys 0.010s
I20260501 13:59:45.236174 10633 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:45.563503 10571 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:45.210331 10508 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.236512  8373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 351) took 1204 ms. Trace:
I20260501 13:59:45.352859 10618 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:45.854913  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.507s	user 0.010s	sys 0.008s
I20260501 13:59:45.760506  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:45.857666  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1565) took 2020 ms. Trace:
W20260501 13:59:45.968609  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.621s	user 0.010s	sys 0.008s
I20260501 13:59:45.555445 10649 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:45.564255  7678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.253s	user 0.038s	sys 0.066s
I20260501 13:59:45.214339  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2328) took 1419 ms. Trace:
W20260501 13:59:45.969020  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 1.65206e+06us
I20260501 13:59:45.210080  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 924) took 2764 ms. Trace:
W20260501 13:59:45.865944  7792 connection.cc:254] RPC call timeout handler was delayed by -1.0759711369998968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260501 13:59:45.854305 10627 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.871521  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:45.872108  7819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.005s	sys 0.024s
W20260501 13:59:45.977113  7819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.006s	sys 0.025s
I20260501 13:59:45.969909  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:45.941946 10532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.923s	user 0.036s	sys 0.074s
I20260501 13:59:45.968787  7821 rpcz_store.cc:276] 0501 13:59:43.836893 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.844045 (+  7152us) service_pool.cc:224] Handling call
0501 13:59:43.844361 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:43.852037 (+  7676us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 13:59:44.105986 (+253949us) log.cc:844] Serialized 14 byte log entry
0501 13:59:45.857214 (+1751228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:45.857276 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:45.857341 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.857414 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.857587 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":742406,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":45344,"raft.queue_time_us":1339,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":1388,"thread_start_us":1969462,"threads_started":2}
I20260501 13:59:45.969702  8376 rpcz_store.cc:276] 0501 13:59:42.445519 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.463876 (+ 18357us) service_pool.cc:224] Handling call
0501 13:59:42.464249 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:42.985935 (+521686us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.985983 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:42.986049 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0501 13:59:42.986100 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.209817 (+2223717us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540035a054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:45.209870 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.210016 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199060736}
I20260501 13:59:45.931977 10654 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:45.869828  8372 rpcz_store.cc:276] 0501 13:59:43.972378 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.982003 (+  9625us) service_pool.cc:224] Handling call
0501 13:59:43.984870 (+  2867us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.987953 (+  3083us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.987986 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.989264 (+  1278us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.125794 (+1136530us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:45.125840 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.125922 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.356412 (+230490us) raft_consensus.cc:1685] finished
0501 13:59:45.356443 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.356609 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3923,"raft.queue_time_us":5181,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":9393,"thread_start_us":1135382,"threads_started":1,"wal-append.queue_time_us":1364287}
W20260501 13:59:45.859624  8374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.006s	sys 0.009s
I20260501 13:59:45.874979  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:45.875993  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1380) took 1842 ms. Trace:
I20260501 13:59:45.986104  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:45.986346  7670 rpcz_store.cc:276] 0501 13:59:44.033664 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.874443 (+1840779us) service_pool.cc:224] Handling call
0501 13:59:45.874828 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.875658 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.875932 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.722810 10512 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:45.877012  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54857.4us
I20260501 13:59:45.875339  7828 rpcz_store.cc:276] 0501 13:59:44.401342 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.191810 (+790468us) service_pool.cc:224] Handling call
0501 13:59:45.831560 (+639750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.884405  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 520) took 1409 ms. Trace:
I20260501 13:59:45.989480  7825 rpcz_store.cc:276] 0501 13:59:44.474666 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.882845 (+1408179us) service_pool.cc:224] Handling call
0501 13:59:45.883443 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.883646 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:45.883673 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:45.883718 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:45.883750 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.883803 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.884339 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 13:59:45.873055 10260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.005s	sys 0.008s
I20260501 13:59:45.886060  7676 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:45.964862 10513 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:45.993898  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1383) took 1959 ms. Trace:
I20260501 13:59:45.886855  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:45.856911 10416 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:45.866811 10429 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:45.888415 10610 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.890758 10479 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.147600 10400 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:45.706043 10347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.002s	sys 0.007s
I20260501 13:59:45.899510 10629 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.917058  7748 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:45.919304 10266 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.920163  7674 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:46.047678  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1382) took 2013 ms. Trace:
I20260501 13:59:45.989106 10649 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.048058  7674 rpcz_store.cc:276] 0501 13:59:44.034214 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.875584 (+1841370us) service_pool.cc:224] Handling call
0501 13:59:45.890106 (+ 14522us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.047385 (+157279us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.047614 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.938665  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:45.941651  7717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.006s	sys 0.010s
W20260501 13:59:46.049329  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.049728  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.049834 10649 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:45.964857  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1691) took 2414 ms. Trace:
W20260501 13:59:45.969516  7678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.043s	sys 0.071s
I20260501 13:59:46.050926  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.051548  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2324) took 2258 ms. Trace:
I20260501 13:59:46.036322 10447 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.051635  7826 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:45.869045  7672 rpcz_store.cc:276] 0501 13:59:42.567168 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.567285 (+   117us) service_pool.cc:224] Handling call
0501 13:59:42.736162 (+168877us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:42.979098 (+242936us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.205777 (+2226679us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54002d4e50. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:45.205939 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179877632}
I20260501 13:59:46.052938 10627 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:46.053634  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.054248  7826 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:45.977686  7753 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260501 13:59:46.055109 10582 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:45.969563  7677 rpcz_store.cc:276] 0501 13:59:43.794563 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.896462 (+101899us) service_pool.cc:224] Handling call
0501 13:59:43.920053 (+ 23591us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:43.983264 (+ 63211us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.983309 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:43.983362 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:43.983406 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.214082 (+1230676us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54002ba7d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:45.214142 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:45.214277 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144881536}
W20260501 13:59:45.868362  8380 rpcz_store.cc:269] 0501 13:59:44.008874 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.009008 (+   134us) service_pool.cc:224] Handling call
0501 13:59:45.740538 (+1731530us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:45.823935 (+ 83397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3065216}
W20260501 13:59:45.964656 10551 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260501 13:59:45.987371  7792 connection.cc:254] RPC call timeout handler was delayed by -1.007296730999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260501 13:59:46.055982  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.056622 10479 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:46.056658  7792 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.512s (SENT)
I20260501 13:59:45.988016  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.057235  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 929) took 2091 ms. Trace:
I20260501 13:59:46.051321 10446 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:46.057243  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:46.057173 10479 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.994619  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.057873  8374 rpcz_store.cc:276] 0501 13:59:43.965595 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.972993 (+  7398us) service_pool.cc:224] Handling call
0501 13:59:44.005803 (+ 32810us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:44.572035 (+566232us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:44.587792 (+ 15757us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:45.123328 (+535536us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.729057 (+605729us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b48000f0558. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2ff6191a1 00007fb2ff610237 00007fb2ff6100ca 00007fb2ff70792f 00007fb2ff7075f7 00007fb2ff71bc1c 00007fb2ff71bbc8 00007fb2ff71bb48 00007fb2ff71bb03 00007fb2ff71adac 00007fb2fe643b36
0501 13:59:45.998558 (+269501us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:46.004751 (+  6193us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.035350 (+ 30599us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.056897 (+ 21547us) raft_consensus.cc:1685] finished
0501 13:59:46.056914 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.057168 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":510001,"raft.queue_time_us":528411,"raft.run_cpu_time_us":24533,"raft.run_wall_time_us":1157010,"spinlock_wait_cycles":10059008,"thread_start_us":777847,"threads_started":1,"wal-append.queue_time_us":741774}
I20260501 13:59:46.059397  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:46.035259  8371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 353) took 1999 ms (client timeout 2038 ms). Trace:
W20260501 13:59:46.060307  8371 rpcz_store.cc:269] 0501 13:59:44.032952 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.739766 (+1706814us) service_pool.cc:224] Handling call
0501 13:59:46.032416 (+292650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.995783  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.060768 10421 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:45.994272  7676 rpcz_store.cc:276] 0501 13:59:44.034550 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.871251 (+1836701us) service_pool.cc:224] Handling call
0501 13:59:45.885861 (+ 14610us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.993640 (+107779us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.993840 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.061340  7828 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:46.062274  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:45.917234 10625 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.063309  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:45.997278  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.064149  7825 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:46.004503 10587 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260501 13:59:46.064990  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:45.967595 10571 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.067754 10571 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.068396  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 511) took 3649 ms. Trace:
I20260501 13:59:46.090378  7824 rpcz_store.cc:276] 0501 13:59:42.418535 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.418717 (+   182us) service_pool.cc:224] Handling call
0501 13:59:42.448591 (+ 29874us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:42.462159 (+ 13568us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:42.462209 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:42.463106 (+   897us) log.cc:844] Serialized 52 byte log entry
0501 13:59:42.552875 (+ 89769us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:42.552934 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.553034 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.002634 (+2449600us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:46.032809 (+1030175us) raft_consensus.cc:1685] finished
0501 13:59:46.032840 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.068328 (+ 35488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1959,"raft.queue_time_us":7449,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":1692,"spinlock_wait_cycles":214926720,"thread_start_us":89317,"threads_started":1,"wal-append.queue_time_us":206577}
I20260501 13:59:46.092540  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.093030 10610 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.093168  7824 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 3.
I20260501 13:59:46.094066  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.095193  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:45.997226  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:45.996194  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 352) took 1963 ms. Trace:
I20260501 13:59:46.051986  7678 rpcz_store.cc:276] 0501 13:59:43.793420 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.796004 (+  2584us) service_pool.cc:224] Handling call
0501 13:59:43.796299 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.800329 (+  4030us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.800367 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.800883 (+   516us) log.cc:844] Serialized 26 byte log entry
0501 13:59:44.160145 (+359262us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:46.050880 (+1890735us) log.cc:844] Serialized 14 byte log entry
0501 13:59:46.051115 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.051212 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.051276 (+    64us) raft_consensus.cc:1685] finished
0501 13:59:46.051298 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.051464 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66839,"prepare.queue_time_us":121153,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":64,"raft.queue_time_us":6615,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":6289,"thread_start_us":2094235,"threads_started":2,"wal-append.queue_time_us":898909}
W20260501 13:59:46.001191  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.701s (SENT)
W20260501 13:59:45.997995  7718 connection.cc:254] RPC call timeout handler was delayed by -1.5589237949999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260501 13:59:45.978001 10588 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:45.931494 10586 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.928987 10563 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:46.098739  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 103342us
W20260501 13:59:46.099349  7718 connection.cc:254] RPC call timeout handler was delayed by -1.0657237949999399s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260501 13:59:46.099524  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:45.985608 10508 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.032226  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1546) took 4060 ms. Trace:
I20260501 13:59:45.931675 10596 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.033540  8377 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260501 13:59:45.941727 10547 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.994192 10654 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.034794 10657 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.040107  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 371) took 4483 ms. Trace:
I20260501 13:59:46.042165 10400 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.043756 10416 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
W20260501 13:59:46.007450 10347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.003s	sys 0.012s
W20260501 13:59:46.046120 10647 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260501 13:59:46.046660  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.113893  7748 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:46.055943  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:45.964795 10481 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:45.999948 10513 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:45.967945  8373 rpcz_store.cc:276] 0501 13:59:44.032237 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.341249 (+309012us) service_pool.cc:224] Handling call
0501 13:59:45.236414 (+895165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.117638  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 928) took 2152 ms. Trace:
I20260501 13:59:46.117594  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.118351  8373 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:46.118652 10532 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:46.119212  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:46.119554  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.120288  8373 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.120406  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.121044  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.120518 10547 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.122229  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.123263 10596 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.122888 10524 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.107121  7827 rpcz_store.cc:276] 0501 13:59:41.941878 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.942022 (+   144us) service_pool.cc:224] Handling call
0501 13:59:41.942344 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:41.942698 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:41.942730 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:41.950759 (+  8029us) log.cc:844] Serialized 26 byte log entry
0501 13:59:42.048067 (+ 97308us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:42.048119 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.048203 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.220062 (+3171859us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:45.996480 (+776418us) raft_consensus.cc:1685] finished
0501 13:59:45.996522 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.002015 (+  5493us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23117,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":24963328,"thread_start_us":96883,"threads_started":1,"wal-append.queue_time_us":177485}
I20260501 13:59:46.124090  7747 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.124508  8373 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:46.127552 10654 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.128616  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.130434 10481 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.131330  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.132191  8371 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:46.108539  7679 rpcz_store.cc:276] 0501 13:59:41.556842 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:41.594379 (+ 37537us) service_pool.cc:224] Handling call
0501 13:59:41.594719 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:41.811047 (+216328us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:41.811096 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:41.862316 (+ 51220us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b2c000014c8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 13:59:41.871234 (+  8918us) log.cc:844] Serialized 52 byte log entry
0501 13:59:42.012490 (+141256us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:42.108648 (+ 96158us) log.cc:844] Serialized 14 byte log entry
0501 13:59:42.124894 (+ 16246us) log.cc:844] Serialized 14 byte log entry
0501 13:59:42.130631 (+  5737us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:42.130752 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:45.148516 (+3017764us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 13:59:46.039787 (+891271us) raft_consensus.cc:1685] finished
0501 13:59:46.039842 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.040013 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35584,"prepare.queue_time_us":880415,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":7723,"raft.queue_time_us":99124,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":43185,"spinlock_wait_cycles":36162176,"thread_start_us":385724,"threads_started":3,"wal-append.queue_time_us":412209}
I20260501 13:59:46.113842 10629 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260501 13:59:46.124655  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.080802 10625 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:46.050563  7752 rpcz_store.cc:276] 0501 13:59:43.531475 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.698598 (+167123us) service_pool.cc:224] Handling call
0501 13:59:43.699142 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:45.753724 (+2054582us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.945836 (+192112us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54000af854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:45.946125 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4723730176}
I20260501 13:59:46.081483 10467 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 13:59:46.124565 10479 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:45.999470 10514 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260501 13:59:46.134094 10481 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:46.118098  8381 rpcz_store.cc:276] 0501 13:59:43.965233 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.965388 (+   155us) service_pool.cc:224] Handling call
0501 13:59:43.965752 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:43.966192 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:43.966235 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:43.975860 (+  9625us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.862924 (+1887064us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:45.862971 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.863045 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.117424 (+254379us) raft_consensus.cc:1685] finished
0501 13:59:46.117447 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.117569 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":18829,"thread_start_us":1866736,"threads_started":1,"wal-append.queue_time_us":1935775}
I20260501 13:59:46.141563  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.142817  8381 raft_consensus.cc:2410] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260501 13:59:46.081694  7823 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:46.082278 10505 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.082753  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 601) took 1759 ms. Trace:
I20260501 13:59:46.136889  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.143721  7751 rpcz_store.cc:276] 0501 13:59:44.323439 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.323624 (+   185us) service_pool.cc:224] Handling call
0501 13:59:44.324095 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:44.324566 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:44.324606 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:44.336886 (+ 12280us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.869036 (+1532150us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:45.869085 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.869160 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.082541 (+213381us) raft_consensus.cc:1685] finished
0501 13:59:46.082567 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.082694 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":910285,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":1445773,"threads_started":1,"wal-append.queue_time_us":1577138}
I20260501 13:59:46.136940  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:45.969079 10633 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.084653  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1560) took 2560 ms. Trace:
I20260501 13:59:46.146423  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:45.998661 10543 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:46.057780  8376 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:46.086678  7750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 599) took 1769 ms. Trace:
I20260501 13:59:46.138095  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.087203  7821 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:46.148876  7824 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 3.
I20260501 13:59:46.145013  8380 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:46.002804 10631 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:46.088965  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.148613  7750 rpcz_store.cc:276] 0501 13:59:44.317562 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.317686 (+   124us) service_pool.cc:224] Handling call
0501 13:59:44.348264 (+ 30578us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:45.754397 (+1406133us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:45.754428 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:45.755018 (+   590us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.950653 (+195635us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:45.950708 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.950817 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.086457 (+135640us) raft_consensus.cc:1685] finished
0501 13:59:46.086482 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.086613 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":903506,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":1557063,"threads_started":2,"wal-append.queue_time_us":250799}
I20260501 13:59:46.089781  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:46.096164  8379 rpcz_store.cc:276] 0501 13:59:44.032619 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.874362 (+1841743us) service_pool.cc:224] Handling call
0501 13:59:45.996130 (+121768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:45.985976  7754 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:46.097151  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:46.156566  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.156764  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:46.156925  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 155743us
I20260501 13:59:46.002081  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.055104  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.100759  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.101663 10588 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.103103 10563 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.103963 10447 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:46.101042 10610 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:46.098389 10578 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:46.105792  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 597) took 1790 ms. Trace:
I20260501 13:59:46.106205 10586 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.107537 10550 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:46.056784  8375 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:46.118359 10513 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.122787  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.147138  7819 rpcz_store.cc:276] 0501 13:59:43.524031 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.524152 (+   121us) service_pool.cc:224] Handling call
0501 13:59:43.524556 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:44.997449 (+1472893us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:44.997498 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:45.074416 (+ 76918us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.977584 (+903168us) raft_consensus.cc:1645] Marking committed up to 2
0501 13:59:45.977636 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:45.977736 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.084435 (+106699us) raft_consensus.cc:1685] finished
0501 13:59:46.084460 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.084589 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130324,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2119,"thread_start_us":2260422,"threads_started":2,"wal-append.queue_time_us":859555}
I20260501 13:59:46.138152  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.153580  7828 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:46.089491  7822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45436 (request call id 519) took 1655 ms (client timeout 1728 ms). Trace:
I20260501 13:59:46.154989  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:46.159605  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58926.1us
I20260501 13:59:46.250897  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 598) took 1934 ms. Trace:
I20260501 13:59:46.248370  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:46.344017  7748 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:46.250962  7745 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.235347  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:46.325392  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:46.176411  8344 connection.cc:254] RPC call timeout handler was delayed by -1.5566491869999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260501 13:59:46.234848  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 175147us
I20260501 13:59:46.107065 10508 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.353103  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:46.346840  8344 connection.cc:254] RPC call timeout handler was delayed by -1.5566491869999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260501 13:59:46.345770  7746 rpcz_store.cc:276] 0501 13:59:44.315720 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.315950 (+   230us) service_pool.cc:224] Handling call
0501 13:59:44.348194 (+ 32244us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:45.304705 (+956511us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:45.304755 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:45.350345 (+ 45590us) log.cc:844] Serialized 26 byte log entry
0501 13:59:45.823391 (+473046us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:45.823455 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.105302 (+281847us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54001068d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:46.105369 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.105438 (+    69us) raft_consensus.cc:1685] finished
0501 13:59:46.105459 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.105715 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":689,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":23947,"spinlock_wait_cycles":2198424960,"thread_start_us":334449,"threads_started":1,"wal-append.queue_time_us":435550}
W20260501 13:59:46.354259  8344 connection.cc:254] RPC call timeout handler was delayed by -1.3660837009999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30910000000000004s for a response
I20260501 13:59:46.353812  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.251216  7825 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
W20260501 13:59:46.343432  7822 rpcz_store.cc:269] 0501 13:59:44.434563 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.549418 (+114855us) service_pool.cc:224] Handling call
0501 13:59:46.089278 (+1539860us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54002e1dd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.089413 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817807744}
I20260501 13:59:46.248826  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.348938  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.343472  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:46.349606  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 206111us
I20260501 13:59:46.345898  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.108647 10516 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:46.352285  8375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 350) took 2313 ms (client timeout 1944 ms). Trace:
I20260501 13:59:46.352898  7751 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.361967  7792 leader_election.cc:400] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5.
I20260501 13:59:46.362326  7792 leader_election.cc:403] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:46.355666  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.162761 10514 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:46.358681  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.359848  7827 raft_consensus.cc:2410] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260501 13:59:46.354604  8344 connection.cc:254] RPC call timeout handler was delayed by -1.1010287279998465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260501 13:59:46.135249 10629 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:46.137763  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.360464  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.360795  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.362123  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.362401 10610 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.139887 10532 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:46.363734  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.377858  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:46.347589  7749 rpcz_store.cc:276] 0501 13:59:44.316718 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.316915 (+   197us) service_pool.cc:224] Handling call
0501 13:59:44.349147 (+ 32232us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:45.879105 (+1529958us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:45.879130 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:45.885822 (+  6692us) log.cc:844] Serialized 52 byte log entry
0501 13:59:46.035714 (+149892us) raft_consensus.cc:1645] Marking committed up to 8
0501 13:59:46.035770 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.035897 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.250586 (+214689us) raft_consensus.cc:1685] finished
0501 13:59:46.250617 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.250814 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":902831,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":1009352,"threads_started":2,"wal-append.queue_time_us":318086}
I20260501 13:59:46.249439  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.225633  8374 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.384776  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.352118 10446 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260501 13:59:46.364607  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.322569 10524 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:46.365285  7826 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:46.322815 10633 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.365481  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.138222 10648 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:46.162803 10631 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.367317  7748 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:46.367950  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:46.361449  8375 rpcz_store.cc:269] 0501 13:59:44.031757 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.034859 (+  3102us) service_pool.cc:224] Handling call
0501 13:59:45.930066 (+1895207us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:46.344739 (+414673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3904256}
I20260501 13:59:46.370666  7751 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.402398  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.371255  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:46.371474  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.404922 10485 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.405525 10485 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:46.405587  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.406226 10485 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.406564  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.406544  7751 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:46.404167  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.357085 10508 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.377041  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.377259  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.352010 10550 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.352666 10447 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.352051 10578 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.423594  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.425410 10578 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.425587  7753 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:46.425424 10447 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.427078  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 604) took 2091 ms. Trace:
I20260501 13:59:46.162858 10543 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.427502  7751 rpcz_store.cc:276] 0501 13:59:44.335261 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.425741 (+2090480us) service_pool.cc:224] Handling call
0501 13:59:46.426541 (+   800us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.426749 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.426777 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.426825 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:46.426863 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.426920 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.427019 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.429325 10543 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:46.429709  7751 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:46.429901  7754 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:46.430356  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 605) took 2086 ms. Trace:
I20260501 13:59:46.390064  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.385236 10416 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:46.391443  7750 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260501 13:59:46.368918 10513 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 5
I20260501 13:59:46.395040  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2502) took 1222 ms. Trace:
I20260501 13:59:46.446627  7745 rpcz_store.cc:276] 0501 13:59:45.172512 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.871218 (+698706us) service_pool.cc:224] Handling call
0501 13:59:46.394775 (+523557us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003ac0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.394958 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594727808}
I20260501 13:59:46.447825  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:46.448311  7745 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.448974  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:46.369947 10629 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.396829  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.398167  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.453076  7750 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.453701  7826 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260501 13:59:46.398339  7747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1695) took 2832 ms (client timeout 1664 ms). Trace:
I20260501 13:59:46.370574 10429 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:46.419699  7824 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:46.456722  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.456638  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:46.420583  7827 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:46.443445 10633 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.418522 10524 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:46.432199  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.363972  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.433380  7822 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260501 13:59:46.434574 10588 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:46.435448  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 347) took 2447 ms. Trace:
W20260501 13:59:46.436527  7823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1566) took 2599 ms (client timeout 2192 ms). Trace:
I20260501 13:59:46.436662  7820 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:46.437072 10550 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:46.472759  7823 rpcz_store.cc:269] 0501 13:59:43.837226 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.838734 (+  1508us) service_pool.cc:224] Handling call
0501 13:59:46.436263 (+2597529us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400298e54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.436407 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5017847680}
I20260501 13:59:46.437161 10631 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.477306  7828 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:46.472008  8377 rpcz_store.cc:276] 0501 13:59:43.988407 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.988512 (+   105us) service_pool.cc:224] Handling call
0501 13:59:44.311977 (+323465us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:46.108135 (+1796158us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.435181 (+327046us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54004b1254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:46.435386 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3915666816}
I20260501 13:59:46.421053  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.438549  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.400313 10584 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:46.419379 10563 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:46.444262  7751 rpcz_store.cc:276] 0501 13:59:44.344391 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.429213 (+2084822us) service_pool.cc:224] Handling call
0501 13:59:46.429535 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.430123 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.430305 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.450161  7819 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:46.442863 10324 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
I20260501 13:59:46.383214 10532 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.457710  7821 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:46.443965 10604 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260501 13:59:46.455291  7747 rpcz_store.cc:269] 0501 13:59:43.565472 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.600586 (+ 35114us) service_pool.cc:224] Handling call
0501 13:59:46.398048 (+2797462us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54000ae954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.398216 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5591811456}
I20260501 13:59:46.457866  7752 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 13:59:46.464986 10629 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:46.470443  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 106557us
I20260501 13:59:46.470543  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.493947  7828 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: [6.5-7.6]
W20260501 13:59:46.497462  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 59006.2us
I20260501 13:59:46.408157 10648 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.471343 10446 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:46.467161 10633 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:46.508313  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.471391 10524 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:46.504603  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.493736 10584 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.521535  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.525807  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.527316  7746 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:46.519502  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.543732  7750 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.527709  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.528412  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:46.520865 10505 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.015s
I20260501 13:59:46.522794 10613 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:46.498631 10550 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:46.498335 10324 consensus_queue.cc:1243] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer bc1b0a0a152e46fea4bd4934ba9976ed log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:46.540877  7749 raft_consensus.cc:2410] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260501 13:59:46.545677  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:46.540994  7745 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:46.544979  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.547019  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.547175  7821 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.547708  7828 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:46.540274 10524 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.550890  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:46.555992  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2506) took 1343 ms. Trace:
I20260501 13:59:46.556564  7745 rpcz_store.cc:276] 0501 13:59:45.212632 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.549159 (+1336527us) service_pool.cc:224] Handling call
0501 13:59:46.549562 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.549824 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.549862 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.549923 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:46.555651 (+  5728us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.555759 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.555918 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.557782  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.559161  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2507) took 1346 ms. Trace:
I20260501 13:59:46.559718  7745 rpcz_store.cc:276] 0501 13:59:45.212930 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.558166 (+1345236us) service_pool.cc:224] Handling call
0501 13:59:46.558537 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.558754 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.558792 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.558851 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0501 13:59:46.558897 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.558970 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.559094 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.560474  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.562059  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.562698  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2509) took 1349 ms. Trace:
I20260501 13:59:46.546161 10613 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.570925 10613 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.572729 10613 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:46.576468  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:46.577080  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2503) took 1402 ms. Trace:
I20260501 13:59:46.577546  7751 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.577711 10532 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.579340 10532 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.584467  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2512) took 1369 ms. Trace:
I20260501 13:59:46.586033  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:46.590087  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.597378  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.577569  7746 rpcz_store.cc:276] 0501 13:59:45.174456 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.543270 (+1368814us) service_pool.cc:224] Handling call
0501 13:59:46.576409 (+ 33139us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.576666 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.576703 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.576765 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:46.576809 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.576878 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.577007 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.518069 10563 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:46.593307 10421 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:46.575130 10485 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.608215  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 515) took 2207 ms. Trace:
I20260501 13:59:46.608853  7750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2505) took 1396 ms. Trace:
I20260501 13:59:46.609266  7750 rpcz_store.cc:276] 0501 13:59:45.212215 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.546934 (+1334719us) service_pool.cc:224] Handling call
0501 13:59:46.547234 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:46.580289 (+ 33055us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.580333 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:46.580980 (+   647us) log.cc:844] Serialized 26 byte log entry
0501 13:59:46.581169 (+   189us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:46.581217 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.581299 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:46.608648 (+ 27349us) raft_consensus.cc:1685] finished
0501 13:59:46.608669 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.608795 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42235}
I20260501 13:59:46.527387 10633 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.594096  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2504) took 1401 ms. Trace:
I20260501 13:59:46.620615  7747 rpcz_store.cc:276] 0501 13:59:45.192845 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.544838 (+1351993us) service_pool.cc:224] Handling call
0501 13:59:46.593565 (+ 48727us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.593763 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.593802 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.593855 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:46.593895 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.593947 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.594042 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.527968 10629 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.622927  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:46.623378  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 172623us
I20260501 13:59:46.551774 10516 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:46.599321  7751 rpcz_store.cc:276] 0501 13:59:45.214591 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.578366 (+1363775us) service_pool.cc:224] Handling call
0501 13:59:46.578748 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.578970 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.579010 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.579066 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:46.579112 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.579183 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.584390 (+  5207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.593580  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2513) took 1378 ms. Trace:
I20260501 13:59:46.632275  7752 rpcz_store.cc:276] 0501 13:59:45.214909 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.592722 (+1377813us) service_pool.cc:224] Handling call
0501 13:59:46.593040 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.593224 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.593258 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.593319 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0501 13:59:46.593365 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.593427 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.593527 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.633852  7752 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:46.540412 10514 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:46.625555  7746 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:46.591413 10547 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:46.608054 10421 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:46.605562 10610 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:46.636257  7573 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 7, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:46.607038 10446 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:46.605124  7821 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:46.612416  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:46.608620  7820 rpcz_store.cc:276] 0501 13:59:44.400619 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:44.402001 (+  1382us) service_pool.cc:224] Handling call
0501 13:59:46.436405 (+2034404us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:46.479074 (+ 42669us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.607997 (+128923us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b5400298e50. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.608145 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4606871424}
I20260501 13:59:46.614583 10586 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:46.656858  7822 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:46.619436  7828 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:46.635213  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2499) took 1560 ms. Trace:
I20260501 13:59:46.660317  7754 rpcz_store.cc:276] 0501 13:59:45.074414 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.431731 (+1357317us) service_pool.cc:224] Handling call
0501 13:59:46.592527 (+160796us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.600955 (+  8428us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.600985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.601030 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0501 13:59:46.601068 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.601150 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.635044 (+ 33894us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540012c0d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.635149 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8021,"raft.queue_time_us":8268,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"spinlock_wait_cycles":368997632}
I20260501 13:59:46.648166  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.662889  7749 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:46.550772 10543 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260501 13:59:46.569171  7745 rpcz_store.cc:276] 0501 13:59:45.213569 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.561703 (+1348134us) service_pool.cc:224] Handling call
0501 13:59:46.562043 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:46.562303 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.562340 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:46.562399 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:46.562443 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.562513 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:46.562634 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:46.664875  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.641955  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 299) took 6204 ms. Trace:
I20260501 13:59:46.552002 10578 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260501 13:59:46.650758  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.663554 10599 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.641324 10516 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:46.606706 10648 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:46.639803 10514 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.639569 10513 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5.
I20260501 13:59:46.633051 10619 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260501 13:59:46.679029  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 90111.6us
I20260501 13:59:46.645463 10421 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.655522 10657 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:46.672178  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.648618  7573 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 4 to 5, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted, no longer has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:46.671267 10599 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.672585 10651 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:46.668430  7577 rpcz_store.cc:276] 0501 13:59:40.437982 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:40.439043 (+  1061us) service_pool.cc:224] Handling call
0501 13:59:46.641884 (+6202841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:40.821923 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:40.822524 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:40.822562 (+    38us) write_op.cc:435] Acquired schema lock
0501 13:59:40.822575 (+    13us) tablet.cc:662] Decoding operations
0501 13:59:40.823430 (+   855us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:40.823483 (+    53us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:40.823508 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0501 13:59:40.824155 (+   647us) tablet.cc:701] Row locks acquired
0501 13:59:40.824170 (+    15us) write_op.cc:260] PREPARE: finished
0501 13:59:40.824320 (+   150us) write_op.cc:270] Start()
0501 13:59:40.824464 (+   144us) write_op.cc:276] Timestamp: P: 1777643980824266 usec, L: 0
0501 13:59:40.824489 (+    25us) op_driver.cc:348] REPLICATION: starting
0501 13:59:40.825240 (+   751us) log.cc:844] Serialized 2835 byte log entry
0501 13:59:41.470452 (+645212us) op_driver.cc:464] REPLICATION: finished
0501 13:59:41.492906 (+ 22454us) write_op.cc:301] APPLY: starting
0501 13:59:41.492979 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:41.493172 (+   193us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:41.493322 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:41.609920 (+116598us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:41.637331 (+ 27411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0501 13:59:41.643848 (+  6517us) write_op.cc:312] APPLY: finished
0501 13:59:41.668471 (+ 24623us) log.cc:844] Serialized 59 byte log entry
0501 13:59:41.735970 (+ 67499us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:41.767166 (+ 31196us) write_op.cc:454] Released schema lock
0501 13:59:41.767239 (+    73us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:41.767768 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:41.767809 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1287,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":17556,"apply.run_cpu_time_us":4347,"apply.run_wall_time_us":274749,"num_ops":7,"prepare.queue_time_us":2751,"prepare.run_cpu_time_us":3623,"prepare.run_wall_time_us":12628,"replication_time_us":634047,"thread_start_us":94645,"threads_started":1}]]}
I20260501 13:59:46.673748 10516 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.671972 10446 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:46.671294 10586 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:46.656394 10604 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260501 13:59:46.679389 10467 tablet_bootstrap.cc:700] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Time spent opening tablet: real 0.206s	user 0.002s	sys 0.000s
I20260501 13:59:46.678239 10514 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:46.706243  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 108925us
I20260501 13:59:46.702185  7573 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 5, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:46.703431 10599 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.718917  7573 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:46.688580 10657 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.702982 10632 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.704092 10651 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.720711  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.707152 10516 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:46.728688  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.730074 10610 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:46.734153  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.741953  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.744095 10596 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:46.744617 10596 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.745458 10596 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.748378  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.704535 10563 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.725801 10632 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:46.731506 10651 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:46.752143  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 105915us
I20260501 13:59:46.733484 10610 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:46.740221 10547 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.738202 10550 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260501 13:59:46.752267 10446 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.761325  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.748070 10485 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.767971 10543 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.768606 10543 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.769025 10543 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.772248 10347 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:46.766106 10684 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260501 13:59:46.776183  7753 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:46.755329 10632 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.761246 10610 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:46.799595  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.761641 10547 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:46.731877 10586 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:46.820045  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.823320  7827 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:46.825157 10429 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:46.826107 10429 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:46.809549 10613 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:46.838157  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.826433 10429 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.809414 10547 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.837246 10613 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:46.843376 10685 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260501 13:59:46.845990  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 150924us
W20260501 13:59:46.844247 10678 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260501 13:59:46.854104  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.853826 10508 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.855604  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.858210  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:46.862349  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.870505  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:46.872175  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 138084us
I20260501 13:59:46.874395 10684 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:46.874797 10684 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:46.875149 10684 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.876106  7827 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260501 13:59:46.877074 10682 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.156s	user 0.002s	sys 0.002s
I20260501 13:59:46.878058 10582 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:46.846565 10685 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:46.896595  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.902369  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.906201  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.909718  7748 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:46.847038 10657 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:46.858566 10485 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260501 13:59:46.918169  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 45193.5us
I20260501 13:59:46.905094 10685 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.916847  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.918995  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:46.925417  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:46.927246  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.895975  8373 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:46.942648 10584 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.944732  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.889093 10429 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.948503 10429 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:46.948191 10421 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:46.925204 10694 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:46.950847  7819 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:46.968892  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.960433  7748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2498) took 1967 ms. Trace:
I20260501 13:59:46.960850  7751 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260501 13:59:46.996891  7792 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.917s (SENT)
I20260501 13:59:46.970073  7748 rpcz_store.cc:276] 0501 13:59:44.992783 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.406318 (+1413535us) service_pool.cc:224] Handling call
0501 13:59:46.960161 (+553843us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540026e3d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:46.960358 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148166400}
I20260501 13:59:47.012354  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.938006  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:46.919889 10613 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.013785  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:46.968505 10525 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Stepping down as leader of term 3
W20260501 13:59:47.034332  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.034539 10582 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:47.027889 10648 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:46.959383 10694 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:47.076900 10694 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.078346 10694 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:46.995667 10584 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:47.083058  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2519) took 1094 ms. Trace:
I20260501 13:59:47.083555  7747 rpcz_store.cc:276] 0501 13:59:45.989046 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.621653 (+632607us) service_pool.cc:224] Handling call
0501 13:59:46.636569 (+ 14916us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:46.644792 (+  8223us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:46.644835 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:46.670521 (+ 25686us) log.cc:844] Serialized 26 byte log entry
0501 13:59:46.848548 (+178027us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:46.848603 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:46.848684 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:47.082788 (+234104us) raft_consensus.cc:1685] finished
0501 13:59:47.082813 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:47.082981 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":623,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":13218,"thread_start_us":168323,"threads_started":1,"wal-append.queue_time_us":351683}
I20260501 13:59:47.088724 10657 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:46.950683 10689 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260501 13:59:47.114202 10400 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:47.114897 10400 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:47.114348 10696 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:47.120821  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 609) took 1077 ms. Trace:
I20260501 13:59:47.121416  7751 rpcz_store.cc:276] 0501 13:59:46.043769 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.636566 (+592797us) service_pool.cc:224] Handling call
0501 13:59:46.960523 (+323957us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:46.971088 (+ 10565us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:47.120527 (+149439us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540026e3d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:47.120730 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684320000}
I20260501 13:59:47.043411 10525 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:47.071259 10582 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:47.075032 10648 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:47.061939  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.159128 10654 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:47.160005  7792 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.130s (SENT)
W20260501 13:59:47.172518  7792 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.138s (SENT)
I20260501 13:59:47.168498  7819 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:47.175895  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.184303  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:47.185875  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:47.153467 10421 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:47.186887  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:47.170899 10582 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.200126  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:47.161929 10508 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:47.212759  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 285588us
W20260501 13:59:47.244052  7643 connection.cc:254] RPC call timeout handler was delayed by -2.5891443989999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260501 13:59:47.247045  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:47.248005  7821 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260501 13:59:47.248277  7748 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:47.249611  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.247156  7828 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260501 13:59:47.252367  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:47.261056  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.179724 10654 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.268534  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:47.279728  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:47.269443  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.169713 10400 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.252954 10446 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:47.296952  8377 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:47.300499  7827 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260501 13:59:47.298142  8373 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:47.305909  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.252431 10607 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260501 13:59:47.211309 10525 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.316802  7819 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
W20260501 13:59:47.212170  8374 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.818s	user 0.017s	sys 0.018s
W20260501 13:59:47.328622 10524 consensus_meta.cc:287] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.002s
I20260501 13:59:47.251768 10650 consensus_queue.cc:1059] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260501 13:59:47.313383 10400 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:47.295114 10446 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:47.340200  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:47.309930 10651 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.545s	user 0.029s	sys 0.012s
I20260501 13:59:47.344645  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.342862  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:47.204828 10513 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:47.374253  8375 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:47.366566 10525 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:47.377493 10514 consensus_meta.cc:287] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.010s
W20260501 13:59:47.377194 10633 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.747s	user 0.019s	sys 0.000s
I20260501 13:59:47.377693 10446 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:47.384203 10507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.045s
W20260501 13:59:47.404922 10543 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.006s
W20260501 13:59:47.422123  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 213210us
W20260501 13:59:47.408793 10684 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.013s
W20260501 13:59:47.413223 10596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.042s
I20260501 13:59:47.217450 10648 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:47.422161 10507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.045s
I20260501 13:59:47.372138 10524 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.421705 10650 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:47.420651  8374 raft_consensus.cc:2410] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:47.412581 10689 consensus_queue.cc:1243] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 13:59:47.428359  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:47.457273  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.386392 10651 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.420809  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.463578  7754 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260501 13:59:47.464705  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:47.451913 10596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.006s	sys 0.042s
I20260501 13:59:47.415728 10514 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:47.473045  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 130273us
W20260501 13:59:47.476570  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.468876  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.485926  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.451675 10701 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:47.421516 10633 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.492921  8376 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:47.498067  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.427719 10543 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.464619 10696 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:47.520588  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.454561 10578 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260501 13:59:47.449522 10684 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.472008 10615 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:47.470386 10650 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:47.526710  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.529562  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.535027  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.530365  7826 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:47.530943  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 57095.1us
I20260501 13:59:47.495517  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 470) took 1485 ms. Trace:
W20260501 13:59:47.533833  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.541960  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.542721  8372 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:47.522504 10707 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:47.548691  7643 connection.cc:254] RPC call timeout handler was delayed by -1.817765283999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260501 13:59:47.550395  7643 connection.cc:254] RPC call timeout handler was delayed by -1.7178652840000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260501 13:59:47.552022 10651 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.552968 10524 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.553812  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:47.550840  7643 connection.cc:254] RPC call timeout handler was delayed by -1.7178652840000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260501 13:59:47.561174  7643 connection.cc:254] RPC call timeout handler was delayed by -1.7088652840000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260501 13:59:47.561564  7643 connection.cc:254] RPC call timeout handler was delayed by -1.6404652840000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260501 13:59:47.561895  7643 connection.cc:254] RPC call timeout handler was delayed by -1.5945652840000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260501 13:59:47.562183  7643 connection.cc:254] RPC call timeout handler was delayed by -1.5432652839999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260501 13:59:47.566432 10599 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.841s	user 0.009s	sys 0.018s
W20260501 13:59:47.566762 10429 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.002s
W20260501 13:59:47.552052 10699 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260501 13:59:47.568475 10447 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:47.568929 10447 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:47.569931 10516 consensus_meta.cc:287] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.830s	user 0.011s	sys 0.000s
I20260501 13:59:47.570384 10516 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.570004 10447 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.573140 10684 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:47.575577 10610 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.764s	user 0.015s	sys 0.015s
W20260501 13:59:47.573155 10547 consensus_meta.cc:287] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.725s	user 0.016s	sys 0.012s
I20260501 13:59:47.587698 10610 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.587801 10547 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:47.588449 10709 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260501 13:59:47.590000 10648 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:47.590649 10610 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:47.592394  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 98945.2us
I20260501 13:59:47.593952 10543 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.595124 10698 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:47.595326 10514 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.596478  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:47.596830 10718 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:47.597716  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.598237  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.598819  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:47.577442 10629 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.948s	user 0.013s	sys 0.000s
W20260501 13:59:47.562470  7643 connection.cc:254] RPC call timeout handler was delayed by -1.4613652839999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260501 13:59:47.538522  8374 rpcz_store.cc:276] 0501 13:59:46.002916 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.089490 (+ 86574us) service_pool.cc:224] Handling call
0501 13:59:47.488206 (+1398716us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:47.543670 10689 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:47.579241  8380 raft_consensus.cc:2410] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260501 13:59:47.584197  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.584695  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 521) took 1593 ms. Trace:
I20260501 13:59:47.585053 10633 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.543390 10654 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.586973  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.637383  8372 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:47.601112 10706 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:47.638015 10446 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.605749  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.605975 10684 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:47.608608  7643 connection.cc:254] RPC call timeout handler was delayed by -1.4550652840000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260501 13:59:47.573957 10696 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:47.642076  7643 connection.cc:254] RPC call timeout handler was delayed by -1.4073652839999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260501 13:59:47.642058 10684 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:47.642621  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3902652839999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260501 13:59:47.642953  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3902652839999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260501 13:59:47.643253  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3641652840000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260501 13:59:47.592109 10650 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:47.643558  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3641652840000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260501 13:59:47.643893  7643 connection.cc:254] RPC call timeout handler was delayed by -1.351565284000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260501 13:59:47.644179  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3326652839999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260501 13:59:47.615600  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:47.644464  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3326652839999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260501 13:59:47.630926  7826 rpcz_store.cc:276] 0501 13:59:45.990928 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:46.454656 (+463728us) service_pool.cc:224] Handling call
0501 13:59:46.454982 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:47.535729 (+1080747us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:47.584427 (+ 48698us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540021fcd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:47.584629 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468916096}
W20260501 13:59:47.644830  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2957652840000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260501 13:59:47.633009  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:47.645221  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2642652839999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260501 13:59:47.645592  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2642652839999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260501 13:59:47.645869  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2309652840000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260501 13:59:47.646159  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2129652840000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260501 13:59:47.646445  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2129652840000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260501 13:59:47.646764  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2012652839999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260501 13:59:47.647364  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:47.648097  8381 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260501 13:59:47.648777  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:47.634146  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 76532.7us
I20260501 13:59:47.595597 10698 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:47.627395 10689 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.566957 10599 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.650079  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.650533  7826 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: [6.5-7.6]
W20260501 13:59:47.650802  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.638329 10706 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.597374 10718 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.652541  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.639683  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.657379  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:47.673923  8381 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:47.673864  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:47.590004 10547 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.652223  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.595959 10707 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.664358 10625 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260501 13:59:47.681253 10516 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.682017 10516 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:47.682381 10516 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:47.682771 10516 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.684249 10599 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.664108 10514 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:47.685734 10514 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:47.686250 10514 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:47.686726 10514 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.657606 10713 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:47.689116 10713 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:47.689503 10713 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:47.690703  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:47.664775 10610 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260501 13:59:47.685762 10710 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 13:59:47.693444  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.693928 10698 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.694898  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:47.695318 10698 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.695784  8372 raft_consensus.cc:2410] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260501 13:59:47.696300  8371 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 13:59:47.699955  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:47.700549 10584 consensus_meta.cc:287] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.007s
I20260501 13:59:47.502887 10701 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.695124 10706 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.675155  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:47.726046  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 50987.5us
I20260501 13:59:47.706072  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:47.644254 10684 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.664105 10447 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:47.700801 10516 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:47.714736 10718 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.715152 10707 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.717002 10446 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.718829 10689 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.751700 10716 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:47.728228  7754 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.728024  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.761888 10516 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:47.762526 10516 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:47.666899  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:47.764436  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 97699.1us
I20260501 13:59:47.764562 10599 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:47.763411  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:47.710558 10632 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.904s	user 0.016s	sys 0.015s
I20260501 13:59:47.743093  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.757332 10716 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.768316  7826 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.733824 10547 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:47.782810  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:47.792874  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:47.776942 10467 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260501 13:59:47.801596  7826 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:47.805629  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:47.776302 10689 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:47.793809 10547 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:47.813086 10547 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:47.816001  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:47.836813  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.838075  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:47.838905  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.842656  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:47.849617  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:47.791414 10416 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260501 13:59:47.777516 10632 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:47.851986  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 85502.3us
I20260501 13:59:47.835440 10629 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:47.835713 10516 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:47.852536  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:47.845402 10689 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:47.858649  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.860280  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.840837 10711 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:47.846024 10446 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:47.836141 10722 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260501 13:59:47.847512 10707 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:47.871088  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:47.860401 10694 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.782s	user 0.021s	sys 0.000s
I20260501 13:59:47.852965 10718 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:47.875689  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.904688  7754 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
W20260501 13:59:47.886768  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.906298  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:47.868484 10685 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.939s	user 0.012s	sys 0.011s
I20260501 13:59:47.908834 10685 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.911051 10685 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:47.912235  7820 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260501 13:59:47.913426  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.915042  7822 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:47.865643 10698 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:47.865031 10684 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:47.906872  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:47.917553  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:47.924718  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:47.926710  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.930475  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.866719 10629 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:47.863603 10689 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:47.940258  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:47.950021  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.952715  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:47.880821 10706 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:47.954844  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48058.2us
I20260501 13:59:47.963542  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:47.954968  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.950778  7821 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:47.967972  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:47.968465  7751 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260501 13:59:47.968683  7822 raft_consensus.cc:606] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:47.966516  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.968832  7751 pending_rounds.cc:85] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 5
I20260501 13:59:47.973744  7751 pending_rounds.cc:107] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260501 13:59:47.973801  7749 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:47.903816 10416 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:47.974045  7751 raft_consensus.cc:2889] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:47.976742  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:47.972406  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:47.983610  7821 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:47.984871  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:47.987030  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:47.938050 10711 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:47.974938  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:47.937711 10698 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:47.957207 10689 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:47.980643 10416 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:47.988760 10347 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:48.009546 10698 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:48.137367 10615 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:48.137431 10632 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.994825 10711 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:48.109161  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 172643us
I20260501 13:59:47.981287 10721 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260501 13:59:48.142565  8344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.908s (SENT) [suppressed 46 similar messages]
W20260501 13:59:48.139767 10725 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.283s	user 0.002s	sys 0.004s
I20260501 13:59:47.969640 10630 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:47.994199 10429 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.072729 10629 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.130023 10713 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.154536 10713 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.132323 10716 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:47.957263 10550 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 13:59:47.975433 10543 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:48.155838 10543 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:48.156375 10543 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:48.136660 10701 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:48.160964 10727 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.347s	user 0.010s	sys 0.016s
I20260501 13:59:48.136700 10416 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.140060 10711 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:48.166298 10723 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
I20260501 13:59:48.168840 10610 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:48.169325 10610 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:48.169885 10467 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260501 13:59:48.147697 10730 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
W20260501 13:59:48.140350 10726 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.166s	user 0.005s	sys 0.001s
I20260501 13:59:48.170212 10610 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.175109 10711 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:48.145855 10582 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.934s	user 0.018s	sys 0.003s
W20260501 13:59:48.220567  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:48.222968  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.130640  7824 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:48.298643  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:48.299485  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.300381 10716 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.301612 10716 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.228683 10516 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:48.304299 10516 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:48.304872 10516 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:48.307286 10416 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
W20260501 13:59:48.231619  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 348219us
W20260501 13:59:48.238451  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 246478us
I20260501 13:59:48.243728 10467 tablet_bootstrap.cc:492] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 13:59:48.175661 10429 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:48.248570 10684 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.178057 10730 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:48.329926 10701 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:48.330834 10701 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.179306 10698 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.332324 10684 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.333470 10701 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.333729 10698 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.128927 10400 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:48.335072 10684 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.261829  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:48.336686  7750 raft_consensus.cc:606] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:48.337229  7750 raft_consensus.cc:614] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:48.338629 10738 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:48.339066 10630 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:48.182572 10689 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:47.984922  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:48.313526 10599 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:48.314801  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:48.317903 10711 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.320582 10716 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.322822 10739 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260501 13:59:48.149538 10547 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.177889 10514 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.322863 10610 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.362972 10711 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:48.364727 10711 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.365893 10514 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.367055 10711 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:48.358779  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 44423.5us
I20260501 13:59:48.337141  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:48.357998 10732 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.213s	user 0.000s	sys 0.003s
I20260501 13:59:48.379591 10582 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.380829 10633 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 13:59:48.382359  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.382745 10582 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.383385  7745 raft_consensus.cc:2368] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7.
I20260501 13:59:48.387403  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2545) took 1187 ms. Trace:
I20260501 13:59:48.390154  7824 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:48.395983  7745 rpcz_store.cc:276] 0501 13:59:47.199523 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:47.199776 (+   253us) service_pool.cc:224] Handling call
0501 13:59:48.387100 (+1187324us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000d07d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:48.387286 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718004096}
I20260501 13:59:48.390728 10631 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.397101 10516 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.397629 10631 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.397974 10730 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.399880 10516 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.400272 10711 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:48.400873  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 64010us
W20260501 13:59:48.401242  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.403133 10631 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:48.387590  7754 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:48.342031 10689 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.359022 10599 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:48.359347 10632 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election won for term 4
I20260501 13:59:48.399649 10730 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.372409 10630 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.409647 10748 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 13:59:48.413071 10507 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 13:59:48.413558  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:48.416880 10632 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:48.407851 10599 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:48.422833  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:48.422922 10632 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.424285 10599 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.425684 10416 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:48.426364 10416 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:48.426483 10599 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:48.429236  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 444172us
I20260501 13:59:48.431147  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:48.432237 10629 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:48.433964 10547 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.434506 10347 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:48.435168  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:48.436664 10748 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:48.437144 10748 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:48.408687  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.438328  7679 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:48.438411 10748 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.439316 10467 ts_tablet_manager.cc:1403] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 2.358s	user 0.056s	sys 0.024s
W20260501 13:59:48.424132 10651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.022s
W20260501 13:59:48.440171 10651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.004s	sys 0.022s
I20260501 13:59:48.442391  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:48.443397  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:48.444121  7824 raft_consensus.cc:606] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:48.427631 10416 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.446238  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:48.448117  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e99f3322c2477888132a818eae4971"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:48.448868  7824 raft_consensus.cc:606] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:48.450876 10467 raft_consensus.cc:359] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.456615  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.458690  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.459648  7678 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:48.462044  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.462796  7678 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5. Re-sending same reply.
I20260501 13:59:48.464370  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.463397  7574 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:48.466609  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.467024  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.466354  7574 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:48.467679  7677 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.467554  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.468084  7672 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.468528  7674 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:48.470121  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.472002 10629 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:48.473539  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:48.474598  8376 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:48.474843  8371 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260501 13:59:48.475278  8371 pending_rounds.cc:85] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 6
I20260501 13:59:48.475546  8371 pending_rounds.cc:107] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260501 13:59:48.475870  8371 raft_consensus.cc:2889] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:48.475664  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:48.476045  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:48.477078  7824 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:48.477667  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:48.471673 10446 consensus_meta.cc:287] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.013s
I20260501 13:59:48.478868  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:48.479032 10446 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:48.479444  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:48.480449  7679 raft_consensus.cc:2368] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5.
I20260501 13:59:48.482367 10748 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.482404 10543 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.485478 10543 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.490049  7754 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:48.490540  7676 raft_consensus.cc:2368] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7.
I20260501 13:59:48.491621  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:48.492766  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.493204  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:48.452694 10467 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
W20260501 13:59:48.499953  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 68975.9us
I20260501 13:59:48.500964  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.502105  7674 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:48.502291  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:48.503322 10543 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:48.504369  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.505812  7676 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260501 13:59:48.519208 10467 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:48.522193  7676 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:48.521850  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:48.523981  7574 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:48.530757  7745 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:48.530965  7574 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 3, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 3 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:48.532047 10421 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:48.538635  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.539155 10421 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.536221 10467 ts_tablet_manager.cc:1434] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.096s	user 0.003s	sys 0.011s
I20260501 13:59:48.539664  7674 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.541517 10421 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:48.543257  7574 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:48.545377  7574 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 5, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:59:48.535905  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.549654  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:48.547111  7574 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 5 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:48.551393 10631 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:48.551342  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:48.560102  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.563684 10631 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:48.567615  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:48.572062  7819 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:48.580641  7824 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260501 13:59:48.581588 10756 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260501 13:59:48.583547  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.584589  7679 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260501 13:59:48.584769  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.584772  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.585494  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.585965  7672 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.586372  7678 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.586309  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.585759  7674 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.587057  7677 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.590946  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:48.591308  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:48.591634  7828 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.592985  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.594933  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.595432  7671 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:48.595970  7678 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.595783  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.596748  7673 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260501 13:59:48.596856  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.597223  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.597601  7678 raft_consensus.cc:2376] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6. Re-sending same reply.
I20260501 13:59:48.599423  7679 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260501 13:59:48.599879  7679 pending_rounds.cc:85] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 4
I20260501 13:59:48.600144  7679 pending_rounds.cc:107] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260501 13:59:48.600392  7679 raft_consensus.cc:2889] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:48.601905  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.602823  7670 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.603948  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.604854  7675 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.594983 10610 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.605835  7828 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:48.606130 10610 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.607007 10543 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.607738 10543 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.608696 10610 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.609966  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 270) took 5625 ms. Trace:
I20260501 13:59:48.610029 10543 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.606005 10347 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260501 13:59:48.613279  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 62050.3us
I20260501 13:59:48.628098 10416 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:48.631517  7750 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260501 13:59:48.623320  7675 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260501 13:59:48.623253  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:48.637379  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:48.638170  8376 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:48.637389  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.639557  7670 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5. Re-sending same reply.
I20260501 13:59:48.635062  7674 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:48.646343  7677 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:48.650163  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:48.653651  7748 raft_consensus.cc:2410] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260501 13:59:48.656585  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f875366331345f08d2e236a76c1c71d with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50946
I20260501 13:59:48.659521  8380 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:48.650669 10416 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.666515  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.667366  7677 raft_consensus.cc:2376] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:48.667690  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-23c164f5975a45b495c25c9e99b628d3 received from {username='slave'} at 127.0.0.1:42716
I20260501 13:59:48.668396  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-23c164f5975a45b495c25c9e99b628d3 on tablet 23c164f5975a45b495c25c9e99b628d3 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:48.670506  8374 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:48.672299 10543 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.673090 10543 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:48.681036  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.689287  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet 1f875366331345f08d2e236a76c1c71d (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 13:59:48.692807  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:48.696399  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.710551 10582 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.711254 10582 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:48.711629  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.713339 10582 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.716018  7792 leader_election.cc:400] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7.
I20260501 13:59:48.716384  7792 leader_election.cc:403] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260501 13:59:48.720348 10507 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7.
I20260501 13:59:48.721738  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:48.726374  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:48.680197 10416 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.732064 10416 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.733968  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.734855  7675 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.735994 10748 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:48.736140  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:48.698894 10543 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:48.740921  8380 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:48.611341  7573 rpcz_store.cc:276] 0501 13:59:42.984000 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:42.984319 (+   319us) service_pool.cc:224] Handling call
0501 13:59:48.609712 (+5625393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:47.026850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:47.211320 (+184470us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:47.217789 (+  6469us) write_op.cc:435] Acquired schema lock
0501 13:59:47.217824 (+    35us) tablet.cc:662] Decoding operations
0501 13:59:47.389259 (+171435us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:47.397611 (+  8352us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:47.409583 (+ 11972us) tablet.cc:685] Acquiring locks for 5 operations
0501 13:59:47.508656 (+ 99073us) tablet.cc:701] Row locks acquired
0501 13:59:47.508684 (+    28us) write_op.cc:260] PREPARE: finished
0501 13:59:47.536550 (+ 27866us) write_op.cc:270] Start()
0501 13:59:47.544661 (+  8111us) write_op.cc:276] Timestamp: P: 1777643987531772 usec, L: 0
0501 13:59:47.544700 (+    39us) op_driver.cc:348] REPLICATION: starting
0501 13:59:47.645233 (+100533us) log.cc:844] Serialized 2069 byte log entry
0501 13:59:48.308775 (+663542us) op_driver.cc:464] REPLICATION: finished
0501 13:59:48.401277 (+ 92502us) write_op.cc:301] APPLY: starting
0501 13:59:48.401489 (+   212us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:48.401800 (+   311us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:48.402012 (+   212us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:48.403292 (+  1280us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:48.403744 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0501 13:59:48.408407 (+  4663us) write_op.cc:312] APPLY: finished
0501 13:59:48.410763 (+  2356us) log.cc:844] Serialized 47 byte log entry
0501 13:59:48.415487 (+  4724us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:48.415839 (+   352us) write_op.cc:454] Released schema lock
0501 13:59:48.416151 (+   312us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:48.416730 (+   579us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:48.416765 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2888516,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":92012,"apply.run_cpu_time_us":4486,"apply.run_wall_time_us":15470,"num_ops":5,"prepare.queue_time_us":198122,"prepare.run_cpu_time_us":29842,"prepare.run_wall_time_us":727202,"raft.queue_time_us":155586,"raft.run_cpu_time_us":18473,"raft.run_wall_time_us":95807,"replication_time_us":759758,"thread_start_us":276074,"threads_started":4,"wal-append.queue_time_us":183761}]]}
I20260501 13:59:48.751300  7677 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:48.751695  7674 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:48.756276  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:48.763866  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:48.765815  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 152021us
I20260501 13:59:48.766829 10730 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:48.760870 10748 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:48.776898 10748 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.777271 10580 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260501 13:59:48.778499 10580 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:48.778983 10580 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:48.793298  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:48.809319 10725 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260501 13:59:48.792646 10543 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.813298 10685 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260501 13:59:48.800410 10580 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:48.831399  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.841071  8377 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
W20260501 13:59:48.845564  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.851908  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:48.851994  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.855429  7674 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
W20260501 13:59:48.870453  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:48.878094  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:48.853121 10582 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:48.885378  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.887966  7674 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.843604 10543 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:48.893738 10765 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260501 13:59:48.894484 10582 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.896204  7748 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:48.900147 10421 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:48.900653 10421 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:48.901520 10421 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:48.902875 10421 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:48.903363 10582 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:48.905573 10543 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:48.912035 10759 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260501 13:59:48.921509  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.922495  7674 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.915993 10580 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:48.930999  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.931797  7674 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
W20260501 13:59:48.929291  7792 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.513s (SENT)
I20260501 13:59:48.947150  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.947950  7674 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
W20260501 13:59:48.951179  7792 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.606s (SENT)
I20260501 13:59:48.951781  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:48.958498  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.961125  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 182) took 3759 ms. Trace:
I20260501 13:59:48.954672 10507 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:48.970856  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:48.976064  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.980152  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.980897  7670 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:48.981216  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.981974  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.982656  7679 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:48.980654  7672 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:48.982821  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.983613  7673 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.977198 10543 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:48.979288  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.980742  7674 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.986011  7677 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260501 13:59:48.980576 10550 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:48.986997  7678 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260501 13:59:48.987424  7678 pending_rounds.cc:85] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 3
I20260501 13:59:48.987748  7678 pending_rounds.cc:107] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260501 13:59:48.988020  7678 raft_consensus.cc:2889] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:48.989076  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.989890  7677 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.984277  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:48.978639  7676 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:48.990665  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:48.991453  7673 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:48.992085 10629 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:48.992750 10629 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:48.994041  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:48.985565 10543 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 13:59:48.990109  7792 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.633s (SENT)
I20260501 13:59:48.993854 10629 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:48.993991  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:48.963979  7576 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 4 to 5, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 5 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:48.961503  7574 rpcz_store.cc:276] 0501 13:59:45.197024 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:45.197167 (+   143us) service_pool.cc:224] Handling call
0501 13:59:48.956581 (+3759414us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:48.672668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:48.673390 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:48.673455 (+    65us) write_op.cc:435] Acquired schema lock
0501 13:59:48.673494 (+    39us) tablet.cc:662] Decoding operations
0501 13:59:48.674574 (+  1080us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:48.674660 (+    86us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:48.674693 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0501 13:59:48.675489 (+   796us) tablet.cc:701] Row locks acquired
0501 13:59:48.675511 (+    22us) write_op.cc:260] PREPARE: finished
0501 13:59:48.675715 (+   204us) write_op.cc:270] Start()
0501 13:59:48.680583 (+  4868us) write_op.cc:276] Timestamp: P: 1777643988675640 usec, L: 0
0501 13:59:48.682726 (+  2143us) op_driver.cc:348] REPLICATION: starting
0501 13:59:48.728385 (+ 45659us) log.cc:844] Serialized 2814 byte log entry
0501 13:59:48.906914 (+178529us) op_driver.cc:464] REPLICATION: finished
0501 13:59:48.907447 (+   533us) write_op.cc:301] APPLY: starting
0501 13:59:48.907562 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:48.907798 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:48.907921 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:48.908961 (+  1040us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:48.909192 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0501 13:59:48.909242 (+    50us) write_op.cc:312] APPLY: finished
0501 13:59:48.909566 (+   324us) log.cc:844] Serialized 59 byte log entry
0501 13:59:48.909749 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:48.917620 (+  7871us) write_op.cc:454] Released schema lock
0501 13:59:48.922802 (+  5182us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:48.940537 (+ 17735us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:48.943396 (+  2859us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73139,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":287,"apply.run_cpu_time_us":3009,"apply.run_wall_time_us":26410,"num_ops":7,"prepare.queue_time_us":52832,"prepare.run_cpu_time_us":5072,"prepare.run_wall_time_us":56188,"replication_time_us":222909,"thread_start_us":37829,"threads_started":1}]]}
I20260501 13:59:48.995245  7673 raft_consensus.cc:2376] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:49.000123 10543 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:48.978577 10767 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.105s	user 0.004s	sys 0.000s
I20260501 13:59:49.002624  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.016103 10429 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:49.022109 10505 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:49.027122  7828 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260501 13:59:49.029956 10730 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:49.010650  7576 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 5 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:49.037309  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.041087  7673 raft_consensus.cc:2368] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5.
I20260501 13:59:49.044852  7824 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:49.046406  7576 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 4 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 6 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:49.049541  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 59488.8us
I20260501 13:59:49.050884  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:49.053239 10772 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.083s	user 0.001s	sys 0.001s
I20260501 13:59:49.059022  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.059970  7676 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.060256  7673 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260501 13:59:49.060887  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.061630  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.063521  7675 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 4: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:49.070315  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 76432.2us
I20260501 13:59:49.049319 10730 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
W20260501 13:59:49.077419  7792 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.639s (SENT)
W20260501 13:59:49.078759  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.650s (SENT)
I20260501 13:59:49.079156  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.080034 10505 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:49.080549  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:49.081795  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:49.082450 10582 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:49.082931 10582 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.083240 10550 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:49.084014 10550 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:49.083323 10582 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:49.085212 10550 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.089468 10543 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:49.100785  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:49.107699  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.671s (SENT)
I20260501 13:59:49.108351  7675 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:49.108770  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.101192  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.101904  7673 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:49.102007  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.113425  7676 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.102388  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.113899  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 292) took 5664 ms. Trace:
I20260501 13:59:49.114596  7674 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.103543  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.104277  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.115355  7823 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:49.105631  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.115840  7672 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:49.106818  7671 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:49.116309  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:49.106894  7670 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:49.117733  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.117859  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:49.118532  7824 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:49.118597  8377 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:49.119087  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.119849  7823 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:49.124045 10580 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:49.129319  7670 pending_rounds.cc:85] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 4
I20260501 13:59:49.129784  7670 pending_rounds.cc:107] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260501 13:59:49.114308  7576 rpcz_store.cc:276] 0501 13:59:43.449582 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:43.450133 (+   551us) service_pool.cc:224] Handling call
0501 13:59:49.113828 (+5663695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:49.077956 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:49.078642 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:49.078687 (+    45us) write_op.cc:435] Acquired schema lock
0501 13:59:49.078713 (+    26us) tablet.cc:662] Decoding operations
0501 13:59:49.079276 (+   563us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:49.079348 (+    72us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:49.079380 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0501 13:59:49.079725 (+   345us) tablet.cc:701] Row locks acquired
0501 13:59:49.079746 (+    21us) write_op.cc:260] PREPARE: finished
0501 13:59:49.079942 (+   196us) write_op.cc:270] Start()
0501 13:59:49.080079 (+   137us) write_op.cc:276] Timestamp: P: 1777643989079877 usec, L: 0
0501 13:59:49.080101 (+    22us) op_driver.cc:348] REPLICATION: starting
0501 13:59:49.080843 (+   742us) log.cc:844] Serialized 1303 byte log entry
0501 13:59:49.082784 (+  1941us) op_driver.cc:464] REPLICATION: finished
0501 13:59:49.083255 (+   471us) write_op.cc:301] APPLY: starting
0501 13:59:49.083339 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:49.083474 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:49.083576 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:49.084660 (+  1084us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:49.084871 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0501 13:59:49.084924 (+    53us) write_op.cc:312] APPLY: finished
0501 13:59:49.085145 (+   221us) log.cc:844] Serialized 35 byte log entry
0501 13:59:49.085299 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:49.085405 (+   106us) write_op.cc:454] Released schema lock
0501 13:59:49.085451 (+    46us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:49.085821 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:49.085860 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1598486,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":263,"apply.run_cpu_time_us":2016,"apply.run_wall_time_us":2519,"num_ops":3,"prepare.queue_time_us":494,"prepare.run_cpu_time_us":3201,"prepare.run_wall_time_us":3202,"replication_time_us":2536}]]}
I20260501 13:59:49.130016  7670 raft_consensus.cc:2889] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:49.131004  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.129328  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.133316  7573 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:49.139498  7573 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 3 to 4, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 4 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.142966  7573 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:59:49.145799  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.151371  7671 raft_consensus.cc:2393] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.151734  7678 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
W20260501 13:59:49.153648  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.158479  7573 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.164130  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.165365  7674 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.167276  8377 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260501 13:59:49.167725  8377 pending_rounds.cc:85] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 6
I20260501 13:59:49.167985  8377 pending_rounds.cc:107] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260501 13:59:49.168212  8377 raft_consensus.cc:2889] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:49.168267  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.168915  7824 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:49.170177  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.170996  7677 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.173501  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.173983  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.186208  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.187242  7827 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:49.201195  7821 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260501 13:59:49.212453 10778 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260501 13:59:49.214586  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 70404.6us
I20260501 13:59:49.179778  7573 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 8, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 13:59:49.242337  7792 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.807s (SENT)
I20260501 13:59:49.242870  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.238240  7573 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:49.252158  7573 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.254379  7573 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 6, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:49.256666  7573 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:49.259217  7573 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:59:49.267161  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.845s (SENT)
I20260501 13:59:49.267704  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.264290 10685 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:49.268826  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.511s (SENT)
I20260501 13:59:49.269308  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.274282  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.266332  7573 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.280869 10543 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:49.284315  7677 raft_consensus.cc:2410] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260501 13:59:49.285146  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:49.285838  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:49.296773  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.296947  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:49.274539 10550 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:49.311904  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.316401  7671 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.280931 10685 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 13:59:49.327963  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.295527 10543 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:49.330775 10543 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.331317 10543 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:49.334663  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.335549  7677 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.336115 10716 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:49.302495 10429 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260501 13:59:49.336330  7676 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:49.336625 10716 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.337049 10716 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:49.338348  7672 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:49.338742  7672 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:49.292434 10416 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:49.339603  7672 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.340008 10416 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.340791  7672 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:49.342777 10416 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:49.298808 10629 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260501 13:59:49.349865  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.352921  7674 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:49.358585  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.354424  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.315249 10630 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:49.369668  7679 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260501 13:59:49.370839  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.372807  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.373577  7753 raft_consensus.cc:2410] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:49.377215  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.378044  7678 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.377696  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.378739  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.379070  7679 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:49.380421 10543 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.382754  7679 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:49.383070 10543 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:49.385015  7679 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260501 13:59:49.385186  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.388458  7678 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:49.389406  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.390259  7678 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.391010  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.392189  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.392330  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.393422  7676 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:49.393754  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.394485  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.395342  7676 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:49.393415  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.396386  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.398988  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.400520 10582 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.364344 10630 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:49.403556  7679 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260501 13:59:49.391706  7678 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 13:59:49.407392  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.405946 10630 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:49.475303 10582 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:49.476305  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 110564us
I20260501 13:59:49.483213 10651 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:49.483650 10505 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:49.483835 10651 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.484463 10505 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:49.486157 10651 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:49.491876  7671 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:49.493114  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 196247us
I20260501 13:59:49.494050  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:49.496943  7676 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260501 13:59:49.500682  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.501407  7749 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:49.505307  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.506945  7672 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260501 13:59:49.507556  7672 pending_rounds.cc:85] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 13:59:49.507982  7672 pending_rounds.cc:107] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260501 13:59:49.508322  7672 raft_consensus.cc:2889] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:49.509735  7673 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:49.510826  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:49.511797  7679 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.513711  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.514415  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.521520  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.514815  7674 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:49.493901 10716 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:49.525857  7673 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:49.605962  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 260376us
I20260501 13:59:49.710934  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.635532  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.512673  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:49.714696  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.532027  7679 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.599427  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:49.579923  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.684301  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.717101  7670 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260501 13:59:49.514467 10787 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260501 13:59:49.560990  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.543587  7576 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 7, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 7 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 13:59:49.718129  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:49.717979  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 205419us
I20260501 13:59:49.711836  7828 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:49.634594  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.714998  7671 raft_consensus.cc:2376] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5. Re-sending same reply.
I20260501 13:59:49.719939  7576 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 6 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.525116  7678 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:49.512499  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:49.730592  7745 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:49.515091 10550 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:49.731272 10550 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.731623 10550 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:49.732188  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.733047  7746 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:49.733387  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.734226  7674 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.734683 10729 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:49.734969  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.735118 10729 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.735548 10729 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:49.603163 10782 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:49.736485 10782 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.729472  7576 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.527036 10505 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:49.748862  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.749522  7671 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:49.747727 10782 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:49.750272  7672 raft_consensus.cc:2368] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7.
I20260501 13:59:49.739991  7576 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.545552  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:49.756177  7792 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.935s (SENT)
I20260501 13:59:49.756867 10716 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:49.757921  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.759938  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.760275  7823 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260501 13:59:49.505774 10582 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:49.762784  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.763718  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.774060  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.774865  7672 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:49.774811  7678 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:49.775182  7792 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.047s (SENT)
I20260501 13:59:49.765734  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:49.775923  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:49.772680  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 260214us
I20260501 13:59:49.776803  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.776835  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.772629  7576 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 5 to 6, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:49.761998  7676 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:49.764149  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.776494  7672 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:49.778002  7673 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:49.776201  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.779328  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.778823 10505 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:49.779958  7745 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:49.780560  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.780685 10543 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:49.781118  7673 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:49.781776  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.782440  7671 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:49.784328  7679 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:49.783775  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.778604 10582 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.786831 10582 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:49.787204  7671 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260501 13:59:49.790974  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.791777  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.792084  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:49.792649  7672 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:49.794414  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.794736  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:49.782090 10716 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:49.796159 10716 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:49.796563 10716 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:49.797281  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:49.797953 10550 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:49.798527  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.799860  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:49.800170  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.800731  8374 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:49.796169  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.796173  8371 raft_consensus.cc:1217] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260501 13:59:49.802533  8371 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260501 13:59:49.796486  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:49.804590  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:49.796520  7673 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:49.785338 10630 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:49.810815  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.809427  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:49.810170  7672 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:49.816565  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.817209  7822 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:49.821856  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.826840  7753 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:49.828120  7828 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:49.830947  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.832141  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:49.832492  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.834359  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:49.836709  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:49.837123  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.838830  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:49.840545  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.841563  7746 raft_consensus.cc:2368] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5.
W20260501 13:59:49.845518  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.850857  7573 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:49.853264  7824 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:49.853392  7573 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:49.854383  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:49.855293  8377 raft_consensus.cc:2393] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:49.822414 10550 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:49.857599  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.848s (SENT)
I20260501 13:59:49.858125  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:49.859237 10550 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:49.859517  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.554s (SENT)
I20260501 13:59:49.865180  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:49.862046  7822 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
W20260501 13:59:49.863227  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:49.863081  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 122023us
I20260501 13:59:49.871223  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.871248 10543 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:49.872859  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.873469  7828 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:49.873767  8377 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:49.874259  7718 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.639s (SENT)
I20260501 13:59:49.874826  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:49.875779 10543 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:49.876088  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:49.877256  7718 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.641s (SENT)
I20260501 13:59:49.877794  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:49.878703 10543 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:49.874881  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:49.884182  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:49.884815  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.886772  7822 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260501 13:59:49.888286  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 101429us
I20260501 13:59:49.810654 10729 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:49.896559  7828 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
W20260501 13:59:49.896920  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.126s (SENT)
I20260501 13:59:49.897387  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 13:59:49.898138  7792 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.705s (SENT)
I20260501 13:59:49.899546  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.908259  8380 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:49.912127  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:49.927807  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:49.928709  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.904242 10550 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:49.931623  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.945024  7828 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:49.933156 10729 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:49.935411  7821 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:49.936188  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.946233  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.946869  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:49.948304  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 13:59:49.948362  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.906924 10630 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:49.952001  8380 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:49.954195  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.956561  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:49.959380  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 70405.2us
I20260501 13:59:49.960377  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.964732  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.965029  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:49.968271  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:49.968910  7828 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:49.964594  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.972313  7821 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:49.973742  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:49.975535  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:49.976873  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:49.978430 10610 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:49.979076 10610 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:49.958528 10782 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:49.980400 10782 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:49.983131  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:49.986158  8380 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:49.988612  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:49.990636  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:49.997152  7827 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 13:59:49.998422  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:49.999831  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:50.003270  7792 leader_election.cc:336] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.674s (SENT)
I20260501 13:59:50.003746  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.003074 10543 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
W20260501 13:59:50.013501  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.218s (SENT)
I20260501 13:59:50.014134  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.015108 10505 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:50.015583  7792 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.222s (SENT)
I20260501 13:59:50.016739  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.020001  7749 raft_consensus.cc:2368] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:49.991791 10429 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:50.032680  7821 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:50.041729  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:50.047091  7745 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.043970 10421 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:50.050565  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:49.993536 10550 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260501 13:59:50.051733  7827 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.020996 10630 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:50.057287  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:50.057401  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:50.060109  7751 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:50.048945 10429 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.070883  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:50.083343  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:50.084287  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 90026.6us
I20260501 13:59:50.067222 10716 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:50.101864  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.734s (SENT)
I20260501 13:59:50.071785 10796 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260501 13:59:50.108696  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:50.114609  7747 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:50.110057 10796 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:50.117938 10796 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:50.117507 10429 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.118876 10796 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.124784  7751 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:50.126438  7745 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:50.082155 10794 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260501 13:59:50.088076 10630 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260501 13:59:50.130409  7753 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:50.137977  7827 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:50.102487 10421 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260501 13:59:50.110970 10782 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:50.143081 10795 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260501 13:59:50.149616  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:50.148286  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 171488us
I20260501 13:59:50.138276 10550 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260501 13:59:50.147130 10796 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:50.148563 10543 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:50.169288  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44488.1us
I20260501 13:59:50.171931 10811 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:50.172406 10811 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.173686  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.156529 10795 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260501 13:59:50.167639 10809 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
W20260501 13:59:50.176196 10806 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
I20260501 13:59:50.177892 10807 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:50.193359 10550 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:50.193888 10550 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.194811 10716 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:50.187994 10805 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260501 13:59:50.185540 10809 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.186295 10582 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.192627 10505 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.194907 10550 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.198807  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:50.170794 10748 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260501 13:59:50.176734 10811 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.203094  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.197803  7576 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:50.204231  7576 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:50.203150  7573 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 4 to 5, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 5 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:50.208482  7748 raft_consensus.cc:2368] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:50.212177 10416 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:50.205947 10429 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:50.213961  7573 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:50.215515 10416 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:50.221441 10416 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:50.222752 10813 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260501 13:59:50.201658 10809 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.227424 10809 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.208523 10729 consensus_queue.cc:1059] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260501 13:59:50.231961 10729 raft_consensus.cc:3055] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 13:59:50.232350 10729 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:50.232582 10550 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:50.234859 10794 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:50.235320 10794 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:50.236680 10794 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.222892 10739 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260501 13:59:50.238214 10794 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.223047 10782 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260501 13:59:50.240217 10630 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:50.240645 10630 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:50.241494 10630 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.242791 10630 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:50.212383 10812 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:50.243485 10812 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.216168 10543 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.246466 10429 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.247471 10429 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.251595  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:50.233187 10729 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.256196 10729 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:50.258112 10629 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:50.258876 10629 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.205423 10716 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260501 13:59:50.265616 10739 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:50.270998 10651 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 13:59:50.271410 10651 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:50.272437 10651 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:50.276768  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 70421.2us
I20260501 13:59:50.291688  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.292708 10813 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.293905  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.294762 10813 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.295311  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.295680  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:50.296154 10632 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.296325  7819 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:50.275801 10782 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:50.281774 10811 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:50.280186 10807 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:50.319392 10748 raft_consensus.cc:993] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:50.324550 10651 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.291162 10582 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:50.312052 10816 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260501 13:59:50.306131  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:50.350358  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44774.4us
I20260501 13:59:50.349568  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:50.342818 10629 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:50.381829  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.392537  7819 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 13:59:50.360248 10505 raft_consensus.cc:1081] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
W20260501 13:59:50.404670  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:50.408847  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:50.418835 10819 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:50.419517 10819 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:50.419986 10819 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:50.346308 10807 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.360531 10347 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260501 13:59:50.425889  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44193.8us
I20260501 13:59:50.409593 10610 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260501 13:59:50.438674 10748 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:50.439162 10748 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:50.440135 10748 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.441176  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:50.442693  7792 leader_election.cc:400] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 4. Current term is 5.
I20260501 13:59:50.441401 10748 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:50.444872 10816 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:50.445399 10816 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:50.446389 10816 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.448657 10807 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:50.450901  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:50.391885 10812 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:50.451737  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.415448 10814 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.452752 10630 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:50.453438  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.377017 10416 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.456447 10814 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.457849  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.458293 10416 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:50.458657 10814 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.460114  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.460214 10813 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:50.474080  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 167979us
I20260501 13:59:50.484238  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:50.485471  7675 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:50.482959  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:50.489524  7676 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:50.492357  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:50.493029  7672 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
W20260501 13:59:50.485773  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 189254us
I20260501 13:59:50.494228  7676 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:50.496668  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:50.470824 10814 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:50.497530  7673 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:50.497974  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.499727  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:50.499877  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:50.502882  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:50.503729  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:50.504431  7672 raft_consensus.cc:2376] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:50.502771 10632 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:50.514446  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:50.523533  7675 raft_consensus.cc:2368] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7.
I20260501 13:59:50.473723 10782 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:50.534286  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 107860us
I20260501 13:59:50.535221  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.536368  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:50.536823  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:50.537196  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:50.537863  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:50.538560  7819 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:50.546365  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:50.543179  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.792s (SENT)
I20260501 13:59:50.547214  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.531157 10827 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:50.550841  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:50.551716  7748 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:50.530525 10505 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260501 13:59:50.540858 10632 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:50.543741 10794 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260501 13:59:50.572119  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:50.530211 10815 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
W20260501 13:59:50.575443  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:50.562135 10810 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.595454  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:50.596719  8380 raft_consensus.cc:2410] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:50.576821  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:50.598520  7823 raft_consensus.cc:606] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.580196  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:50.601478  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 61634.3us
I20260501 13:59:50.563560 10794 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:50.581637  7573 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:50.587972 10782 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.590507 10716 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:50.604416  7573 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:50.604244  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:50.613667  7792 leader_election.cc:400] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:50.614050  7792 leader_election.cc:403] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260501 13:59:50.593767 10630 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.606639 10794 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:50.617420  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:50.606478 10810 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:50.618036  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.618996  7748 raft_consensus.cc:606] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.620833  7748 raft_consensus.cc:614] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:50.556298 10827 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:50.626899  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51962.9us
I20260501 13:59:50.613273 10811 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:50.570466 10819 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.633857 10550 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.638971 10829 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:50.639593 10829 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.640902  7678 raft_consensus.cc:2368] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:50.641952 10829 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:50.615913 10828 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:50.643913 10828 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.646229 10828 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:50.641230 10819 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:50.649111 10827 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:50.650106  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.652503  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.653509 10830 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.654148 10830 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.655516  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:50.656203  7819 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:50.656770 10429 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 13:59:50.657001 10823 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:50.657467  7822 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260501 13:59:50.658921  7821 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260501 13:59:50.660132  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:50.661131  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:50.662587  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:50.663334  7748 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:50.617496 10347 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:50.656823  7827 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:50.611248 10716 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.667799 10748 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:50.629642 10811 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:50.695776  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:50.627712 10810 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.701182  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:50.678318 10811 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:50.673949 10716 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:50.709519  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77332.7us
I20260501 13:59:50.712455  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.716588  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.717286  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:50.717962  7821 raft_consensus.cc:606] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:50.724974  7827 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:50.727646  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:50.728580  8377 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.732632  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:50.733454  8371 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:50.735529  8376 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: []
I20260501 13:59:50.740815  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b540df5a794f06ab617858163d4297"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:50.715420 10651 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260501 13:59:50.741544  7827 raft_consensus.cc:606] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.741933  7827 raft_consensus.cc:614] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:50.712499 10416 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260501 13:59:50.745810  8371 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:50.762061  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:50.762893  7827 raft_consensus.cc:606] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.763305  7827 raft_consensus.cc:614] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:50.764905  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:50.767333 10782 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:50.767993 10810 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.768461 10782 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.771199 10782 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:50.772337  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.776510 10819 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:50.776734  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:50.777581  8374 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:50.777659 10819 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:50.778147 10819 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:50.779670  8371 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260501 13:59:50.780567  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 64167.3us
I20260501 13:59:50.782883  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:50.723786 10813 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.726897 10815 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:50.795711  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 13:59:50.800239  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:50.805071 10748 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:50.806092 10748 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:50.807051 10748 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.807883  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:50.810097  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:50.804558  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:50.812294 10835 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260501 13:59:50.811908  8371 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:50.813679 10347 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:50.779377 10828 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:50.812675  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.816473  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.817551  7792 leader_election.cc:400] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7.
I20260501 13:59:50.820824  8377 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:50.827036  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.832408  8374 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:50.824081 10828 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:50.820307 10582 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260501 13:59:50.834615  7823 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:50.835754  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:50.836817  7643 leader_election.cc:400] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5.
I20260501 13:59:50.837150  7643 leader_election.cc:403] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260501 13:59:50.837814 10829 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.838142  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.838536 10829 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 5
I20260501 13:59:50.839108  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.839771 10811 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.751770 10827 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260501 13:59:50.841353 10582 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:50.844030 10807 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:50.844841 10807 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.845932  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:50.846247 10814 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:50.820362 10632 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.847254 10416 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:50.849710  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.822157 10830 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:50.859829  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.861970  7822 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 13:59:50.779053 10819 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:50.863291 10828 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.864290 10830 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.864357  7827 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:50.865486 10830 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.866523 10582 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:50.867926 10610 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.828547 10782 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 13:59:50.870584  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.875300  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.876633  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:50.880319  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:50.881220  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:50.886299 10807 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:50.898304  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:50.899274  7819 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:50.879585 10829 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 4. Current term is 5.
I20260501 13:59:50.878266 10610 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:50.880443 10828 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 13:59:50.878198 10416 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:50.883771 10782 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:50.917397 10819 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:50.920152 10807 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:50.931860  7819 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:50.939146  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:50.940392 10582 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:50.941061 10582 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:50.942301 10582 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.928200 10610 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260501 13:59:50.949050 10796 raft_consensus.cc:993] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:50.924007 10811 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:50.968405 10610 consensus_queue.cc:1243] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 13:59:50.968587 10416 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.969496 10347 raft_consensus.cc:1081] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:50.976729 10807 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:50.930562 10782 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:50.981925 10829 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Stepping down as leader of term 8
W20260501 13:59:50.965791  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 79270.7us
I20260501 13:59:51.001222  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:51.006127  7573 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:50.991554  7754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:59:51.017911  7754 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:51.018471  7754 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:51.013833  7643 leader_election.cc:400] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:51.020637  7643 leader_election.cc:403] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260501 13:59:51.024343  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 162369us
I20260501 13:59:51.007917  7574 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 6 to 7, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 7 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 13:59:51.028293  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.001019 10854 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.009043  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:51.007843 10829 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 13:59:51.059104  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45539.3us
I20260501 13:59:51.002364 10782 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.075588  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:51.096357  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.097466  7673 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:51.099210  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.100314  7673 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:51.102423  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.104712  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.108079  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.109216  7673 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:51.113123  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.110946  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.114089  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.060024 10852 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.114169  7677 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:51.074205  7754 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.114825  7676 raft_consensus.cc:2376] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7. Re-sending same reply.
I20260501 13:59:51.115461  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.118260  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.118475  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.118917  7672 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:51.067950 10815 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:51.125217  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.123145  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.125864  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.126395  7676 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:51.124313  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.124989  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.127063  7674 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:51.127159  7671 raft_consensus.cc:2410] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:51.125864  7677 raft_consensus.cc:2376] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7. Re-sending same reply.
I20260501 13:59:51.111299 10610 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:51.128290  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.143930  7670 raft_consensus.cc:2376] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7. Re-sending same reply.
I20260501 13:59:51.056393 10854 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.132149  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.133930  7679 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260501 13:59:51.135954 10858 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260501 13:59:51.121402 10829 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.156366 10829 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:51.158377 10854 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.149348 10610 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:51.159328 10610 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:51.139999 10848 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260501 13:59:51.143005  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.148620  7672 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:51.151417  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:51.166009  7823 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:51.166360  7823 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:51.152638  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.153213  7754 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.168462  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:51.169092  8380 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.172143  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.067317 10794 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:51.126102 10632 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:51.167099  7823 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.182768 10550 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:51.183271 10550 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:51.183652 10550 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.183663 10782 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.192108 10822 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.192807 10822 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.194988 10822 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.197779  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:51.199074  8380 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:51.199625  7823 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:51.204958  7672 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:51.206434 10809 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election won for term 5
W20260501 13:59:51.208810  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.210839 10809 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:51.210940 10794 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:51.212857  7674 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:51.215071  7754 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:51.233584  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.234309  7674 raft_consensus.cc:2376] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7. Re-sending same reply.
I20260501 13:59:51.236562  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.238969  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:51.214471 10809 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.199451 10796 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260501 13:59:51.256705 10796 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:51.257155 10796 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:51.258003 10796 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.262944  7678 raft_consensus.cc:2410] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260501 13:59:51.266073  7672 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260501 13:59:51.266556  7672 pending_rounds.cc:85] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 3
I20260501 13:59:51.266863  7672 pending_rounds.cc:107] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260501 13:59:51.267318  7672 raft_consensus.cc:2889] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:51.272679  7675 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
W20260501 13:59:51.273350  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.275803  7677 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260501 13:59:51.276804  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 43835.6us
I20260501 13:59:51.277674 10852 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:51.279201  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:51.280007  8380 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:51.281323 10610 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.284049 10796 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:51.299858  7673 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:51.284624  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:51.301194  7754 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:51.288236  7823 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:51.284252 10550 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.302945  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:51.305416  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.306349  7675 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:51.306589  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.306921  8380 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
W20260501 13:59:51.302179  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.313257 10610 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.313877  7823 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 13:59:51.309532 10852 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:51.317808 10795 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:51.315809 10852 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.318508 10795 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:51.317191  7677 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:51.325379  7676 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 13:59:51.325325  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.317740  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.328577  7675 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:51.330946  7677 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 13:59:51.337150  7754 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:51.337405 10819 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:51.309062 10630 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260501 13:59:51.339533 10630 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:51.349730 10630 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:51.350733 10630 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.337186  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:51.341362  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:51.337514  7671 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:51.352872 10610 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:51.319651 10795 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.353331 10815 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:51.353886 10815 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:51.354831 10815 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:51.347855 10852 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.356648  7749 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260501 13:59:51.356869  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.330488 10811 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260501 13:59:51.342090 10822 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:51.368261 10829 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:51.366283 10867 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260501 13:59:51.371793 10550 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.374980  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.379053 10819 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:51.385176  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.389112 10831 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:51.384390 10794 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.390625 10794 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.393492 10794 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.381071 10630 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.399632  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:51.400910  8377 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:51.403178  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:51.404176 10831 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.404698 10831 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.406929 10831 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:51.407457 10831 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 13:59:51.408595  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.410056 10819 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260501 13:59:51.407781 10831 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:51.425758  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:51.440946  7576 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:51.440332  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.467531  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:51.474339  7749 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:51.447149 10831 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:51.477245  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 59407us
I20260501 13:59:51.478732  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:51.487723  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:51.447410 10610 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260501 13:59:51.489600  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:51.491014  7718 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.643s (SENT)
I20260501 13:59:51.491526  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.496062 10421 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:51.496737 10421 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:51.497205 10421 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.503212  7823 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260501 13:59:51.504038  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.467047 10819 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:51.511957  8377 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:51.513054  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.504917 10632 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260501 13:59:51.510267 10814 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:51.529875 10852 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260501 13:59:51.531687  7718 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.653s (SENT)
I20260501 13:59:51.531916  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:51.531939 10819 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:51.514636 10809 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:51.518275 10818 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.546890  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:51.548174  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:51.540582 10828 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:51.551662  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:51.553088  7792 leader_election.cc:400] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:51.556092  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.556521  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:51.557452  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:51.558933  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.560431  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:51.560340 10828 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:51.563315  7748 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 13:59:51.563493  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:51.564021  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.564437  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:51.564987  7746 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.564924  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.565778  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:51.566461  7828 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.567402  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:51.568071  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.569284  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:51.565704 10416 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:51.571024  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:51.571877  7824 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260501 13:59:51.549191 10610 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 13:59:51.572711  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.577016  7745 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:51.585705  7746 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:51.586649  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:51.559154 10550 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:51.588550  7828 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:51.561923 10818 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.585320 10505 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260501 13:59:51.592054 10819 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.592510 10818 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.593005 10505 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:51.592720 10819 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.593360 10505 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:51.593990 10505 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.594838 10819 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.595041 10505 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.595397 10819 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:51.598169  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.598296  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.599038  7678 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:51.599541  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.595965 10852 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.600160  7749 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:51.600126  7679 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:51.601171  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69514.9us
I20260501 13:59:51.604707  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.605544 10818 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:51.601218 10416 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.607803 10416 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.608772  7819 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 13:59:51.609982 10416 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:51.617549  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:51.618296  7824 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 13:59:51.621508  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.629719  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:51.631937  8371 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 13:59:51.641255  7672 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:51.558171 10814 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.644196  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.645905  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.649088  7672 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:51.653227 10550 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:51.653700 10831 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.656535 10831 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.657027 10829 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:51.657696  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:51.600432 10819 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.631225 10347 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:51.674695  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:51.623347 10852 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.563561 10828 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.683966  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.671290 10809 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:51.682904 10610 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260501 13:59:51.711474 10809 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:51.713192  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 78324.6us
I20260501 13:59:51.673681 10829 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260501 13:59:51.729292  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48639.1us
I20260501 13:59:51.743785  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:51.744565  8380 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:51.704741 10831 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.679208 10347 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:51.721441  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:51.715364 10795 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:51.793009  8380 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:51.746073 10782 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:51.735061 10809 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:51.795744 10796 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:51.806124  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75782.7us
I20260501 13:59:51.777014 10831 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:51.835084  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 160462us
W20260501 13:59:51.837749  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 68696.5us
I20260501 13:59:51.828536 10851 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:51.832602 10796 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.829101 10782 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:51.845382  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.869573  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:51.871625  7671 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:51.871697  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.884895  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:51.886358  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:51.889097  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.889801  7677 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:51.891089  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:51.892218  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.893015  8380 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:51.871469 10886 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.894182 10886 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.898017  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:51.898559 10421 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:51.899652 10885 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260501 13:59:51.890727 10823 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:51.900561 10823 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:51.901191  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:51.901443 10883 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260501 13:59:51.901794  7671 raft_consensus.cc:2376] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7. Re-sending same reply.
I20260501 13:59:51.902678  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.903183  7671 raft_consensus.cc:2376] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5. Re-sending same reply.
I20260501 13:59:51.904534  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.904912  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:51.905061 10421 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:51.905529 10884 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260501 13:59:51.906044  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.905143  7674 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:51.903237 10823 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:51.925676  7671 raft_consensus.cc:2376] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7. Re-sending same reply.
I20260501 13:59:51.878371 10582 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:51.930152  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:51.930999  7670 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:51.905069 10831 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:51.962978  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 90080us
W20260501 13:59:51.970665  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 77753.8us
I20260501 13:59:51.906208 10819 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.977677  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:51.978842  7674 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 13:59:51.926112 10852 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:51.981801  7677 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:51.928565 10818 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:51.986896  7677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43e99f3322c2477888132a818eae4971"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:59:51.987915  7677 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:51.988538  7677 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:51.925637 10827 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260501 13:59:52.001586  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:52.000690 10894 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.007759  7677 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:51.872316 10851 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:52.007905 10881 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260501 13:59:52.015972  7677 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.016484  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:52.019685  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
W20260501 13:59:52.020785  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 115952us
I20260501 13:59:52.007674 10347 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.005538 10814 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.022640  7753 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 13:59:52.023031  7678 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260501 13:59:52.021771 10550 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:52.017800 10886 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:52.035209 10891 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260501 13:59:52.039072  7677 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:52.039191  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:51.998436 10782 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.024742 10739 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:52.046553 10796 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:52.046734 10739 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.047175 10739 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:52.014062 10894 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.049043 10894 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.049873 10902 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:52.050462 10902 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:52.053015 10896 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.053612 10896 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.051367 10902 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.068580  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.038722 10831 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:52.078801  7670 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
W20260501 13:59:52.080794  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 56412.4us
I20260501 13:59:52.084775  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.085760 10901 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:52.087200 10901 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:52.087582 10901 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:52.088112  7677 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260501 13:59:52.088181  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 67033.5us
I20260501 13:59:52.092494 10582 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:52.093236  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.094669 10818 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:52.083283 10739 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.087954 10901 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:52.097601 10903 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 13:59:52.099148 10739 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:52.115366  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.116628  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:52.116873  7827 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:52.025744 10823 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260501 13:59:52.120810  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:52.121894  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:52.068828 10896 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.122040  8380 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:52.124447  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.126361  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:52.126925  7753 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.121309 10827 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.125845  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.127761 10827 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.128904 10887 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:52.129302 10887 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.129659 10887 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.129878 10827 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.105803 10550 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260501 13:59:52.130923 10550 consensus_queue.cc:1243] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer bc1b0a0a152e46fea4bd4934ba9976ed log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 13:59:52.132573  8377 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEARNER]: Advancing to term 6
I20260501 13:59:52.132973 10901 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.135072 10901 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:52.134987  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:52.131647  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.142519  7753 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:52.144093  8377 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:52.172665  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:52.187247  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:52.203438  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 78323.7us
I20260501 13:59:52.205726 10905 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.206554 10905 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.208305 10851 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.208988 10827 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:52.209259 10905 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:52.216264  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 43786us
I20260501 13:59:52.230959  7828 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:52.231495  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.231874  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.232533  7827 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 13:59:52.215588 10903 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:52.237562  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.203511  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:52.241362  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:52.222378 10739 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:52.216385 10818 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:52.229257 10630 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260501 13:59:52.250311 10739 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.252391 10582 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.227118 10809 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.281814 10739 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:52.250597 10903 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.299762 10809 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.300945 10899 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:52.302490 10903 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.303207  7746 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:52.284519 10582 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.305974 10582 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.307184 10829 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.307704 10829 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.309695 10829 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.312115  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.312778  7751 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:52.313165 10828 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:52.300966 10887 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.318639 10851 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:52.319167 10851 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.320564 10887 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.321357  7747 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:52.293965 10795 consensus_meta.cc:287] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260501 13:59:52.323191 10795 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:52.323963  7745 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:52.324045 10910 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260501 13:59:52.323967 10895 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.325119 10895 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.328708  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.328832 10818 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.329811  7746 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:52.327692 10895 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.332803 10851 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.334163  7748 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:52.332469 10739 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.315423  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:52.334586  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:52.335569  7746 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:52.343415  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.347532 10893 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:52.346786 10905 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:52.364763 10893 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:52.364596  7577 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:52.365811 10893 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.366793  7577 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:52.368891  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 187) took 1130 ms. Trace:
I20260501 13:59:52.371263  7577 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 9, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:52.370416  7576 rpcz_store.cc:276] 0501 13:59:51.238799 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:51.239532 (+   733us) service_pool.cc:224] Handling call
0501 13:59:52.368797 (+1129265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:51.477192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:51.532485 (+ 55293us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:51.532530 (+    45us) write_op.cc:435] Acquired schema lock
0501 13:59:51.532551 (+    21us) tablet.cc:662] Decoding operations
0501 13:59:51.532961 (+   410us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:51.533025 (+    64us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:51.533056 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:51.533291 (+   235us) tablet.cc:701] Row locks acquired
0501 13:59:51.533314 (+    23us) write_op.cc:260] PREPARE: finished
0501 13:59:51.533498 (+   184us) write_op.cc:270] Start()
0501 13:59:51.533630 (+   132us) write_op.cc:276] Timestamp: P: 1777643991533434 usec, L: 0
0501 13:59:51.533656 (+    26us) op_driver.cc:348] REPLICATION: starting
0501 13:59:51.637465 (+103809us) log.cc:844] Serialized 533 byte log entry
0501 13:59:51.673575 (+ 36110us) op_driver.cc:464] REPLICATION: finished
0501 13:59:51.707754 (+ 34179us) write_op.cc:301] APPLY: starting
0501 13:59:51.714025 (+  6271us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:51.741283 (+ 27258us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:51.823848 (+ 82565us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:51.836027 (+ 12179us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:51.847669 (+ 11642us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:51.871461 (+ 23792us) write_op.cc:312] APPLY: finished
0501 13:59:51.891330 (+ 19869us) log.cc:844] Serialized 23 byte log entry
0501 13:59:51.926303 (+ 34973us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:51.939785 (+ 13482us) write_op.cc:454] Released schema lock
0501 13:59:51.968166 (+ 28381us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:52.076965 (+108799us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6dd208 00007fb2fe1229f1 00007fb2fe1221c8 00007fb2fe126e61 00007fb2fe126e19 00007fb2fe126da9 00007fb2fe126d71 00007fb2fe125f9d 0000000000379254 0000000000379099
0501 13:59:52.077298 (+   333us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:52.077353 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9341,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":2517,"apply.run_cpu_time_us":6346,"apply.run_wall_time_us":309656,"num_ops":1,"prepare.queue_time_us":186,"prepare.run_cpu_time_us":10559,"prepare.run_wall_time_us":610491,"replication_time_us":131521,"spinlock_wait_cycles":56595712}]]}
I20260501 13:59:52.377799  7577 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 7, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:52.388882  7577 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:52.391578  7577 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:52.401032  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:52.404507  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 518147us
I20260501 13:59:52.405887  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.402045  8377 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
W20260501 13:59:52.408998  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58084.7us
I20260501 13:59:52.414045  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.359670  7746 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:52.428109 10888 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:52.429304  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:52.429746 10917 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:52.430028  7822 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:52.378530 10739 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:52.425988  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.444974  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.446779  7822 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:52.450824  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.466061  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.472319  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:52.477480  7746 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260501 13:59:52.479489  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:52.480947  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:52.490182  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:52.483110  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.461658 10850 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:52.462486 10851 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:52.497025  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.498502  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:52.484755 10888 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:52.517416  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:52.484618 10895 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:52.504580  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.488538 10831 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.511286  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.511672  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.485968 10505 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:52.482244 10887 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260501 13:59:52.518426  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.526487  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.505333  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.467327 10632 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260501 13:59:52.529925  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.528924  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.533538  7677 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.526930  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.534294  7670 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:52.535266  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.535766  7670 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.463882 10917 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260501 13:59:52.536393  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.538152  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.539371  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.539554  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.540419  7679 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:52.540689 10899 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:52.541270  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.543093  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.543665  7679 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:52.498744 10828 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:52.530634  7671 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 13:59:52.549633  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.550315  7675 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:52.551057  7671 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 13:59:52.550408  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.526777  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.528267  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:52.528805  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.552080  7679 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:52.546639  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.498945 10851 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.499300 10850 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.552161  7751 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.552116  7672 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:52.519941  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.494560 10915 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:52.558678  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "294b76c5890f455f97130fdbedace9af"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:52.559299  7746 raft_consensus.cc:606] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:52.560493  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.559790  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.561228  7671 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:52.561721  7679 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:52.562430  7671 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 13:59:52.567551  7672 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:52.574597  7670 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:52.575160  7677 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:52.523917 10894 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:52.579134  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.575766 10918 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:52.575947 10864 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260501 13:59:52.536365 10827 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260501 13:59:52.582464 10864 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:52.582870 10864 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:52.583876  8377 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260501 13:59:52.581784 10918 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.585424 10918 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:52.588797 10922 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 13:59:52.592311  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.592334  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:52.599327  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.498590 10421 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260501 13:59:52.528635 10505 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.603842  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.558089 10917 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:52.600495  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.557735 10898 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:52.613509  7675 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:52.557586 10850 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:52.557951 10851 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.630592  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.632195  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.533034 10831 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.636619  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.639416  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.621721 10505 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:52.644613  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 114208us
I20260501 13:59:52.618709 10894 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:52.631440 10811 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:52.659301  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.653955  7751 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:52.620685 10887 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:52.673502  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:52.636199 10854 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:52.643949 10818 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:52.635675 10915 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 13:59:52.645747 10899 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:52.629438 10809 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260501 13:59:52.686973  8380 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 13:59:52.645870 10819 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 13:59:52.688798  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 126153us
I20260501 13:59:52.689015  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:52.583751 10864 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.670217 10811 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.680526 10651 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election won for term 5
I20260501 13:59:52.706012  8371 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:52.707324  7670 pending_rounds.cc:85] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 13:59:52.713848  7670 pending_rounds.cc:107] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260501 13:59:52.714146  7670 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:52.709033  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:52.696010 10898 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:52.722329  8371 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 13:59:52.722640  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:52.730672  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.731803  7674 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 5: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:52.686349 10887 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.693624 10888 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260501 13:59:52.716061 10811 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:52.738590  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.743166  7674 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:52.744854  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:52.749496 10909 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:52.758705 10909 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:52.759114 10909 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:52.760962 10920 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260501 13:59:52.764194 10926 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260501 13:59:52.737876  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:52.728045 10651 raft_consensus.cc:697] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:52.814368  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.824843 10421 raft_consensus.cc:993] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:52.825424 10421 raft_consensus.cc:1081] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:52.829087  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:52.830238 10421 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:52.831110  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.785742 10898 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:52.771212 10918 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.810063 10729 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.831430 10827 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:52.729502 10894 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.813169 10582 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260501 13:59:52.831514 10915 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:52.810917 10794 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260501 13:59:52.831091 10930 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260501 13:59:52.894003  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 83489.9us
I20260501 13:59:52.816460 10550 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260501 13:59:52.869604 10899 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:52.882963 10421 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:52.900759  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:52.883944  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:52.906039 10887 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:52.906239 10936 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260501 13:59:52.885488 10831 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:52.904493 10794 consensus_queue.cc:1243] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer bc1b0a0a152e46fea4bd4934ba9976ed log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260501 13:59:52.886283 10729 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:52.944304  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 60460.5us
I20260501 13:59:52.947610 10900 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:52.951277  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:52.952016  7673 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:52.952313 10943 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:52.931142 10421 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:52.948357 10900 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.962882  7673 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 13:59:52.936604 10815 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 13:59:52.971030  7827 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:52.971483  7827 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 13:59:52.972410 10933 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260501 13:59:52.972366  7827 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.976100 10630 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:52.976583 10630 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:52.977433 10630 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.907577 10651 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:52.980433 10815 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:52.980973 10815 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 13:59:52.984954  7672 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 13:59:52.969277  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 13:59:52.988413  7673 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:52.988771  7673 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:52.990223  7678 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:52.964092  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:52.965736  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:52.993486  7827 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:52.928849  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 60582.5us
I20260501 13:59:52.904214 10915 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.957266 10943 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:53.015002  7749 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:52.918617 10899 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:52.982862 10850 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.005143 10930 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:53.066303  7673 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:53.070595  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 110985us
I20260501 13:59:53.077479  7824 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260501 13:59:53.077953  7824 pending_rounds.cc:85] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 5
I20260501 13:59:53.078251  7824 pending_rounds.cc:107] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260501 13:59:53.081781  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:53.082665  7749 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:53.084022  7821 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260501 13:59:53.078575  7824 raft_consensus.cc:2889] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:53.075994 10936 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260501 13:59:53.138577  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:53.071542 10930 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:53.135331  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:53.137187  7822 raft_consensus.cc:2368] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6.
W20260501 13:59:53.140151  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54389.2us
I20260501 13:59:53.135067  7673 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:53.143839  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:53.137779 10935 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260501 13:59:52.957521 10898 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:53.157388  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 135269us
I20260501 13:59:53.147444 10930 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:53.189888  8374 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260501 13:59:53.171878 10942 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260501 13:59:53.158879 10918 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.156792 10852 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:53.224413  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:53.225576  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:53.230700  8375 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:53.205718 10939 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260501 13:59:53.162860 10957 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:53.206341 10854 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:53.243273  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 98902.2us
I20260501 13:59:53.143560 10421 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.255909  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 13:59:53.258697  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 172115us
I20260501 13:59:53.268939  7827 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:53.271585  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:53.272389  7824 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:53.272774  7824 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:53.282588  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:53.233096 10729 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.282385  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:53.235966 10827 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:53.314777  7679 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:53.289039  7824 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.331651  7827 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 13:59:53.288403  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:53.233572 10852 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:53.348549  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 110212us
W20260501 13:59:53.369099  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 134899us
I20260501 13:59:53.315327 10794 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260501 13:59:53.384534  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 100963us
I20260501 13:59:53.390985  7679 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 13:59:53.289489 10854 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.215693 10943 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.335282 10827 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.243948 10957 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.371984 10899 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.429042  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:53.429818  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:53.430756  7827 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:53.395326 10850 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:53.393725 10961 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:53.452670  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:53.501960  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 71852.9us
I20260501 13:59:53.508771 10969 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 13:59:53.519155 10956 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260501 13:59:53.519294 10955 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260501 13:59:53.518854 10969 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.521060 10948 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:53.521425 10969 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.461158 10932 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.277s
I20260501 13:59:53.501725  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:53.540402  7749 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:53.522330 10827 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.521770 10948 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:53.497602 10651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.011s	sys 0.023s
I20260501 13:59:53.468866 10899 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260501 13:59:53.483047 10968 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:53.556983  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:53.505992 10729 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:53.510131 10582 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:53.546103 10651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.012s	sys 0.024s
W20260501 13:59:53.568178 10958 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260501 13:59:53.592315  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:53.594347 10993 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:53.594729 10970 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:53.595109 10993 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.595293 10970 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.597668 10970 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:53.598848 10964 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260501 13:59:53.599303 10852 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.600222 10975 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:53.569147 10729 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.600932 10975 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.602856 10729 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.603188 10975 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.572365 10582 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.604116 10959 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:53.605609 10582 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:53.606424 10811 consensus_meta.cc:287] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.004s
I20260501 13:59:53.606933 10811 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.600322 10852 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:53.488093 10961 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:53.620605  7675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.031s	sys 0.043s
W20260501 13:59:53.621176  7675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.031s	sys 0.043s
W20260501 13:59:53.646296 10909 consensus_meta.cc:287] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.006s
W20260501 13:59:53.667845  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:53.674075 10505 consensus_meta.cc:287] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.999s	user 0.010s	sys 0.005s
I20260501 13:59:53.674593 10505 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.678519 10854 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.562938 10968 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.682336 10968 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.682714 10864 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:53.685789 10948 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.689366 10961 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:53.691445 10815 consensus_meta.cc:287] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.710s	user 0.015s	sys 0.000s
I20260501 13:59:53.692870 10815 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.623353 10852 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.691632 10957 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.696518 10852 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.679256 10909 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.697826 10993 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.698637 10909 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:53.695782 10505 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:53.703598 10922 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:53.704578 10922 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.705708 10900 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.710304  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1698) took 1119 ms. Trace:
I20260501 13:59:53.710711  7822 rpcz_store.cc:276] 0501 13:59:52.591367 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.591963 (+   596us) service_pool.cc:224] Handling call
0501 13:59:53.710062 (+1118099us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400134054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:53.710212 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135407232}
I20260501 13:59:53.711359 10811 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.707494 10922 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:53.720943 10936 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
I20260501 13:59:53.718607  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47166 (request call id 31) took 1180 ms. Trace:
I20260501 13:59:53.724277  7746 rpcz_store.cc:276] 0501 13:59:52.537706 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.558526 (+ 20820us) service_pool.cc:224] Handling call
0501 13:59:53.712719 (+1154193us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400317f20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa65e900 00007fb2fa6dba32 00007fb2ff6b7cca 00007fb2f8c30934 00007fb2f8c308c2 00007fb2f8c307f1 00007fb2f8c3076c 00007fb2f8c2fa22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:53.712971 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95547776}
I20260501 13:59:53.734196 10953 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:53.737706 10937 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:53.738442 10937 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:53.740938 10941 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.757s	user 0.000s	sys 0.002s
I20260501 13:59:53.734990 10953 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.753228  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47951612b03c496aa487574a115ca380"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:53.756620  7822 raft_consensus.cc:606] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:53.757252  7822 raft_consensus.cc:614] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:53.761097 10851 consensus_meta.cc:287] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.117s	user 0.010s	sys 0.006s
I20260501 13:59:53.761770 10851 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:53.763252  7828 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:53.763285  7745 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 13:59:53.774327  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1699) took 1182 ms. Trace:
I20260501 13:59:53.774817  7828 rpcz_store.cc:276] 0501 13:59:52.591762 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.592031 (+   269us) service_pool.cc:224] Handling call
0501 13:59:53.774099 (+1182068us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003c8054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:53.774254 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689405696}
I20260501 13:59:53.778853 10915 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:53.781255 10930 consensus_meta.cc:287] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260501 13:59:53.781860 10930 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:53.783070  7824 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:53.784195 10937 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:53.785413  8375 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:53.752746 10953 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:53.786455  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:53.802420 10630 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:53.802829  7749 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 6
I20260501 13:59:53.807806  7746 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:53.809248  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539945233a6f4f6589f58e774245669e"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:53.809962  7828 raft_consensus.cc:606] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:53.810338  7828 raft_consensus.cc:614] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:53.816114  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:53.814754  7573 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:53.822203  7573 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 3 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), now has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:59:53.793556 10851 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:53.829119  7749 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:53.837682  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:53.838603 10930 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.832774  7824 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
W20260501 13:59:53.857210  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 289197us
I20260501 13:59:53.867023  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:53.868153  7824 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:53.873167  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:53.873463  7828 raft_consensus.cc:606] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:53.874296  7749 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:53.908021  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:53.910535  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1702) took 1278 ms. Trace:
I20260501 13:59:53.912317  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:53.913254  8375 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:53.911026  7819 rpcz_store.cc:276] 0501 13:59:52.623993 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.624176 (+   183us) service_pool.cc:224] Handling call
0501 13:59:52.624686 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:52.631124 (+  6438us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:52.631173 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:52.949842 (+318669us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b2c00163b48. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 13:59:52.960542 (+ 10700us) log.cc:844] Serialized 26 byte log entry
0501 13:59:53.345427 (+384885us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:53.345568 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:53.347202 (+  1634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:53.900352 (+553150us) raft_consensus.cc:1685] finished
0501 13:59:53.900369 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:53.902178 (+  1809us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29765,"raft.queue_time_us":65610,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":16915,"spinlock_wait_cycles":3818368,"thread_start_us":384063,"threads_started":1,"wal-append.queue_time_us":895649}
I20260501 13:59:53.936607  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:53.917249  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:53.939064  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:53.940163  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:53.943043  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:53.944470  7745 raft_consensus.cc:2368] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:53.943188  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:53.946127  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 272) took 2716 ms. Trace:
I20260501 13:59:53.941128  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:53.946694  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:53.949574  7747 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:53.939034  7750 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:53.952636  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:53.954249  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:53.916628 10815 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:53.917354 10930 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:53.957676  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.010s	sys 0.037s
I20260501 13:59:53.960465  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:53.961181  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:53.965490  7819 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:53.966051  7819 raft_consensus.cc:614] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 13:59:53.966547  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.010s	sys 0.037s
I20260501 13:59:53.967602  7745 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:53.971454  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 655140us
I20260501 13:59:53.948269  7577 rpcz_store.cc:276] 0501 13:59:51.230193 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:51.239963 (+  9770us) service_pool.cc:224] Handling call
0501 13:59:53.946049 (+2706086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:52.516813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:52.539511 (+ 22698us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:52.539548 (+    37us) write_op.cc:435] Acquired schema lock
0501 13:59:52.539565 (+    17us) tablet.cc:662] Decoding operations
0501 13:59:52.540431 (+   866us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:52.540510 (+    79us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:52.540543 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0501 13:59:52.541083 (+   540us) tablet.cc:701] Row locks acquired
0501 13:59:52.541100 (+    17us) write_op.cc:260] PREPARE: finished
0501 13:59:52.541257 (+   157us) write_op.cc:270] Start()
0501 13:59:52.541389 (+   132us) write_op.cc:276] Timestamp: P: 1777643992541201 usec, L: 0
0501 13:59:52.541410 (+    21us) op_driver.cc:348] REPLICATION: starting
0501 13:59:52.542095 (+   685us) log.cc:844] Serialized 2454 byte log entry
0501 13:59:52.700439 (+158344us) op_driver.cc:464] REPLICATION: finished
0501 13:59:52.905458 (+205019us) write_op.cc:301] APPLY: starting
0501 13:59:52.905624 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:52.905881 (+   257us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:52.906032 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:52.913404 (+  7372us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:52.913736 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0501 13:59:52.913811 (+    75us) write_op.cc:312] APPLY: finished
0501 13:59:52.914200 (+   389us) log.cc:844] Serialized 53 byte log entry
0501 13:59:52.914473 (+   273us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:52.914651 (+   178us) write_op.cc:454] Released schema lock
0501 13:59:52.914732 (+    81us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:52.915228 (+   496us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:52.915277 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63537,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":201482,"apply.run_cpu_time_us":3506,"apply.run_wall_time_us":12938,"num_ops":6,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":3777,"prepare.run_wall_time_us":76468,"replication_time_us":158807,"thread_start_us":119295,"threads_started":1}]]}
W20260501 13:59:53.988582  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49192us
I20260501 13:59:53.947722 10822 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:53.956591 10831 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 13:59:53.995193  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:53.951887 10902 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:54.000602  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:54.006568  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:54.007462  7750 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:54.007462  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:53.970480 10900 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 13:59:54.010911  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:54.041414  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:53.951511 10937 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260501 13:59:54.002238  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:54.038269  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:53.987007 10930 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.129063  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1486) took 1552 ms. Trace:
I20260501 13:59:54.130137  7673 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260501 13:59:54.135459  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 97364.1us
I20260501 13:59:53.995190 10815 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260501 13:59:54.004899 10946 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.100s
W20260501 13:59:54.136463  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 134324us
I20260501 13:59:54.146255  7718 leader_election.cc:400] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6.
I20260501 13:59:54.146595  7718 leader_election.cc:403] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260501 13:59:54.132738 10990 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260501 13:59:54.128031 10994 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260501 13:59:54.100664  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 59946.7us
I20260501 13:59:54.137418  7670 rpcz_store.cc:276] 0501 13:59:52.576931 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.620442 (+ 43511us) service_pool.cc:224] Handling call
0501 13:59:52.636215 (+ 15773us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 13:59:52.782215 (+146000us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:52.782263 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 13:59:52.783009 (+   746us) log.cc:844] Serialized 52 byte log entry
0501 13:59:52.869125 (+ 86116us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:53.134517 (+265392us) log.cc:844] Serialized 14 byte log entry
0501 13:59:53.418533 (+284016us) log.cc:844] Serialized 14 byte log entry
0501 13:59:53.740386 (+321853us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b24000f8bb8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7495e94 00007fb2f7493f9b 00007fb2f7522d39 00007fb2f75229c5 00007fb2f752200d 00007fb2fa2644ae 00007fb2fa27bc2c 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1
0501 13:59:53.940866 (+200480us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:54.128554 (+187688us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54001ecb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:54.128611 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:54.128663 (+    52us) raft_consensus.cc:1685] finished
0501 13:59:54.128677 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:54.128909 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124227,"prepare.queue_time_us":336492,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":96,"raft.queue_time_us":489648,"raft.run_cpu_time_us":1003,"raft.run_wall_time_us":42221,"spinlock_wait_cycles":211085952,"thread_start_us":1101054,"threads_started":4,"wal-append.queue_time_us":134983}
W20260501 13:59:54.083802  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:54.000196 10822 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:54.107426 10996 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260501 13:59:54.010535 10894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.003s	sys 0.006s
I20260501 13:59:54.140312  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:54.196776  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:54.193351  7828 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260501 13:59:54.155050  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:54.243129  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:54.234537  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:54.169703  7819 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:54.227514  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65432us
I20260501 13:59:54.180795  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:54.404161  7824 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:54.233762  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:54.403328  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:54.176143  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:54.033500 10900 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:54.401008  7821 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:54.145066 10610 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:54.163134 10894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.007s	sys 0.024s
W20260501 13:59:54.393805 11002 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260501 13:59:54.318660 11003 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.455534  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:54.455883 10961 raft_consensus.cc:993] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:54.456422 10961 raft_consensus.cc:1081] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 13:59:54.175841 11000 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:54.457527 11000 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:54.457885 11000 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:54.331768 10850 raft_consensus.cc:1027] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: attempt to promote peer 91854d93e96c4756834efe8b2ef59fce: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260501 13:59:54.460577  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:54.461102 10898 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.461453  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:54.440871  7792 leader_election.cc:400] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:54.462061  7792 leader_election.cc:403] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260501 13:59:54.461717 10898 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:54.155143 10822 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:54.443310 10630 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:54.175673 10999 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 13:59:54.463843 10630 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:54.464162 10999 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:54.322710 10864 consensus_meta.cc:287] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.005s
I20260501 13:59:54.464859 10630 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.465109 10999 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.451007 10951 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.468111 10951 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.456517  7827 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:54.461229  7826 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:54.455590 11003 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.152639 10910 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6.
W20260501 13:59:54.248986 10985 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260501 13:59:54.276530 10990 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260501 13:59:54.256560 10416 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:54.474145  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:54.154971 10899 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.483459  8376 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:54.486151  8375 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:54.441857 10900 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:54.315668 10915 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:54.352558 10946 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:54.190771 10930 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:54.471277 10898 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:54.516781  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:54.486860 11000 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.504900 10953 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:54.506568 10979 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:54.471944 10610 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.505185 10945 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:54.570564  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 413) took 1324 ms. Trace:
I20260501 13:59:54.479332 11003 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.554948 10898 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:54.507349 10965 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:54.504932 10416 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:54.512203 10899 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.553375 10953 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:54.537407 10950 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260501 13:59:54.483278 10822 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:54.539150 10946 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.571092  8374 rpcz_store.cc:276] 0501 13:59:53.237521 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:53.237663 (+   142us) service_pool.cc:224] Handling call
0501 13:59:53.238008 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:53.347925 (+109917us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:53.347980 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:53.348826 (+   846us) log.cc:844] Serialized 26 byte log entry
0501 13:59:53.485429 (+136603us) raft_consensus.cc:1645] Marking committed up to 7
0501 13:59:53.485513 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:53.485829 (+   316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:54.561240 (+1075411us) raft_consensus.cc:1685] finished
0501 13:59:54.561275 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:54.561451 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16082,"raft.queue_time_us":2492,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":28161,"thread_start_us":245372,"threads_started":2,"wal-append.queue_time_us":507417}
I20260501 13:59:54.577694 10979 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:54.611862 11005 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260501 13:59:54.579202 10965 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:54.579399 11003 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.540787 10912 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260501 13:59:54.535634 10915 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.622114 10610 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.575732 10945 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:54.629611  7747 consensus_meta.cc:287] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.677s	user 0.014s	sys 0.000s
I20260501 13:59:54.631381 10953 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:54.640463  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:54.578840 10898 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:54.663779 10951 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:54.706295  7747 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:54.706470  8377 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
W20260501 13:59:54.657240 11008 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260501 13:59:54.732254  7826 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:54.656421 11013 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:54.660595  8379 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEARNER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:59:54.722398 10850 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:54.718433 10815 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.780740 10610 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.665069 11003 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.741433 10899 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.740378 10896 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:54.798020 10610 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:54.791949 10632 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.747982 11013 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.821549 11013 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.822377 11013 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:54.823046 11013 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:54.829293 10997 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.730s	user 0.001s	sys 0.009s
I20260501 13:59:54.834365 10979 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.790524 10815 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.812286 11000 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.793484 10850 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.891558  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1488) took 2311 ms. Trace:
I20260501 13:59:54.892277  7675 rpcz_store.cc:276] 0501 13:59:52.577639 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.634913 (+ 57274us) service_pool.cc:224] Handling call
0501 13:59:52.990752 (+355839us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 13:59:52.991095 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:52.991122 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 13:59:53.000376 (+  9254us) log.cc:844] Serialized 26 byte log entry
0501 13:59:53.621927 (+621551us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:53.653169 (+ 31242us) log.cc:844] Serialized 14 byte log entry
0501 13:59:53.680414 (+ 27245us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:53.680518 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 13:59:54.177667 (+497149us) raft_consensus.cc:1685] finished
0501 13:59:54.177690 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:54.888846 (+711156us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54001ec650. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:54.889027 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26929,"prepare.queue_time_us":30989,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":54,"raft.queue_time_us":27859,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":11442,"spinlock_wait_cycles":817215744,"thread_start_us":592521,"threads_started":1,"wal-append.queue_time_us":871213}
I20260501 13:59:54.809048 10899 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.875180 10905 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:54.920068 10905 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.922482 10905 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:54.805960 10898 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:54.886257 10965 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:54.919585 11012 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260501 13:59:54.887516 10822 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.836278 10632 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:54.927208 10946 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.959281 10999 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:54.961727  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 496792us
I20260501 13:59:54.943025 10915 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:54.928673 10416 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:54.928831 10899 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:54.989604  7720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.024s	sys 0.021s
W20260501 13:59:55.094461  7720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.025s	sys 0.021s
W20260501 13:59:55.091341 10903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.016s	sys 0.030s
W20260501 13:59:55.119709  7822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.060s
W20260501 13:59:55.128707  7822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.000s	sys 0.060s
I20260501 13:59:55.090668 10822 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:55.130939 10795 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.011s	sys 0.044s
W20260501 13:59:55.133533 10823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.016s	sys 0.039s
I20260501 13:59:55.116694 10610 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:55.161664 10582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.023s	sys 0.032s
W20260501 13:59:55.165891 10823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.016s	sys 0.042s
I20260501 13:59:55.131412 10937 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:55.166265 10630 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:54.991209 10999 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:55.211210 10630 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.213488 10999 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.213938 10630 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:55.195643 10902 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 13:59:55.164551 11012 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260501 13:59:55.133046 10903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.017s	sys 0.030s
W20260501 13:59:55.165373 10795 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.012s	sys 0.044s
W20260501 13:59:55.236723  8372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.036s	sys 0.044s
I20260501 13:59:55.128084 11003 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:55.237385  8372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.037s	sys 0.044s
W20260501 13:59:55.164883  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.014s	sys 0.034s
W20260501 13:59:55.242457  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.014s	sys 0.034s
W20260501 13:59:55.243054  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 673760us
W20260501 13:59:55.200562 10582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.029s	sys 0.033s
W20260501 13:59:55.245025 10900 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.706s	user 0.019s	sys 0.000s
I20260501 13:59:55.258960 10900 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.261843 10900 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.199064 10850 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:55.162637 10822 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.250329 10815 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:55.248030 11013 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.271157  7826 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260501 13:59:55.267958  8376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 407) took 2555 ms (client timeout 1519 ms). Trace:
W20260501 13:59:55.274391  8376 rpcz_store.cc:269] 0501 13:59:52.708376 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.708657 (+   281us) service_pool.cc:224] Handling call
0501 13:59:55.263592 (+2554935us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54004b1254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:55.263727 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4030361344}
W20260501 13:59:55.270669  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.015s	sys 0.082s
W20260501 13:59:55.278831  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.015s	sys 0.082s
W20260501 13:59:55.271413 11006 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 1.002s	user 0.012s	sys 0.012s
I20260501 13:59:55.281322 11013 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.275126 10632 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:55.285027 10991 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.292323  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:55.294303  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.295300  7826 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:55.288700 10969 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:55.312810  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:55.297643  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.021s	sys 0.025s
I20260501 13:59:55.289439 10729 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 13:59:55.297317 10953 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.565s	user 0.016s	sys 0.004s
W20260501 13:59:55.327126  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.022s	sys 0.025s
W20260501 13:59:55.329677  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 1.1894e+06us
I20260501 13:59:55.338832  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.340046  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.342196  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.343158  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.300454 10899 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.298520 10632 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.345391  8374 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:55.346007  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.288491 11013 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.349799  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:55.352727  8371 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:55.353617  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.355665  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.327699 10739 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.356714  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.347388  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.359515  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.357322  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.348959 11026 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.300400 10991 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.364445 10739 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.364538 11026 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.348803 10815 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.365936 10815 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.366917 11026 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.367403 10899 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.367949 10899 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.369108 11013 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.369318 10894 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:55.369856 10899 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.349380 11021 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.370695 11021 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.372814 11021 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.366966 10739 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.374503  7826 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:55.333530 10969 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.376127 11028 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.376672 11028 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.377735 10969 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.378729 11028 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.331094 10729 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.381757  7823 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:55.382494 10729 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:55.385717  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.386281  8374 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:55.375200  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:55.389602  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 413253us
I20260501 13:59:55.392005  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.393704  7823 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:55.392665  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.392814  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:55.395160  7827 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:55.345624  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.627s (SENT) [suppressed 41 similar messages]
I20260501 13:59:55.392048  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.336400 10953 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.357812 10632 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.396626 11021 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:55.405849  7821 raft_consensus.cc:2368] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9.
I20260501 13:59:55.408370  8371 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:55.409098  8375 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260501 13:59:55.401786 11023 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.406652  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:55.416014  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.403090 10815 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.418473  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.444494  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.440490  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.444495  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.445341  7749 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:55.445585  7747 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 13:59:55.446563  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.410245 10550 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.448807  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.448619  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.428174 10969 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.428377 11013 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.451437  8371 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:55.451599  7747 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:55.452025  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.431354 11003 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.437674 11017 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.437827 10915 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.450649  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.455084  7745 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260501 13:59:55.431581 10610 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.461233  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.461503  7749 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:55.428201 10899 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.456964  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.429193 11021 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.469635  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:55.464376  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 95394.4us
I20260501 13:59:55.475481  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.461890  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.471395  7828 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 13:59:55.458600  7750 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:55.469933  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.448745 10923 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.458593 10822 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.479354  7827 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 13:59:55.480417  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.480566  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.451673 11016 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:55.478258  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.487932  7826 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 13:59:55.488955  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.439045 11023 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.460914 11027 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.470813 11032 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.496233  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.478238 10898 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.503808  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.509446 10582 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.510018 11016 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:55.459367 10969 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.457752 10550 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.487883 10923 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.470189 11017 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.473865 10899 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.516413  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.517128 10998 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:55.543179 11016 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.543988 10998 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:55.544955 10998 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.545735 10899 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.546298 10998 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:55.517737  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:55.520190  7828 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:55.461431 11013 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:55.527534  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 181929us
I20260501 13:59:55.529956  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.531100  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.470501 11003 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.535554  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.472918 10610 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.523561 10815 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.541325 10991 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.493913 10965 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.548290  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:55.473611 10915 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.551179  8381 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:55.546332 10899 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.553714 11031 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:55.554193  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:55.563756  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:55.580111  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.581535  7750 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 13:59:55.582288  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.567302 10815 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.583688  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:55.583853  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.518067 11027 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.567487 11031 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:55.589407 11031 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:55.589831 11017 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.590142 10610 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.590790 10610 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.580344 10899 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.599413 10899 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.600194  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.532076 10582 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.567708 10991 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.601150 10953 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.600998 10923 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.523782 11032 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:55.624966  8377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51744 (request call id 1004) took 1713 ms (client timeout 1627 ms). Trace:
I20260501 13:59:55.624802 10991 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.615743  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:55.622820 10915 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.616351 10969 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.629854  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.532461 10898 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:55.631372  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.632118  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:55.629961  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.632448  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.632800  7677 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:55.633080  7676 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:55.632200  7679 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:55.635164  7672 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:55.620355  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.636933  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1010) took 1078 ms. Trace:
I20260501 13:59:55.634130  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.637485  8379 rpcz_store.cc:276] 0501 13:59:54.559025 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:54.559185 (+   160us) service_pool.cc:224] Handling call
0501 13:59:54.576311 (+ 17126us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:54.576618 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 13:59:55.227638 (+651020us) log.cc:844] Serialized 14 byte log entry
0501 13:59:55.536203 (+308565us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b1800036fa0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7611be6 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9
0501 13:59:55.636151 (+ 99948us) log.cc:844] Serialized 14 byte log entry
0501 13:59:55.636444 (+   293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:55.636529 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:55.636596 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:55.636699 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:55.636855 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127216,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":110,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4948,"spinlock_wait_cycles":42504320,"thread_start_us":275838,"threads_started":2,"wal-append.queue_time_us":225187}
I20260501 13:59:55.569694 10900 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:55.642928  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.644013  7679 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:55.645813  7673 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:55.591313 10610 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:55.625451  8377 rpcz_store.cc:269] 0501 13:59:53.911051 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:53.914032 (+  2981us) service_pool.cc:224] Handling call
0501 13:59:55.624729 (+1710697us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b540075f8d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:55.624856 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761535360}
I20260501 13:59:55.646644  7671 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 13:59:55.636005  7752 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 13:59:55.649498  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.570125 10931 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:55.585937 10632 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.674343  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:55.675136  7678 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:55.563077 10965 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:55.702661  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 121705us
I20260501 13:59:55.619406 11023 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.616523 11021 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.623320 11003 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.569808 10795 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:55.707492  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.664701  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:55.669375 10887 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.665629 10953 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.712297  7677 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:55.706086  7671 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:55.787597  7675 pending_rounds.cc:85] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 2
W20260501 13:59:55.737605 11046 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260501 13:59:55.669427 10900 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:55.716706 10930 raft_consensus.cc:1064] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 13:59:55.595460 11039 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260501 13:59:55.721446 10582 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.601032 10550 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.618330 11013 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.723392 11027 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.724403 10610 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.725633 10815 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:55.732175  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:55.601045 10899 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.837414 10899 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.738579  7676 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:55.748317 10632 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:55.839442  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.840026 10632 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:55.749119  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:55.756312  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:55.750653  7678 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:55.760800  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.626257 11032 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.779294 10823 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.780501  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:55.716382 10969 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.788028  7675 pending_rounds.cc:107] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260501 13:59:55.716566 10991 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:55.815845  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:55.775286 10795 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:55.802294 10953 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.840931  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.852625  7748 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:55.852715  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.848803  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.853834  7749 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:55.854467  7670 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:55.855329  7675 raft_consensus.cc:2889] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:55.823807  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.857424  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.859400  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.859977  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.860615  7747 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
W20260501 13:59:55.861493  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 105252us
I20260501 13:59:55.862286  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:55.863658  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.864378  7746 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:55.865370  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.868690  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.869944  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:55.871522  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.873116  7747 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:55.876987  7751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:60274
I20260501 13:59:55.877692  7751 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 13:59:55.878129  7751 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:55.882598  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.883499  7748 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:55.882598  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.889691  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:55.906433  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:55.907262  7673 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:55.910171  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56774.9us
I20260501 13:59:55.795185 10887 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:55.858544 10795 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:55.814396 11033 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260501 13:59:55.821280 10931 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:55.918366  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 296) took 4351 ms. Trace:
I20260501 13:59:55.849289 10965 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.850617 10898 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:55.913434  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:55.882115 10812 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.870203 10969 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.868602 10822 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:55.922622  7751 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.869120 10823 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:55.975909  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56374.8us
I20260501 13:59:55.982396  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.092679  7674 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:56.005170  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:55.997272  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 305) took 3878 ms. Trace:
I20260501 13:59:56.094542  7676 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:55.931224  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:56.096894  7677 raft_consensus.cc:2368] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:56.020303  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:55.888692 10979 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:56.103088  7751 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.110301  7748 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 13:59:55.905014 10894 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:56.095031  7573 rpcz_store.cc:276] 0501 13:59:52.118862 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.121777 (+  2915us) service_pool.cc:224] Handling call
0501 13:59:55.997179 (+3875402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:54.612764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:54.613405 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:54.613442 (+    37us) write_op.cc:435] Acquired schema lock
0501 13:59:54.613462 (+    20us) tablet.cc:662] Decoding operations
0501 13:59:54.614027 (+   565us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:54.614087 (+    60us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:54.614126 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0501 13:59:54.614412 (+   286us) tablet.cc:701] Row locks acquired
0501 13:59:54.614428 (+    16us) write_op.cc:260] PREPARE: finished
0501 13:59:54.614609 (+   181us) write_op.cc:270] Start()
0501 13:59:54.614742 (+   133us) write_op.cc:276] Timestamp: P: 1777643994614547 usec, L: 0
0501 13:59:54.614761 (+    19us) op_driver.cc:348] REPLICATION: starting
0501 13:59:54.615640 (+   879us) log.cc:844] Serialized 1170 byte log entry
0501 13:59:55.838464 (+1222824us) op_driver.cc:464] REPLICATION: finished
0501 13:59:55.866847 (+ 28383us) write_op.cc:301] APPLY: starting
0501 13:59:55.866934 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:55.867081 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:55.867197 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:55.867645 (+   448us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:55.867927 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0501 13:59:55.867974 (+    47us) write_op.cc:312] APPLY: finished
0501 13:59:55.868162 (+   188us) log.cc:844] Serialized 29 byte log entry
0501 13:59:55.894492 (+ 26330us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:55.912405 (+ 17913us) write_op.cc:454] Released schema lock
0501 13:59:55.918900 (+  6495us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:55.995917 (+ 77017us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:55.998008 (+  2091us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":393529,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":28137,"apply.run_cpu_time_us":2449,"apply.run_wall_time_us":97477,"num_ops":2,"prepare.queue_time_us":708081,"prepare.run_cpu_time_us":3225,"prepare.run_wall_time_us":17601,"replication_time_us":1223550,"thread_start_us":25644,"threads_started":1}]]}
W20260501 13:59:56.111867  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 197800us
I20260501 13:59:56.107630  7670 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:56.109272  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:56.115269  7673 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:56.117560  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:56.169093  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 59908.5us
W20260501 13:59:56.169358  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 51894.6us
I20260501 13:59:56.170648  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:56.174232  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:55.977828 11012 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260501 13:59:55.994117 11058 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260501 13:59:55.962941 10991 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:55.975423 11026 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:56.180635  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:56.025789 11060 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:56.109396 10937 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:55.965431 10951 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:56.109572 10416 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:56.011803 10899 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.194003  7670 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:56.116597 10961 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:56.110090 10864 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:56.182729 10998 consensus_meta.cc:287] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.002s
I20260501 13:59:56.171800 10894 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:56.172696 10815 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:56.177802  7752 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:59:56.108852 10812 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:56.229007  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:56.271430  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:56.321430  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.111601 10822 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:56.271714  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:56.219579  7670 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:56.188571 10851 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:56.305394  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.307457  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.091511  7574 rpcz_store.cc:276] 0501 13:59:51.567182 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:51.567300 (+   118us) service_pool.cc:224] Handling call
0501 13:59:51.709099 (+141799us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:55.918262 (+4209163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:54.315457 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:54.316190 (+   733us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:54.316241 (+    51us) write_op.cc:435] Acquired schema lock
0501 13:59:54.316260 (+    19us) tablet.cc:662] Decoding operations
0501 13:59:54.316638 (+   378us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:54.316707 (+    69us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:54.316739 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0501 13:59:54.316941 (+   202us) tablet.cc:701] Row locks acquired
0501 13:59:54.316955 (+    14us) write_op.cc:260] PREPARE: finished
0501 13:59:54.317120 (+   165us) write_op.cc:270] Start()
0501 13:59:54.317252 (+   132us) write_op.cc:276] Timestamp: P: 1777643994317064 usec, L: 0
0501 13:59:54.317274 (+    22us) op_driver.cc:348] REPLICATION: starting
0501 13:59:54.318056 (+   782us) log.cc:844] Serialized 533 byte log entry
0501 13:59:55.570224 (+1252168us) op_driver.cc:464] REPLICATION: finished
0501 13:59:55.863308 (+293084us) write_op.cc:301] APPLY: starting
0501 13:59:55.863415 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:55.863534 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:55.863670 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:55.864099 (+   429us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:55.864506 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 13:59:55.864579 (+    73us) write_op.cc:312] APPLY: finished
0501 13:59:55.864806 (+   227us) log.cc:844] Serialized 23 byte log entry
0501 13:59:55.864993 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:55.865118 (+   125us) write_op.cc:454] Released schema lock
0501 13:59:55.865165 (+    47us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:55.866430 (+  1265us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:55.866474 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47437,"reported_tablets":4,"spinlock_wait_cycles":188043648,"child_traces":[["op",{"apply.queue_time_us":282339,"apply.run_cpu_time_us":2010,"apply.run_wall_time_us":3108,"num_ops":1,"prepare.queue_time_us":474519,"prepare.run_cpu_time_us":111156,"prepare.run_wall_time_us":279310,"raft.queue_time_us":694119,"raft.run_cpu_time_us":57851,"raft.run_wall_time_us":332807,"replication_time_us":1229404,"thread_start_us":873484,"threads_started":4,"wal-append.queue_time_us":421924}]]}
I20260501 13:59:56.178478 10630 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:56.178264 10905 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:56.338632 10905 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:56.189960 11021 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 13:59:56.236994  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 347348us
W20260501 13:59:56.343624  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 145794us
I20260501 13:59:55.998404 11031 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:55.977252 10900 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.209008 11060 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.196388 11026 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:56.212028 10937 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.359508  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.361112  7670 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:56.337330  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.328168 10864 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.334569 10632 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.340201  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:56.191639 11019 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.144s
I20260501 13:59:56.343869 11021 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:56.354436  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.373405  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:56.339138 10905 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:56.357352  7750 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:56.300107 10951 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.335340 10851 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:56.329560 10961 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.247498 10416 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.209167 10991 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.376705  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:56.385788 11053 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:56.390619 11053 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:56.390995 11053 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:56.391358 11053 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:56.393118 11063 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260501 13:59:56.394132 11064 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260501 13:59:56.379709  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.380301  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.375846  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:56.359504 10945 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.325645  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 188) took 3861 ms. Trace:
I20260501 13:59:56.401901  7576 rpcz_store.cc:276] 0501 13:59:52.464081 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:52.464256 (+   175us) service_pool.cc:224] Handling call
0501 13:59:56.325565 (+3861309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24519,"reported_tablets":3,"spinlock_wait_cycles":28928}
I20260501 13:59:56.331195 10931 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.330260 10894 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:56.383453  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.330070 10815 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.375084 10823 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.363986 11026 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:56.403524  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:56.423326  8374 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:56.404588  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.377915 11021 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:56.375280 11068 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:56.384207 10851 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:56.407161  7677 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:56.408658  7678 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260501 13:59:56.408377  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:56.419798  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:56.424610  7670 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 13:59:56.426851  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:56.436251  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.428709  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.378657 10932 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260501 13:59:56.436636  8344 leader_election.cc:400] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9.
I20260501 13:59:56.440637  8344 leader_election.cc:403] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 13:59:56.446329 10951 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.448686  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.452420 10812 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.416584 10969 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.375605 10930 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.458429 10887 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.448892 10416 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.464073  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:56.465026  7674 raft_consensus.cc:2376] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6. Re-sending same reply.
I20260501 13:59:56.427500  7679 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:59:56.406322 11069 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:56.473676  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.474409  7678 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 13:59:56.608299  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 214175us
I20260501 13:59:56.611567  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:56.612561  7670 raft_consensus.cc:2376] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8. Re-sending same reply.
W20260501 13:59:56.636961  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:56.639122 11074 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:56.639974 11074 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.646420 11060 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.648967 10991 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.649930 11031 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.652232 10822 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.577517 10923 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:56.681187 10923 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:56.682044 11065 log.cc:927] Time spent T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260501 13:59:56.678409 11043 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260501 13:59:56.680608 10937 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:56.683665 10923 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.705591  8374 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:56.731783 10945 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9.
I20260501 13:59:56.733400  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2721) took 1135 ms. Trace:
I20260501 13:59:56.733819  7754 rpcz_store.cc:276] 0501 13:59:55.597826 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:56.696051 (+1098225us) service_pool.cc:224] Handling call
0501 13:59:56.696530 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:56.732750 (+ 36220us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:56.732782 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:56.732828 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:56.732869 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:56.733154 (+   285us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:56.733331 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35771}
I20260501 13:59:56.735692  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.736749  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:56.737529  7819 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 13:59:56.737879  7819 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:56.740713  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:56.744434  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.745350  7751 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:56.745782  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.746448  7676 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:56.747149  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.747304  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:56.747654  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.747959  7678 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7. Re-sending same reply.
I20260501 13:59:56.748973  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.749739  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.750577  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:56.750690  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 205047us
I20260501 13:59:56.751223  7821 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:56.752549  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.755940  7745 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 13:59:56.757313  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.758806  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.760576 10823 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:56.761114 10823 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.763773 10823 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.775261  7674 raft_consensus.cc:2368] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:56.789405  7671 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:56.739174  7819 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.695596 10851 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.796260  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:56.802186  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.802539  7825 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:56.803081  7671 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:56.733018 10550 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:56.813740  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.840555  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.790483 10902 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:56.808161 10864 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.796408 11029 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:56.883687  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.852365 10902 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.887835  7674 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:56.823876 10550 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.877686 10951 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:56.886060 10815 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:56.914397  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:56.930269  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:56.934935 10905 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.001s
I20260501 13:59:56.936339 10851 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.912770 10951 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.937825 11068 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:56.935534 11026 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.895013 11029 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.958521  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.959303  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:56.957252 10864 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:56.961536 10864 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:56.964774 10550 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.947252 10961 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.965102 10953 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.948781 10905 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:56.966607  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:56.967375  8374 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:56.967638 10905 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:56.968484 10864 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:56.968688  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:56.971269  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:56.959470  7678 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
W20260501 13:59:56.948240  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 185450us
I20260501 13:59:56.979528  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.981544  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:56.970932 11021 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.002s
I20260501 13:59:56.982993  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.985193  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.985713  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:56.987243  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:56.988642  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.001212  7747 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:57.002566  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:57.003217  8376 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:57.005894  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.019182  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.019981  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.020787  7745 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:57.020771  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.020030  8377 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
W20260501 13:59:57.025691  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:57.026480  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:57.026595  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.033762  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.034775  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.036605  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.037344  7824 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:57.038084  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.039248  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.040757  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.043358  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.039348  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:56.983026 11021 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.044103  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.045325  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.069336  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.045611  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.043769  8376 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 13:59:57.045699  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.071859  7827 raft_consensus.cc:2368] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:57.047125  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42706 (request call id 6) took 19451 ms. Trace:
I20260501 13:59:57.073136  7752 rpcz_store.cc:276] 0501 13:59:37.596105 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:37.599117 (+  3012us) service_pool.cc:224] Handling call
0501 13:59:37.682405 (+ 83288us) log.cc:844] Serialized 499 byte log entry
0501 13:59:37.940484 (+258079us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b54003f28a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa65a522 00007fb2fa63b28a 00007fb2fa642133 00007fb2fa6420b9 00007fb2fa642049 00007fb2fa642011 00007fb2fa6411dd 0000000000379254 0000000000379099 00007fb2f7643ab5
0501 13:59:37.954759 (+ 14275us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54003f28a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa65719e 00007fb2fa661d10 00007fb2fa661cb8 00007fb2fa661c38 00007fb2fa661bf3 00007fb2fa660e7c 00007fb300539d16 00007fb3005344c8 00007fb2fa69dbab 00007fb2fa6a06a0
0501 13:59:57.046968 (+19092209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13,"raft.queue_time_us":1386,"raft.run_cpu_time_us":4239,"raft.run_wall_time_us":6425,"spinlock_wait_cycles":53644032,"thread_start_us":116773,"threads_started":2,"wal-append.queue_time_us":115617,"wal-append.run_cpu_time_us":5915,"wal-append.run_wall_time_us":1027141}
I20260501 13:59:57.048382 10902 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.049170 10951 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.049295 11021 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.050372  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.050709  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.081936  7754 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:57.051788  7748 raft_consensus.cc:2368] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:57.052130  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.084570  8381 raft_consensus.cc:2410] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260501 13:59:57.053754  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.087112  7825 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260501 13:59:57.063565  7750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2728) took 1463 ms (client timeout 1656 ms). Trace:
I20260501 13:59:57.091802  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.092284  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.065951  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.093240  7824 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 13:59:57.045325  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.045895  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.046137  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.096168  7821 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 13:59:57.097608  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.101747  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.105687  7826 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:57.054049  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 692) took 1570 ms. Trace:
W20260501 13:59:57.092417  7750 rpcz_store.cc:269] 0501 13:59:55.599695 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:55.615366 (+ 15671us) service_pool.cc:224] Handling call
0501 13:59:57.063360 (+1447994us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54000636d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:57.063502 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679954688}
I20260501 13:59:57.106415  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:57.107759  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 13:59:57.046046 11094 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260501 13:59:57.112581  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.110146  7827 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 13:59:57.110975  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2726) took 1511 ms. Trace:
I20260501 13:59:57.106151  7753 rpcz_store.cc:276] 0501 13:59:55.483510 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:55.483772 (+   262us) service_pool.cc:224] Handling call
0501 13:59:55.842707 (+358935us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b5800062798. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 13:59:55.843003 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:56.175530 (+332527us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:56.175580 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:56.175647 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0501 13:59:56.175694 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:57.053736 (+878042us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54003ad4d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:57.053815 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:57.053943 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774929536}
I20260501 13:59:57.111652  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.113224  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:57.118427  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.119223  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:57.117918  7752 rpcz_store.cc:276] 0501 13:59:55.599130 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:56.161149 (+562019us) service_pool.cc:224] Handling call
0501 13:59:56.161689 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:56.162007 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 13:59:56.788327 (+626320us) log.cc:844] Serialized 14 byte log entry
0501 13:59:57.075512 (+287185us) log.cc:844] Serialized 14 byte log entry
0501 13:59:57.110645 (+ 35133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:57.110699 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0501 13:59:57.110743 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:57.110816 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:57.110919 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98001,"prepare.queue_time_us":1117,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":101743,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":195094,"threads_started":1}
I20260501 13:59:57.120966  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.122821  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.127780  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.133737  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.132520  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.135555  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.112946 10969 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.138187 10969 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.138620 10969 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.062842  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.142066  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.142148 11071 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.143649  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.143967 11071 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:57.144482 10998 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.142428  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.144930 10998 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.145372 10998 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.145838  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.148255  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.149367  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.150218 11071 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:57.150933 10946 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:57.150791 11071 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:57.153024 11071 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.153697  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.150244 10582 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:57.156515 10582 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.156183 10998 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.157039 10582 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.158454 10998 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.147413  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.162345  7820 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:57.112058 10899 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:57.169246 10899 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:57.169785 10899 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:57.172883 11053 consensus_meta.cc:287] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.000s
I20260501 13:59:57.173534 11053 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.174935  7751 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:57.203869 10965 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:57.204548 10965 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:57.205724 10969 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.206779  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2725) took 1607 ms. Trace:
I20260501 13:59:57.214706  7749 rpcz_store.cc:276] 0501 13:59:55.598885 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:57.205719 (+1606834us) service_pool.cc:224] Handling call
0501 13:59:57.206115 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:57.206348 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 13:59:57.206387 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 13:59:57.206447 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0501 13:59:57.206491 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:57.206565 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 13:59:57.206702 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 13:59:57.211891 11071 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.213429 10991 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:57.216274 11028 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260501 13:59:57.217617  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 429260us
W20260501 13:59:57.219112 11081 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.264s	user 0.003s	sys 0.000s
I20260501 13:59:57.217613 10991 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.219730 10991 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.220409 10991 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.045140 11029 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.225399  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.236181  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.213618 10582 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.230404 11089 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260501 13:59:57.229809 11069 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:57.233762 10910 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:57.258373  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.259335  7749 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:57.262382  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:57.263732  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.263427  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.265059  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.268498  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.263630  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.269335  7752 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.269972  7749 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:57.263044  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.284466  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:57.291813  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 172632us
I20260501 13:59:57.293792  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 13:59:57.302578  7745 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 13:59:57.246207 11053 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.304610  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.304602  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.265035 10910 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.314805  7752 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:57.316970  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.266811 11096 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.283912 10953 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.292577 11033 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.322566  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.328343  7748 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:57.264413 11069 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.331808 11069 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:57.319528 10550 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 13:59:57.338100  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.270609 11074 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.326303  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:57.320559 10910 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.319316 10900 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.351969 10969 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.356210 10851 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260501 13:59:57.357414  7625 auto_rebalancer.cc:285] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260501 13:59:57.324836 11096 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.321983 11026 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.323012 10951 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.359720  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.368693  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:57.365768  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 218886us
I20260501 13:59:57.369450  7819 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:57.327245 11033 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 13:59:57.365851 11021 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 13:59:57.378912  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.380631  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.382179  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:57.387104  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.365959 10851 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.383637 10887 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:57.389393 10851 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 13:59:57.389714 10887 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.390122 10887 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
W20260501 13:59:57.390450 10795 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.422s	user 0.015s	sys 0.000s
I20260501 13:59:57.390887 10795 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.392104  7746 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:57.392984 10795 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.393671 11101 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:57.394089 11101 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.394434 11101 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.385385 11033 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.395920 10896 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:57.396409 10896 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.396764 10896 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.371917 10951 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.397897 10951 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.406821  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.407249  7819 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 13:59:57.408037  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1742) took 1088 ms. Trace:
I20260501 13:59:57.408170  7792 leader_election.cc:400] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6.
I20260501 13:59:57.342972 10932 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260501 13:59:57.412427  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.410102  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 13:59:57.403575 11093 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260501 13:59:57.410475 10900 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:57.412856 11021 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:57.413326 11017 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:57.370023 11096 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:57.415810 10630 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260501 13:59:57.415900 11026 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 13:59:57.418470 11029 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:57.408519  7819 rpcz_store.cc:276] 0501 13:59:56.319625 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:56.320002 (+   377us) service_pool.cc:224] Handling call
0501 13:59:56.736536 (+416534us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 13:59:57.350823 (+614287us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5800481dd0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa63d48a 00007fb2fa6bf827 00007fb2fa6d83c7 00007fb2fa6d9bbe 00007fb2fa6e565c 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c
0501 13:59:57.407976 (+ 57153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995064960}
I20260501 13:59:57.384198 11090 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:57.435093 10969 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:57.427188 11102 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:57.435689 10969 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.436443 11102 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.436900 11102 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.437961 10969 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:57.423641 10894 consensus_meta.cc:287] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.988s	user 0.015s	sys 0.000s
I20260501 13:59:57.438930 10894 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.439427 11029 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.426183 11071 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.431686 10582 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.427711 11100 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260501 13:59:57.444661  8371 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:57.439344 11021 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.446554 11029 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:57.454032 11103 log.cc:927] Time spent T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260501 13:59:57.454916 10851 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.456343  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.457003  7819 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.460181  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.460856  8371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1018) took 1051 ms. Trace:
I20260501 13:59:57.461238  8371 rpcz_store.cc:276] 0501 13:59:56.409569 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:56.409715 (+   146us) service_pool.cc:224] Handling call
0501 13:59:56.410012 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 13:59:57.445044 (+1035032us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 13:59:57.460641 (+ 15597us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400680e54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 13:59:57.460801 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379049728}
W20260501 13:59:57.462073 11099 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260501 13:59:57.462809 11090 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:57.463382 11090 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.465606 11090 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.467864  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:57.467588 10965 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.474700  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:57.475494  8374 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 13:59:57.477334  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:57.478217  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:57.478956  8380 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:57.479476  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2709) took 1918 ms. Trace:
I20260501 13:59:57.479875  7746 rpcz_store.cc:276] 0501 13:59:55.561437 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:55.865060 (+303623us) service_pool.cc:224] Handling call
0501 13:59:57.479290 (+1614230us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000af854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 13:59:57.479416 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3509439744}
I20260501 13:59:57.481585  7819 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260501 13:59:57.485466  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.490741  7820 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 13:59:57.495754  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:57.495038  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 199771us
I20260501 13:59:57.472815 10900 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.421430 10887 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.499678  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:57.502295  7746 raft_consensus.cc:606] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.502832  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.501185  7820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50946
I20260501 13:59:57.503805  7820 raft_consensus.cc:606] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Received request to transfer leadership
I20260501 13:59:57.493168 11091 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:57.518769 11091 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:57.519276 11091 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.520215 10896 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.521390  7827 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:57.521868  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.506635 10932 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260501 13:59:57.523468 10850 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:57.523840 10850 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.524174  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.524631 10850 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.525342 10896 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.526002 10850 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:57.509449  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.526551 10999 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 13:59:57.498939 11086 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260501 13:59:57.530817 10851 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.530404  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.509281 10900 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.533658 11017 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:57.534137 10899 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.536607 10899 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:57.557019  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 52272.3us
I20260501 13:59:57.513881  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.515688  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:57.516424  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.516772 10894 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.493973 10632 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.517238 10953 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:57.505571 10961 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:57.499032 10630 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260501 13:59:57.537004 10951 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.542277 10991 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.576098 10961 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.576807 10951 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.577102 10991 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.544407 10910 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:57.577587  7821 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:57.577104 10961 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.579118 10910 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.579841  7747 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:57.581601 10999 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:57.545773 11101 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.583256 11017 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:57.583679 11017 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:57.584380 11101 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.507869 10965 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.583931 11102 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.584548 11017 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.586961 11020 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 13:59:57.587349 11020 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:57.547473  8380 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260501 13:59:57.548046  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:57.588753  7823 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.548938  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.549899  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.590391 11020 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.550196  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.510321 10887 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.592664 11102 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.593205 11020 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 13:59:57.550486  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.551656  8372 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:57.552449  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.595208  8375 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:57.553854  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.596335  7748 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:57.555150  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.597496  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.599355 11069 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.560770  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:57.601552  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:57.602890 10630 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:57.603538 10630 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:57.605751  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.610431  8372 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:57.612681  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.564915  8371 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
W20260501 13:59:57.600371  7625 auto_rebalancer.cc:806] Removing replace marker failed: Leader has not yet committed an operation in its own term
I20260501 13:59:57.605486 11096 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:57.613718  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 47951612b03c496aa487574a115ca380, TS 109c9ba263c34ff8aee17bc446cf258e -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.607312  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.618983  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.569747  7643 leader_election.cc:400] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:57.621685  7643 leader_election.cc:403] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260501 13:59:57.622205  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 52872.3us
W20260501 13:59:57.623998  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:57.624707  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:57.617614  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 47951612b03c496aa487574a115ca380, TS 109c9ba263c34ff8aee17bc446cf258e -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.632239  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.632675  7752 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:57.636802  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:57.635290  7826 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 13:59:57.638764  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.638985  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.639468  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.641072 10991 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:57.642110 11017 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.642002 11100 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:57.644184 11106 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 13:59:57.629458 10823 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260501 13:59:57.645483 11106 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:57.645990 11106 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:57.646313 10823 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:57.629653 11101 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.648867  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:57.649240  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.572672 10899 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260501 13:59:57.647523 10823 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:57.653647  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.655936 10822 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 13:59:57.657510  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:57.658147  7752 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.659375  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.651350  7576 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 4, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added, no longer has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 13:59:57.656535 10822 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:57.656543 10823 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:57.661515  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.665266  7576 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:57.685222  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.657907 11087 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:57.660254 10887 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260501 13:59:57.689941 11087 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:57.686267  7576 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:57.678854 10896 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260501 13:59:57.626498 10910 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260501 13:59:57.691339 11087 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.692049  7576 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:57.693435 11105 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:57.693621 11087 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.692039 11069 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 13:59:57.693821  7576 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:57.568713 11033 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.686165  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50946
I20260501 13:59:57.696461  7576 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 7, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:57.690821 11090 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:57.656924 10991 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.711740  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:57.712232  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:57.713480  7792 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:57.714486  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:57.647094 11106 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.691777 10896 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:57.662271 11107 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:57.670775 10899 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:57.675165 11096 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:57.727524  7746 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 13:59:57.708187 11090 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.733351  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:57.710783 11105 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:57.737509  7821 raft_consensus.cc:606] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.716166 10851 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:57.718242 10969 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:57.738859  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:57.677170 11091 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.717912 10896 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.731379 10953 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:57.728865 10850 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.731913 10961 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 13:59:57.756606 10851 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.728592 10630 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260501 13:59:57.798883 10851 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:57.801030 11033 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.802932  8381 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260501 13:59:57.804059 11090 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.805689 11090 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.668283 10823 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.731748 10899 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:57.663523 10822 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.757126 10905 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260501 13:59:57.786348 10969 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:57.756929 10932 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 13:59:57.810663  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:57.826357  7751 raft_consensus.cc:2410] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260501 13:59:57.811113  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:57.826920  7747 raft_consensus.cc:606] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:57.814358  7823 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 13:59:57.814267  8371 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:57.815347  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:57.829470  8372 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.831213 10823 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.828029 10902 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260501 13:59:57.827052 10932 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:57.835790 10932 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.836938 10905 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:57.837359 10905 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.838256 10905 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.839543 10905 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.840010 10896 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.840402 10969 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.865190  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:57.824882 10899 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:57.868336  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:57.823896 11107 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:57.872167  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 46911.4us
I20260501 13:59:57.872881  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 13:59:57.876276  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 158688us
I20260501 13:59:57.879184  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.885609  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:57.888773 11074 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 13:59:57.889365 11074 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:57.890317 11074 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:57.893263 10896 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.896267 11107 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:57.897647  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:57.897125 10932 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:57.898743 11107 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:57.869738 11112 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.130s	user 0.001s	sys 0.003s
I20260501 13:59:57.865089 10999 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260501 13:59:57.900909 10932 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:57.901381 10999 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 13:59:57.903880  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:57.904855  7746 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.910169  7751 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260501 13:59:57.922773  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 66739.8us
I20260501 13:59:57.925398  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:57.926112  8373 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:57.883010 11096 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:57.907666  8372 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:57.855082 11086 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260501 13:59:57.901808 10999 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:57.943481 11116 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260501 13:59:57.955632  8373 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:57.884078  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:57.960184  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:57.960806  7746 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:57.962321  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:57.925160 10930 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260501 13:59:57.988140  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 104155us
I20260501 13:59:57.989106  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:57.992877 11021 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 13:59:58.015290  7751 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 13:59:57.999699 11101 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
W20260501 13:59:58.028080  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47412.3us
I20260501 13:59:58.001384 11105 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:58.028360 10900 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260501 13:59:57.993525 10999 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.040534 10999 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:58.043372  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:58.044976  7751 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:57.999507 11117 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:58.049530 10582 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:58.050043 10582 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:58.050894 10582 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.052388  7821 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 13:59:58.052753  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.058008 10582 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:58.059717 11106 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 13:59:58.061172  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.063647  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.066129 10965 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:58.066622 10965 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:58.067457 10965 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:58.068954 10965 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:58.069434  7821 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 13:59:58.075591  7748 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:58.076637 11028 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 13:59:58.075798  7751 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:58.080173  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 13:59:58.087486  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.091125  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:58.073155 11091 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 13:59:58.098966  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 109954us
I20260501 13:59:58.100833  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.102146  7643 leader_election.cc:400] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 13:59:58.102972  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.104002  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:58.080870 11021 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:58.105204  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.105401  8381 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 13:59:58.106117  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:58.104449 11101 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:58.107061 11100 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:58.107474 11100 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:58.107614 11117 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:58.107930 11100 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:58.106231  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:58.110565 11074 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:58.111016 11117 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:58.111104 11074 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:58.111618 11117 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:58.112089 11117 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:58.109622  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.112272 11074 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.113034 10931 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 13:59:58.113929 11105 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:58.114637 11105 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:58.118592  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.119861 11105 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 13:59:58.123330  8375 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 13:59:58.121871  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:58.128376  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.133491  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.103314 10930 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:58.135015  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:58.098143 10896 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:58.140650  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:58.104681 10991 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:58.131057 11105 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
W20260501 13:59:58.152871  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.138877 10969 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:58.153259  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:58.158649  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.138314 11101 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:58.164291  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.129766 10910 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260501 13:59:58.145252 10930 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:58.182248 10969 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:58.183164 10969 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 13:59:58.144147 11096 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:58.179010 10930 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.185901  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:58.195899  7822 raft_consensus.cc:606] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Received request to transfer leadership
I20260501 13:59:58.196419  7822 raft_consensus.cc:614] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:58.198383  8373 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260501 13:59:58.198832  8373 pending_rounds.cc:85] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 6
I20260501 13:59:58.199043  8373 pending_rounds.cc:107] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260501 13:59:58.199275  8373 raft_consensus.cc:2889] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:58.164157 10991 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:58.200205 10991 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:58.200632 10991 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:58.155848 11107 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 13:59:58.205478  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.209084  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.152225 10896 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:58.214897 11127 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:58.215471 11074 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:58.185155 10899 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.221460  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:58.223209  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.187990 11096 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:58.230157  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.213930 11101 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 13:59:58.232299  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:58.233363  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:58.234112 11135 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:58.227052 11127 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:58.230154 11096 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:58.228013 11107 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:58.239576 10969 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:58.163033 11021 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:58.255043  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica ca8dd10afb304b4c96cfcec7e2309947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:58.255587  7625 auto_rebalancer.cc:814] Could not move replica: Illegal state: not currently leader
W20260501 13:59:58.256034  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Illegal state: not currently leader
I20260501 13:59:58.255472 10896 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:58.246233 11135 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:58.265440 11117 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.287783 11117 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:58.296882 11130 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260501 13:59:58.302274  7822 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.295159 11105 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 13:59:58.353583  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44407.4us
W20260501 13:59:58.352880 11136 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260501 13:59:58.368280  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 60925.9us
I20260501 13:59:58.379164  7747 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 13:59:58.299217 11100 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.411926 10931 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260501 13:59:58.416136  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.428682  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 195348us
I20260501 13:59:58.430687  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.431144  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.431977  7674 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:58.440119  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.441368  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:58.442504  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.442914  7673 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:58.443666  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.444233  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.444672  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.444921  7670 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 13:59:58.445444  7678 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:58.445516  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.446031  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.446175  7672 raft_consensus.cc:2376] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6. Re-sending same reply.
I20260501 13:59:58.446662  7670 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:58.440860  7674 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:58.447068  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.447525  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.447898  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.448271  7670 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:58.448755  7674 raft_consensus.cc:2376] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8. Re-sending same reply.
I20260501 13:59:58.449335  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.450179  7672 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:58.444864  7677 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:58.452015  7748 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260501 13:59:58.454953  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.456009  7670 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 13:59:58.419623 10899 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:58.458756  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.467861  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.472550  7821 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260501 13:59:58.472517 10900 raft_consensus.cc:2955] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:58.472571 11068 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260501 13:59:58.500638 11100 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:58.502332 11102 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 13:59:58.504050 10991 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:58.508404 10991 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:58.508981 11096 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:58.511533 11096 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:58.544842  7679 raft_consensus.cc:2410] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:58.549320  7676 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 13:59:58.560640  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.566226  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.570710  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.563524  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.574745  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.578814  7746 raft_consensus.cc:2955] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:58.608826  7679 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 13:59:58.608989  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.618495  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.621418  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.622371  7670 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:58.627182  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 43e99f3322c2477888132a818eae4971, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:58.627847  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 43e99f3322c2477888132a818eae4971, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.631709  7747 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:58.647586  7747 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 13:59:58.649143 11091 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260501 13:59:58.652962  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:58.655707  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.659309 11091 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:58.643112  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 273) took 1127 ms. Trace:
I20260501 13:59:58.664937  7671 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:58.650972  7573 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:58.670471  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 13:59:58.670944  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:58.671270  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 6866ee2ef62c4f999f3e6c7b7a6d7aa9, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.678850  7675 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:58.702122  7675 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:58.703243  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.704103  7679 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:58.705149  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.665380  7576 rpcz_store.cc:276] 0501 13:59:57.515015 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:57.515186 (+   171us) service_pool.cc:224] Handling call
0501 13:59:58.642780 (+1127594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 13:59:58.028980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 13:59:58.065033 (+ 36053us) write_op.cc:432] Acquiring schema lock in shared mode
0501 13:59:58.065094 (+    61us) write_op.cc:435] Acquired schema lock
0501 13:59:58.065110 (+    16us) tablet.cc:662] Decoding operations
0501 13:59:58.066153 (+  1043us) write_op.cc:620] Acquiring the partition lock for write op
0501 13:59:58.066221 (+    68us) write_op.cc:641] Partition lock acquired for write op
0501 13:59:58.066257 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0501 13:59:58.066832 (+   575us) tablet.cc:701] Row locks acquired
0501 13:59:58.066852 (+    20us) write_op.cc:260] PREPARE: finished
0501 13:59:58.067018 (+   166us) write_op.cc:270] Start()
0501 13:59:58.067132 (+   114us) write_op.cc:276] Timestamp: P: 1777643998066963 usec, L: 0
0501 13:59:58.067154 (+    22us) op_driver.cc:348] REPLICATION: starting
0501 13:59:58.080610 (+ 13456us) log.cc:844] Serialized 2506 byte log entry
0501 13:59:58.185414 (+104804us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b18000a3720. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 13:59:58.358762 (+173348us) op_driver.cc:464] REPLICATION: finished
0501 13:59:58.485371 (+126609us) write_op.cc:301] APPLY: starting
0501 13:59:58.485483 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0501 13:59:58.485677 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0501 13:59:58.485705 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 13:59:58.486525 (+   820us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 13:59:58.486783 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0501 13:59:58.486833 (+    50us) write_op.cc:312] APPLY: finished
0501 13:59:58.487104 (+   271us) log.cc:844] Serialized 53 byte log entry
0501 13:59:58.487303 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:58.487435 (+   132us) write_op.cc:454] Released schema lock
0501 13:59:58.487493 (+    58us) write_op.cc:341] FINISH: Updating metrics
0501 13:59:58.491097 (+  3604us) write_op.cc:489] Releasing partition, row and schema locks
0501 13:59:58.492308 (+  1211us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":126336,"apply.run_cpu_time_us":2488,"apply.run_wall_time_us":2488,"num_ops":6,"prepare.queue_time_us":177063,"prepare.run_cpu_time_us":20421,"prepare.run_wall_time_us":142306,"raft.queue_time_us":122887,"raft.run_cpu_time_us":8762,"raft.run_wall_time_us":81702,"replication_time_us":291410,"spinlock_wait_cycles":9681536,"thread_start_us":324517,"threads_started":4,"wal-append.queue_time_us":79159}]]}
I20260501 13:59:58.717541  7745 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:58.670317  7573 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 8, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:58.719305 11091 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:58.721652  7670 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 13:59:58.721729  7679 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:58.734946  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.735127  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.736053  7678 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:58.735323  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.737042  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.737337  7671 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 13:59:58.738025  7675 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 3.
I20260501 13:59:58.738886  7676 raft_consensus.cc:2410] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 13:59:58.739554  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.739648  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.740756  7670 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:58.754189  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.768530  7751 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 13:59:58.760664  7573 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 11, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:58.772670  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.773653  7676 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:58.775373  7676 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:58.776525 11091 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 13:59:58.777448  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.779171  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.772161  7573 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:58.785980  7675 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 13:59:58.791146  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.794339  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:58.796638  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.800740  7573 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 8, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:58.806850  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.807809  7671 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:58.807746  7573 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:58.810695  7573 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:58.813594  7573 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:58.816344  7573 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:58.818186  7573 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:58.821992  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.822817  7671 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 13:59:58.826936  7671 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 13:59:58.832108  7671 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260501 13:59:58.841223  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.842211  7671 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
W20260501 13:59:58.845909  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51739.1us
I20260501 13:59:58.847045  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.851354  7671 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 13:59:58.868781  7670 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:58.870785  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.871609  7670 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 13:59:58.873988  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.874949  7670 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:58.878237  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.881181  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.895354  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.900205  7679 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:58.910316  7670 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:58.912998  7677 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:58.921043  8375 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 13:59:58.925197  8373 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:58.931216  7675 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:58.933099  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.936481  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.937086  7670 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
W20260501 13:59:58.949333  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:58.951436  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:58.951973  7678 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:58.952371  7678 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:58.952553  7672 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 13:59:58.953436  7677 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 13:59:58.953400  7678 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:58.954682  7678 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:58.956771  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 13:59:58.957613  7718 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.887s (SENT)
I20260501 13:59:58.958184  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:58.958441  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:58.959141  7675 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:58.959272 11020 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 13:59:58.960194 10903 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:58.966110  7678 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260501 13:59:58.966604  7678 pending_rounds.cc:85] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 13:59:58.967355 10900 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260501 13:59:58.968161  7677 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:58.968612  7677 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:58.966914  7678 pending_rounds.cc:107] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260501 13:59:58.970849  7670 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 13:59:58.971181  7678 raft_consensus.cc:2889] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 13:59:58.980405  7673 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 13:59:58.980288  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 13:59:58.982861  7792 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.706s (SENT)
I20260501 13:59:58.985373  7679 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:58.987299  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:58.993613  7745 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [6.3-8.4]
W20260501 13:59:58.998692  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.000327  7672 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 13:59:59.007762  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.002020 10900 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 13:59:59.011185  7745 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:59.003005  7677 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.020262  7677 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:59.019477  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.022154  7674 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260501 13:59:59.024307  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:59.024722  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.022154 10903 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:59.035940  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 63379us
I20260501 13:59:59.037647  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:59.040057 10632 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:59.040870 10632 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.026489 10903 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.043970 10903 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 13:59:59.045176  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.051573 10900 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.054077 10900 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:59.059109  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.064347  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:59.064818  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:59.065234  7822 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 13:59:59.073084  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.081560  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.082590  7746 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:59.087641  7679 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 13:59:59.088578 10900 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:59.080685  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.089571 11020 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:59.090026 11020 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:59.090372 11020 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.093645 10632 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.106012  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.109105  7748 raft_consensus.cc:1217] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-8.6]   Dedup: 8.6->[]
I20260501 13:59:59.109468 10900 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.109659  7748 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 13:59:59.110018  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:59.114506  7822 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:59.115901  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:59.124608 10900 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.127079 10900 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:59.133810  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.136785  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 189) took 1474 ms. Trace:
I20260501 13:59:59.137398  7574 rpcz_store.cc:276] 0501 13:59:57.662620 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 13:59:57.665338 (+  2718us) service_pool.cc:224] Handling call
0501 13:59:59.136555 (+1471217us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":261,"reported_tablets":15}
I20260501 13:59:59.147339  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 13:59:59.147729  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.148340  7748 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:59.149466  7577 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.154317  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.154721  7820 raft_consensus.cc:1217] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Deduplicated request from leader. Original: 7.5->[8.6-8.6]   Dedup: 8.6->[]
I20260501 13:59:59.154788  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.157967  7820 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 13:59:59.155594  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.153860  7677 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260501 13:59:59.159408  7677 pending_rounds.cc:85] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 13:59:59.159726  7677 pending_rounds.cc:107] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260501 13:59:59.155939  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.160180  7677 raft_consensus.cc:2889] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 13:59:59.166985  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 13:59:59.173949  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.103437 11020 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.177682  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.180979  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.181411  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.181703  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.182379  7821 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.177877 11020 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.183136  7748 raft_consensus.cc:1217] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-8.6]   Dedup: 8.6->[]
I20260501 13:59:59.183712  7748 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 13:59:59.184569  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.188365  7823 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: []
I20260501 13:59:59.188558  7748 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 13:59:59.181627  7746 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:59.189750  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.191349  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.193058  7826 raft_consensus.cc:1217] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Deduplicated request from leader. Original: 7.5->[8.6-8.6]   Dedup: 8.6->[]
I20260501 13:59:59.193302  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:59.193682  7826 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 13:59:59.194064  7822 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
W20260501 13:59:59.193362  7718 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.137s (SENT)
I20260501 13:59:59.165592  7577 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 8 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.200747  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:59.201265  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.201447  8381 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:59.203890  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.204759  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.209126 11028 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 13:59:59.210474  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.154s (SENT)
I20260501 13:59:59.211951  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.214294 11028 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:59.218127  8381 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 13:59:59.220762  7821 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 13:59:59.226789  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.197571  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:59.230382  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.232041 10905 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:59.232601 10905 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:59.233009 10905 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:59.196060 11020 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 13:59:59.238888  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.165s (SENT)
I20260501 13:59:59.238044 11091 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 13:59:59.240072 11091 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:59.240477 11091 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:59.248461  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.258441 10896 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.259102 10896 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.261332 10896 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:59.268829  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.273275  7573 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:59.275068 11028 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.275619 11028 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.277778 11028 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.236445 11020 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.283661 11028 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:59.290460 10905 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.292853 10905 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 13:59:59.295748  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 58797.9us
I20260501 13:59:59.299690  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:59.300541  7821 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 13:59:59.300642  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.301326  7748 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.301359  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.296736 11020 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:59.304308  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:59.304894  8381 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:59.306209  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.307016  7821 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 13:59:59.307273  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.310492  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.316957  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 13:59:59.317814  7821 raft_consensus.cc:606] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:59.317183  7573 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:59.318202  7821 raft_consensus.cc:614] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:59.318943  7573 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.320366  7747 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 13:59:59.322841  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.323411  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:59.323071  7573 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:59.324232 11091 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.323001  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 13:59:59.325592  8373 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:59.326751  7573 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 7. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:59.328191 11029 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:59.328804 11029 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.328751  7573 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 9, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 13:59:59.331063 11029 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:59.333910  7746 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 13:59:59.337066  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.338667 10900 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:59.339087 10900 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:59.339476 10900 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.342206  8381 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 13:59:59.350272  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.183s (SENT)
I20260501 13:59:59.350838  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.351694 11020 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.360144  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3031b746c62f413a9da6fed211d638da"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:59.360932  7747 raft_consensus.cc:606] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.326751 11091 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:59.364118  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:59.364815  7748 raft_consensus.cc:606] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.365350  7748 raft_consensus.cc:614] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:59.364715  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.366428  7745 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:59.370414  7718 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.186s (SENT)
I20260501 13:59:59.373008  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.372689  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 13:59:59.381184  8381 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 13:59:59.372699  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
W20260501 13:59:59.375993  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.376922  7576 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 8, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.383224  8373 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.386114  7745 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.383806  7747 raft_consensus.cc:606] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.387354  7747 raft_consensus.cc:614] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:59.390426  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 13:59:59.391083  7745 raft_consensus.cc:606] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.391484  7745 raft_consensus.cc:614] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 13:59:59.383216  7746 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.396838  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 13:59:59.401572  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 13:59:59.405447  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 13:59:59.416975 10900 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.410600  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.418731 11020 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 13:59:59.422624 11096 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:59.423337 11096 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.425439 11020 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:59.425665 11096 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:59.425905 11020 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:59.427760  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.428064  7577 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 8 to 9, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.436388  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.438199  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.439950  7673 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:59.442417 11020 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.444171 11020 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:59.444262 10900 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:59.448155 10887 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:59.448925 10887 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.449430 10887 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 13:59:59.450934  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.451627 10887 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 13:59:59.475044  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:59.476198  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75946us
I20260501 13:59:59.481312  7747 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 13:59:59.500247 10812 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 13:59:59.489950  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.501525  7673 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:59.491583  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.502575  7679 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:59.502789  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.512432  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.520272  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.500778  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.521188  7678 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 13:59:59.520380  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.521858  7674 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:59.494855  7677 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 13:59:59.522876  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.523592  7678 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:59.525287  7678 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 13:59:59.527264  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.529245  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.529906  7677 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 13:59:59.530002  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.530280  7678 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:59.530643  7678 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:59.531021  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.530670  7672 raft_consensus.cc:2376] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8. Re-sending same reply.
I20260501 13:59:59.531606  7678 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 13:59:59.533120  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.532701  7678 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.534225 10900 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 13:59:59.534160 11102 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 13:59:59.537084 10900 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260501 13:59:59.542076  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.542593  7676 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 13:59:59.543385  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.543946  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.544086  7672 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
W20260501 13:59:59.544699  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69871.8us
I20260501 13:59:59.544907 10903 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 13:59:59.548023  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 13:59:59.549189  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.548048  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.539147  7747 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 13:59:59.555972  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.555976 10903 raft_consensus.cc:993] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:59.548375  7679 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 13:59:59.557718 11028 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 13:59:59.559069 11128 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:59.559474 11128 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:59.560312 11128 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.561652  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 13:59:59.569839  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.573967 11028 raft_consensus.cc:1081] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:59.574384  7678 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 13:59:59.590035  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.590225  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.590786  7674 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 13:59:59.580331  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet a769b271cb04497eb1cb86169399ceb2 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 13:59:59.584331 10812 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.578406  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:59.592286 10812 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.576828 11128 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.594420 10812 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.589393  7577 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 4 to 7, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 13:59:59.596146  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.596357 10900 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:59.596798 10900 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:59.597164 10900 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:59.600514  7679 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.604827  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 13:59:59.605152  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.605645  7821 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 13:59:59.605841  7746 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 13:59:59.607430 10903 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 13:59:59.609578  7810 tablet_service.cc:1558] Processing DeleteTablet for tablet a769b271cb04497eb1cb86169399ceb2 with delete_type TABLET_DATA_TOMBSTONED (TS ca8dd10afb304b4c96cfcec7e2309947 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:50946
I20260501 13:59:59.615628 11020 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Stepping down as leader of term 5
I20260501 13:59:59.617367 11020 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 13:59:59.620321  8344 leader_election.cc:336] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.513s (SENT)
I20260501 13:59:59.616657  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.620906  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.621716 10887 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 13:59:59.622815 11173 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 13:59:59.625038 11020 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.622807  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 13:59:59.627884  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.627956  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.646740 10632 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:59.649048 10632 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:59.649749 10632 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.627660 10900 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.650791 11020 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:59.628098  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 13:59:59.647934 10887 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.648026 11096 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 13:59:59.652477 10900 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 13:59:59.653420 11029 raft_consensus.cc:993] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:59.653133 10896 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:59.664733 11091 consensus_queue.cc:1059] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:59.666442 11091 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:59.666967 11091 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:59.654580 10887 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:59.656500  7673 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 13:59:59.627444  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.590811  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 13:59:59.670092  7678 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.647433  7676 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.628494  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 13:59:59.663853  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.671175  7679 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 13:59:59.672241  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47817.5us
I20260501 13:59:59.668535 10887 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:59.678464 10887 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:59.679083 10632 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.685642 10632 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.680492  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.689777 10905 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:59.689707  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.690783 10896 raft_consensus.cc:1081] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 13:59:59.691134 10812 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:59.691757  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.690340 10905 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:59.692045 11102 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 13:59:59.694834  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.692304 11128 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:59.679782 10887 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.703743 10905 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.708426  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.720417 11174 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 13:59:59.721282 10900 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 13:59:59.671954 11091 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.722385 11174 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260501 13:59:59.704943 10896 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260501 13:59:59.724388 11091 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.711402 11128 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:59.729044  7679 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.734408 11128 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.715654 10632 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.732656  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.739940 10896 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 13:59:59.740399 10896 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:59.741297 10896 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.742661 10896 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.744318 11175 raft_consensus.cc:2764] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260501 13:59:59.745455  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53819.3us
I20260501 13:59:59.746394  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.747344 10632 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:59.728782 10905 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.748183 11174 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260501 13:59:59.728483 11096 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Stepping down as leader of term 8
I20260501 13:59:59.760005 10903 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 13:59:59.769167  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.769260 11029 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260501 13:59:59.773912  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 56579.2us
I20260501 13:59:59.773105 10887 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:59.774055 10632 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:59.774340 10900 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.774014 11102 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 13:59:59.778858 10903 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 13:59:59.779640 11102 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 13:59:59.780055 11102 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 13:59:59.780045 10903 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 13:59:59.781248 11102 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.782845 11102 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 13:59:59.786955 11176 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260501 13:59:59.770232  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 75637us
I20260501 13:59:59.777109  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.778003  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.796722 11177 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:59.771319 11096 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 13:59:59.800992 11173 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 13:59:59.820423  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.808540 11176 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260501 13:59:59.821928 11091 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 13:59:59.822103 10887 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 13:59:59.818971  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.807040 10812 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260501 13:59:59.817108 11128 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 13:59:59.816651 11173 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 13:59:59.827797  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.837584 11174 ts_tablet_manager.cc:1916] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 13:59:59.838701 11020 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.839300 11020 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.841387 11020 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.827385 11175 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 13:59:59.846400  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69434us
I20260501 13:59:59.835130 11173 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.828688 11128 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:59.849311  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48593.9us
W20260501 13:59:59.849758  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.847354 11175 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.855686  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.857749  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:59.859494  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.860045 11128 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:59.861301  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 9, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.863072  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.850415  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 13:59:59.837071 11096 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.875264 11028 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 13:59:59.876042 11096 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 13:59:59.876269 11175 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.868949 11020 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 13:59:59.877518 11020 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 13:59:59.874387  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65882.2us
I20260501 13:59:59.878693  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 13:59:59.877919 11020 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.873392 10903 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 13:59:59.887046 10812 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260501 13:59:59.887212 11178 consensus_queue.cc:1175] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "109c9ba263c34ff8aee17bc446cf258e" responder_term: 9 status { last_received { term: 4 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: [6.3-8.4]" } } last_received_current_leader { term: 0 index: 0 } }
W20260501 13:59:59.887090  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.890432  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:59.885921 10903 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 13:59:59.892410 10903 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 3 FOLLOWER]: Advancing to term 4
I20260501 13:59:59.895185  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 13:59:59.893571  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.895895  7746 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 13:59:59.884277 11176 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:59.897609 11175 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 13:59:59.909595  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 13:59:59.919137  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 68810.4us
I20260501 13:59:59.922994  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 13:59:59.924752 11028 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 13:59:59.925211  7751 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.929235  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 13:59:59.929780  7821 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.933452  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.911612 11176 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:59.930222  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.935436  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 13:59:59.936326 11178 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 13:59:59.937623 11177 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 13:59:59.938140 11177 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 13:59:59.929656 11173 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.938292  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.945184 11178 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.945307 11028 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 13:59:59.946545  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.947109 11174 ts_tablet_manager.cc:1929] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260501 13:59:59.947662 11174 log.cc:1199] T a769b271cb04497eb1cb86169399ceb2 P ca8dd10afb304b4c96cfcec7e2309947: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/wals/a769b271cb04497eb1cb86169399ceb2
I20260501 13:59:59.948496  7751 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 13:59:59.948926  7819 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 13:59:59.948863 11178 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260501 13:59:59.950093  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.950229 11178 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 13:59:59.951105 11175 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 13:59:59.950881 11178 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.951699 11175 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.953083 11178 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.944366 11173 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 13:59:59.953907 11175 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 13:59:59.953987 11177 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 13:59:59.955109  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.956064  7562 catalog_manager.cc:5002] TS ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): tablet a769b271cb04497eb1cb86169399ceb2 (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
W20260501 13:59:59.957476  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 13:59:59.958581  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 13:59:59.959704 11183 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 13:59:59.960170 11183 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 13:59:59.960522 11183 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 13:59:59.962301  7577 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 7, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 13:59:59.966394  7821 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 13:59:59.967916 11175 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:59.969089 10887 raft_consensus.cc:2764] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260501 13:59:59.972388  7625 auto_rebalancer.cc:285] failed to send replica move request: Illegal state: Replica ca8dd10afb304b4c96cfcec7e2309947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 13:59:59.976797  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 13:59:59.992871  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 13:59:59.997047  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 87996.1us
I20260501 13:59:59.980752 11175 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260501 14:00:00.001483  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:00.002002 11175 consensus_queue.cc:1243] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 14:00:00.002616 11178 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:00.002991 11178 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:00.003878 11178 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.004343 11028 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:00.007567  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:00.011669  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica ca8dd10afb304b4c96cfcec7e2309947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 14:00:00.016111  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 93b661856a9e45bf823981177d99ae0c, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:00.016539  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 93b661856a9e45bf823981177d99ae0c, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.019192  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.005474 11178 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:00.016925 11028 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:00.011086 11175 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:00.028036 11028 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 13:59:59.994900 11096 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:00.033480  7821 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.036221 11172 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:00.044587 11172 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:00.045181 11172 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:00.044948 10903 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.048233 11096 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 13:59:59.988557 11176 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 13:59:59.979697 11183 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:00.063272  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 46544.9us
W20260501 14:00:00.066689  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 59252.9us
I20260501 14:00:00.067631  8373 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:00.067687  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.068850 11096 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:00.069382 11096 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:00.070416 11096 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.072824  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:00.075021 11020 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.076507 10903 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.077804  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.026938 11128 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.096004  7819 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:00.095032  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:00.097918  7747 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:00.097795 11183 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:00.124150  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.125108 11028 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.123157  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.127935 11187 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.128569 11187 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:00.131058  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 66969.4us
I20260501 14:00:00.132256  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.133460  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:00.133810 11187 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.134676 11176 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:00.137694 11186 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:00.138911 10812 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:00.139310 10812 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:00.129098 11028 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.140337 11028 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:00.140256 10812 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.142037 10812 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:00.142730 11172 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.130854 11091 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:00.145259  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.145944  7747 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:00.146914 11187 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:00.147466 11187 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.148162  7746 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:00.148438 10903 raft_consensus.cc:2764] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260501 14:00:00.149549 11187 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.139559  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:00.150116 11187 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.159185  7747 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:00.150907 11020 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.155732  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.160838  7673 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:00.160925  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:00.084296 11175 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:00.159986  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.161578  7746 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:00.164314  7821 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:00.165706  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:00.166648  7679 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:00.161882 11187 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.168358 11091 consensus_queue.cc:1059] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 14:00:00.169535 11091 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:00.169894 11091 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:00.170392 11187 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.160557 11186 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:00.171128 11186 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:00.170759 11091 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.172102 11091 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:00.171489  7577 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:00.178495  7747 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:00.180351  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:00.186008  7747 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 3. Current term is 4. Ops: []
I20260501 14:00:00.170097 11172 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.187096 11186 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.191320  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.191865 11177 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 14:00:00.199126  7746 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:00.210146 11183 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:00.211746 11175 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.213238 11183 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:00.213673 11183 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:00.185910 11028 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:00.202934  7577 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 9, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:00.229110  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:00.197597 11177 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:00.234795 11182 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260501 14:00:00.235227 11188 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.235879 11188 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.237942 11188 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.231824  7676 raft_consensus.cc:2955] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:00.245291  7673 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:00.215137 11128 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.224427 11187 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.214437 11183 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.197759 11176 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260501 14:00:00.247854  7674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 14:00:00.261031  7674 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:00.261442  7674 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:00.262230 11183 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:00.244696 10896 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:00.259176 11028 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.234043 11177 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:00.264467  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 132303us
I20260501 14:00:00.259343  7576 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:00.230109 11102 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260501 14:00:00.273375  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:00.286684  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:00.286010 10896 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:00.307935  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:00.264106 11187 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.296238 11172 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:00.315850  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:00.316627  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:00.332520  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.289702 11128 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260501 14:00:00.337960  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:00.340260  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:00.320541 11102 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:00.330724 10900 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 14:00:00.336040 11096 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:00.372699  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:00.343442 11172 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:00.378750  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.370577  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.384294  7674 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.386453  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.387166  7672 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:00.370399 11096 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.392504 11096 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:00.357084 10905 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:00.358146 11102 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:00:00.398222  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.399408  7672 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:00.398113  7822 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:00.406647  7674 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.412838 11190 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:00.413185  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.413519 11190 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:00.413986 11190 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:00.414646  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:00.414939  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:00.380506 11020 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:00.389181 11175 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:00.343020 11177 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.453975  7821 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:00.453995  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.420701 10905 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:00.459206  7822 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260501 14:00:00.454632  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:00.460275  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.459694  7822 pending_rounds.cc:85] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 5
I20260501 14:00:00.472471  7822 pending_rounds.cc:107] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260501 14:00:00.436739 11182 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:00.477301  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.486444  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.436659 11020 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:00.490818 11195 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260501 14:00:00.477212  7822 raft_consensus.cc:2917] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
W20260501 14:00:00.493479 11196 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260501 14:00:00.493810 11020 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.496388 11091 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:00.496991 11194 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260501 14:00:00.471743 11172 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.498087 11187 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:00.499603 11197 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260501 14:00:00.502149  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.503279  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:00.505300  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:00.506174 10632 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Stepping down as leader of term 3
I20260501 14:00:00.506608 10632 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:00.507491 10632 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.508791 10632 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 3 FOLLOWER]: Advancing to term 4
I20260501 14:00:00.512292  7822 raft_consensus.cc:2889] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:00.544073  7673 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:00.437723 10896 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.452414 11175 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:00.554625  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:00.564437  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 90893.4us
I20260501 14:00:00.567011  7678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3031b746c62f413a9da6fed211d638da"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:00.567806  7678 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:00.552270  7577 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 7 to 8, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 8 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:00.569774  7678 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:00.550132 11188 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:00.578930  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.579267 10900 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.589609  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.580157  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.489638 11182 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.564289 11186 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.586885 11175 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.595480  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:00.596133  7748 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:00.587085  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.588245  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.588601 10812 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.589381 10905 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:00.585772  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.591434  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:00.631213  7821 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:00.631656  7821 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:00.592182  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:00.590991  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 358749us
I20260501 14:00:00.571341 11096 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.473862 11102 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.608505  7675 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 14:00:00.628821  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.497004 11091 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.635099  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:00.637475  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.637823  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.644490  7678 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.655993  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:00.661823  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:00.673151  7672 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:00.661981  7821 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.674096  7821 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:00.675302  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:00.674975  7678 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.681558  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:00.690237  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.597532 10900 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.659204 11187 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:00.692148  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:00.692289 11028 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 14:00:00.699630  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:00.628561 11186 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.646669 10812 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.695346 11102 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:00.730481  7821 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:00.740530 11217 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.741236 11217 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.743408 11223 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.709089 10903 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:00.771577 11188 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:00.773195  7752 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:00.774196  7576 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 14:00:00.783771  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.743781 11217 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:00.793051  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 102926us
W20260501 14:00:00.796665  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.829514  7675 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260501 14:00:00.829331  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:00.712634 11187 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:00.792344 11210 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:00.867923  7752 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
W20260501 14:00:00.879591  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.831604 10903 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:00.881877  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:00.882658 11218 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260501 14:00:00.746634 11223 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.863188 11212 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:00.895536  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.880894 11182 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:00.880363 11020 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:00.883848 11211 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:00.883433 11208 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:00.889129 11096 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.919795 11208 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:00.921240 11208 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.929162 11187 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.891594 10896 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.930773 10896 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.933706 10896 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.936913  7574 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 10, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:00.939998 11211 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:00.940719 11211 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:00.945887 11223 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.948271 11186 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.951337 11177 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:00.890132 11091 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.909941 10900 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.910673 10812 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:00.911906 11132 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260501 14:00:00.911089 11020 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.966470 11020 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:00.907151 11207 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260501 14:00:00.969242 11207 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:00.968636 11091 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:00.969847 11207 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:00.917659 11228 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:00.972250 11228 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:00.881130 11210 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:00.976894 11210 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:00.978125 11228 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:00.919059 11222 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260501 14:00:00.982224  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.983969  7747 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 9
W20260501 14:00:00.986088  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 959ae22d6e614940b93df344dbf7fa20, TS 109c9ba263c34ff8aee17bc446cf258e -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:00.986565  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 959ae22d6e614940b93df344dbf7fa20, TS 109c9ba263c34ff8aee17bc446cf258e -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:00.997810  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:00.995671  7745 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:01.030843 11183 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.035948 11183 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.037295 11216 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.038326 11183 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.038156 11216 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.041054  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.041466  7748 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:01.043095  7751 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:01.042721  7752 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 14:00:01.060145 11183 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.065191 11183 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.068033 11183 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.062467 11091 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.069350 11091 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.072062 11091 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.083017  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:01.087134 11234 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:01.087731 11234 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.088207 11234 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:01.089845  7747 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:01.094128  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.121274  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:00.971096 11207 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:01.133757  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 477868us
I20260501 14:00:01.135017  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:01.126510  7679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.007s	sys 0.009s
W20260501 14:00:01.140921  7679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.009s
I20260501 14:00:01.144294 11240 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:01.148561 11216 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.164386  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:01.166311  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.178869  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:01.179666  7745 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:01.180002  7745 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:01.124011 11091 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260501 14:00:01.186890  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 314952us
I20260501 14:00:01.184813  7679 raft_consensus.cc:2955] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:01.187345  7745 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.191649  7745 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:01.195739 10905 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.196314 10905 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.197384  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.195768  7819 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:01.200619  7824 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 14:00:01.200903 10905 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:01.201711  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.181737 11240 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:01.203156 11028 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:01.203460 11240 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:01.203720 11028 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.204504 11240 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.205650  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.205935 11028 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:01.205088  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.207093 11028 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:01.208014  7821 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:01.180752 11176 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.214232  7745 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:01.217284 11176 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:01.217638  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.218699  7821 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
W20260501 14:00:01.229118 11190 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.815s	user 0.014s	sys 0.000s
I20260501 14:00:01.229631 11190 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.197448  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.229641  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.232254  8371 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:01.232685  8381 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:01.229796 11128 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:01.233850 11128 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.235785 11128 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.235809  8373 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:01.237432  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.238253  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.239226  8375 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:01.211339 11207 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.250180  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.257505  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:01.227698 11234 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.259651  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.260887  8371 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260501 14:00:01.262939  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.262782  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.263432  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.268592  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:01.268980  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.269816  7747 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 14:00:01.270438  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:01.273437  7821 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:01.280205  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.280889  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.281198  7676 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:01.281579  7674 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:01.282189  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.284049  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.284664  7672 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:01.286235  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.276445  8375 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:01.238880 10812 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:01.288316  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.290155  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:01.270923  8371 pending_rounds.cc:85] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 5
I20260501 14:00:01.291550  8371 pending_rounds.cc:107] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260501 14:00:01.291756  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2544) took 1023 ms. Trace:
I20260501 14:00:01.292891  7678 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:01.294821  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:01.292392  7679 rpcz_store.cc:276] 0501 14:00:00.268108 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:00.506466 (+238358us) service_pool.cc:224] Handling call
0501 14:00:00.507111 (+   645us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:00.507710 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:00.507740 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:00.508744 (+  1004us) log.cc:844] Serialized 463 byte log entry
0501 14:00:01.141467 (+632723us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:01.184410 (+ 42943us) log.cc:844] Serialized 14 byte log entry
0501 14:00:01.287297 (+102887us) log.cc:844] Serialized 14 byte log entry
0501 14:00:01.291246 (+  3949us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:01.291395 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:01.291454 (+    59us) raft_consensus.cc:1685] finished
0501 14:00:01.291476 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:01.291671 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44491,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3524,"raft.queue_time_us":3005,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":68880,"thread_start_us":632295,"threads_started":1,"wal-append.queue_time_us":643806}
I20260501 14:00:01.297564  8372 raft_consensus.cc:2368] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9.
I20260501 14:00:01.299862  7752 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260501 14:00:01.300377  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.241138 11190 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.240903 11176 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.302074  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.328542  7827 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:01.291934  8371 raft_consensus.cc:2917] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260501 14:00:01.329722  8371 raft_consensus.cc:2889] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:01.304401  7747 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:01.264444 11128 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260501 14:00:01.325057  8381 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 4.
I20260501 14:00:01.339355  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:01.339696  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.340176  7747 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:01.304657  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.305333  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:01.344874  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 57305.6us
I20260501 14:00:01.346030  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.348774  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.307497  7674 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:01.312459  7748 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260501 14:00:01.316210  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.350181  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:01.316658  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.317149  7824 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:01.317576 10903 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.317523 11172 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 14:00:01.318006  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:01.367414  8377 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:01.318384  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.321805 11234 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:01.317436 11233 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260501 14:00:01.369623  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:01.373762  7671 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260501 14:00:01.310325  7576 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 10, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:01.378840  7576 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 14:00:01.383881  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 86699.7us
I20260501 14:00:01.387676  7678 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:01.387658  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.391808  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.392503  7820 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:01.395308  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:01.389367  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.396742  7823 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:01.397022  8381 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 14:00:01.395479  7819 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:01.395684  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:01.398780  7679 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:01.398578  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.437355  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.474373  7676 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:01.438268  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.441821  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.437765  7678 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:01.475930  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 78500.7us
I20260501 14:00:01.365147 10903 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:01.444680 11233 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260501 14:00:01.444591  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:01.364262 11210 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:01.368495 11175 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:01.446491  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.374511 11178 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:01.388989 11172 consensus_queue.cc:1243] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260501 14:00:01.388696 11096 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260501 14:00:01.457616 11229 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.457819  8373 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:01.389112 11187 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260501 14:00:01.464885  7671 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:01.440141 11230 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:01.439023 11199 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.506479 11199 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.509049 11199 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.439585 11236 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 14:00:01.473107  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 93841.9us
I20260501 14:00:01.292508 11183 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260501 14:00:01.476737  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:01.513309  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:01.338078 11208 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.095s
I20260501 14:00:01.478880 10903 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.518402 11176 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.518946 11176 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.519409 11176 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.519124 10900 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260501 14:00:01.481303 11211 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.001s
I20260501 14:00:01.557590 11211 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.559010  7746 raft_consensus.cc:2368] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:01.559927 11211 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.487519 11178 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.560719 11178 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.561893  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.562631  7746 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:01.516301  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:01.564518  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 48313.6us
W20260501 14:00:01.565881  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.521086 11245 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:01.523149  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.524405 11193 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:01.522929 11177 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:01.526659  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:01.526504 10903 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.526876  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.528331  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.529415  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2539) took 1297 ms. Trace:
I20260501 14:00:01.530438  7673 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:01.537678  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.538558 11230 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:01.539659  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.502559 11229 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.542165  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.546846 11190 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:01.482218  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 84238.9us
I20260501 14:00:01.548359 11176 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.549966  7823 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:01.568255  7746 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:01.569949  7748 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
W20260501 14:00:01.574510  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 51451.3us
W20260501 14:00:01.575129  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.575209  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:01.575764  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 134034us
I20260501 14:00:01.534704  7826 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:01.581290 11091 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.558970  7574 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 9 to 10, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:01.586122 11177 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.592262  7677 rpcz_store.cc:276] 0501 14:00:00.232463 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:00.232594 (+   131us) service_pool.cc:224] Handling call
0501 14:00:00.232968 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:00.233334 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 6
0501 14:00:00.571744 (+338410us) log.cc:844] Serialized 14 byte log entry
0501 14:00:00.829428 (+257684us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:00.829889 (+   461us) log.cc:844] Serialized 26 byte log entry
0501 14:00:00.830034 (+   145us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:00.830248 (+   214us) log.cc:844] Serialized 14 byte log entry
0501 14:00:00.863328 (+ 33080us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:00.863440 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:00.935780 (+ 72340us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002287c0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:00.946299 (+ 10519us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b18002287c0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2fe5c33ef 00007fb2f7643bb1 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d
0501 14:00:01.529046 (+582747us) raft_consensus.cc:1685] finished
0501 14:00:01.529085 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:01.529293 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111304,"prepare.queue_time_us":171464,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":107,"raft.queue_time_us":36987,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":48025,"spinlock_wait_cycles":40530304,"thread_start_us":574910,"threads_started":2,"wal-append.queue_time_us":324605}
I20260501 14:00:01.581096 11173 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:01.584550  8377 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:01.607055  7747 raft_consensus.cc:606] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.621523  7747 raft_consensus.cc:614] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:01.580458 11193 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:01.587529 10896 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.590886  7752 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:01.612788  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.611157  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:01.629294  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.613440 10900 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:01.602705 11210 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:01.619375  7643 leader_election.cc:400] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:01.631234  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.640259  7643 leader_election.cc:403] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:01.620218 11177 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:01.634474  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.610635 11091 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.621330 11175 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.617237 11187 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.645732  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:01.650161  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 1824) took 1210 ms. Trace:
I20260501 14:00:01.650328 11172 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260501 14:00:01.636731 11216 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.652144  7671 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:01.653556 11210 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.606508 11190 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.654737  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.622865 11236 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260501 14:00:01.661283  7718 leader_election.cc:400] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9.
I20260501 14:00:01.636348 11208 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:01.640260 11223 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.632542  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:01.667552  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2549) took 1368 ms. Trace:
W20260501 14:00:01.708341  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75930.1us
I20260501 14:00:01.709698  7718 leader_election.cc:403] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:01.709425  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:01.710553  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 49510.4us
I20260501 14:00:01.711160  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.597064 11183 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260501 14:00:01.669793 11091 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.670691 11252 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:01.672586  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.670918 10903 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.636837 10900 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.650920  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:01.675259  7826 rpcz_store.cc:276] 0501 14:00:00.439928 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:00.440148 (+   220us) service_pool.cc:224] Handling call
0501 14:00:01.649949 (+1209801us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54002e9854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:01.650073 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129032576}
I20260501 14:00:01.703233  7676 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:01.707872  7673 rpcz_store.cc:276] 0501 14:00:00.298895 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:00.545267 (+246372us) service_pool.cc:224] Handling call
0501 14:00:01.529935 (+984668us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:01.593770 (+ 63835us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:01.667251 (+ 73481us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54003ffcd0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:01.667457 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263673088}
I20260501 14:00:01.716133  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:01.636905 10896 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.678719 11216 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.725284 11243 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Leader election won for term 4
I20260501 14:00:01.725694 11205 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260501 14:00:01.675786 11102 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:01.728000  7675 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:01.730280  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:01.715863 11223 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.719928 11020 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9.
I20260501 14:00:01.719091 11245 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:01.737002  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.720778 11207 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:01.719579 11128 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 14:00:01.732350 11216 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.705971 11096 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:01.726842 10900 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:01.726586 11241 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:01.702487 11240 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260501 14:00:01.729496 11182 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.679126 11187 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.676470 11175 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.737282 11237 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:01.740262 11223 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.762003  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:01.727799 11252 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.740032 11243 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:01.747917 11207 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.773188 11232 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260501 14:00:01.741472 11253 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:01.782769  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 70493.7us
W20260501 14:00:01.788048  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53120.2us
I20260501 14:00:01.783001  7747 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.701344 11230 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.679679 11193 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.796487 11175 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.749684 10632 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:01.797962 10632 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.798177 11258 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.798491 10632 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:01.798796 11258 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:01.799247 11258 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.739298 11186 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260501 14:00:01.794850  7747 raft_consensus.cc:614] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:01.803979  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:01.778671 11176 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.802983 11253 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.809454 11249 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:01.809945 11249 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.804915 11175 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:01.810353 11249 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:01.810662 11175 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.811290 11253 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.812005 11020 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 14:00:01.812670 11020 consensus_queue.cc:1243] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer bc1b0a0a152e46fea4bd4934ba9976ed log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260501 14:00:01.812871 11175 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.813146 11252 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.784341 11229 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.761425 11096 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:01.815049 11254 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260501 14:00:01.803624 11207 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.780946 11128 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:01.784049 11182 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.807372 10896 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.805521 11028 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260501 14:00:01.824435 11253 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:01.803504 11241 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.880350  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.888324  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.877919  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.883490  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:01.886027  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52422.8us
I20260501 14:00:01.887217  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.879387  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.889883  7747 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:01.895452  7752 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:01.897543 11241 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.877343 10887 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.898674  7820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:01.899466  7820 raft_consensus.cc:606] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.899292 10887 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.899920  7820 raft_consensus.cc:614] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:01.901567  7823 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:01.904264  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.905015  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.906950 11236 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:01.907092  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:01.908015 11175 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.908551 11175 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.910220 11262 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:01.910725 11262 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.910851 11175 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.911136 11262 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:01.912417  7747 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260501 14:00:01.912598 11251 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260501 14:00:01.913816 11256 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:01.907605 11236 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.914429 11256 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.921126 11256 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.920646 11128 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.922283 11241 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.924181 11236 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.924463 11212 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:01.924944 11212 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:01.926082  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 46448.4us
I20260501 14:00:01.907253  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.903923 11253 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.938659  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.939455  7752 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:01.939041 11212 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.940299 11212 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:01.931782  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.941223  7820 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:01.932987  7822 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260501 14:00:01.933992  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.942993  8373 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:01.928365  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.944386  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:01.946190  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.946960  7820 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:01.947773  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.948105  7750 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260501 14:00:01.944705 11208 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.949348  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.949416 11208 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.950155  7828 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:01.952667  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:01.954384  7747 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:01.927057 11199 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:01.955622 11182 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:01.924073 11190 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.956887 11187 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:01.958707  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:01.960260  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.960355  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.961208  8372 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:01.960911 11020 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.960413 11240 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260501 14:00:01.962620 11176 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:01.953682 11243 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.961210 11237 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.967023 11237 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.969473 11237 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:01.961440 11190 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:01.970314  8372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:01.970541 11241 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 14:00:01.971006  8372 raft_consensus.cc:606] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:01.971665  8372 raft_consensus.cc:614] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:01.972242 11187 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:01.972054 11020 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.972690 11187 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:01.973073 11187 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.974330 11020 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:01.976236  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:01.976676 11193 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:01.958027 11236 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:01.980201 11236 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:01.980634 11236 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.982911 11177 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.961643  7825 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:01.987658  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:01.990320  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:01.991070  7825 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:01.990782 11223 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:01.992040  7827 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 14:00:01.993131  8377 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:01.997126  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:01.997903  7821 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:02.007393  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:02.008380  7821 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:01.940479 10887 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.009877  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:02.010250  7828 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260501 14:00:01.945225 11230 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.006790  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.011495  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:02.013790  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:02.026774  7751 raft_consensus.cc:606] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.026887  8376 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:02.027192  7751 raft_consensus.cc:614] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:02.014576  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.009790 11229 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:02.016458  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:02.011519  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:02.036572  7675 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:02.037843  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:02.041144  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.017547  7576 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 8. New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:02.044951  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:01.970259 11190 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:01.940510 11253 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.027904  7750 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:02.057477  7672 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:02.059360  7823 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 14:00:02.063854  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:02.065383  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:02.064036  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 57473us
I20260501 14:00:02.068071  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.069238  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.070258  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.070426  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:02.072068  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:02.072700  7673 raft_consensus.cc:1217] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[6.5-10.7]   Dedup: 6.5->[8.6-10.7]
I20260501 14:00:02.073236  7673 pending_rounds.cc:85] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 14:00:02.073546  7673 pending_rounds.cc:107] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260501 14:00:02.072748  8376 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:02.073825  7673 raft_consensus.cc:2889] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:02.075388  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:02.075896  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.080466  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.083794  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:02.012249 11096 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.084652  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:02.019943 11208 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.019769 11210 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:02.057003 10903 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:02.064236 11240 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:01.962267 11178 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.057770 11241 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:02.106362  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:02.106452  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:02.021906 10632 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.084537 11205 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election won for term 6
I20260501 14:00:02.115175  7675 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 14:00:02.120110  8373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:02.127336  8373 raft_consensus.cc:606] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:02.088218 11211 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:02.128957  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:02.133569  7671 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:02.095733 11020 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 14:00:02.144277  7674 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:02.064534 11230 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.069370 11229 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:02.160544  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 54278us
I20260501 14:00:02.101744 10903 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:02.109047 11260 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.181005  7825 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:02.179020  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:02.179951  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 93870us
W20260501 14:00:02.180717  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 93562.2us
I20260501 14:00:02.193866  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:02.095629 11258 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:02.200626  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:02.127864 11256 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.203935  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:02.136750 11253 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:02.205185  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:02.207803  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:02.178117 11211 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:02.216454  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:02.102982 11091 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.218616  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:02.219609  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:02.224617  7670 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:02.189199 10903 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:02.196484 11020 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:02.199084 11210 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.192853 11240 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:02.130187 11241 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.216728 11245 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260501 14:00:02.244580  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 175394us
I20260501 14:00:02.208604 11175 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:02.208984 11096 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:02.208806 11252 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:02.246557 11223 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.213820 11256 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.200616 11260 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:02.300278  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:02.255231 11245 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:02.264299 11096 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:02.303182  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.307253  7752 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 8
I20260501 14:00:02.283286 11177 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.246647 11216 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.293955 11283 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:02.252818 11210 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.354368  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.342805 11229 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.355358  7824 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:02.254724 11240 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.335899 11245 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:02.302898 11175 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:02.299417 11259 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260501 14:00:02.358873 11020 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.293859 11128 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260501 14:00:02.329051 11096 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:02.393056  7751 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:02.356096 10632 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.282919 11262 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.299621 11190 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.361192 11252 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:02.410396  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 202681us
I20260501 14:00:02.412391  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:02.376374 11178 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.347636 11207 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:02.427537 11277 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260501 14:00:02.427731 11273 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260501 14:00:02.430389 11269 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260501 14:00:02.433089 11266 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.250s	user 0.001s	sys 0.001s
I20260501 14:00:02.435679 11260 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.421752  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:02.417938 11268 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260501 14:00:02.470265  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48655.1us
W20260501 14:00:02.472522  7826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.021s
W20260501 14:00:02.473120  7826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.021s
I20260501 14:00:02.349198 11211 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.489041  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:02.494410  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:02.496057  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.497051  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:02.395207 11175 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:02.470227 10900 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.011s
I20260501 14:00:02.485541 11260 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:02.513823 11260 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:02.515062  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.516203  7750 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
W20260501 14:00:02.475445 11187 consensus_meta.cc:287] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260501 14:00:02.521488  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:02.525053  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 220461us
I20260501 14:00:02.466050 11230 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.537107  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:02.525533  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.424890 11252 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.483325 11258 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.545524  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:02.514422 11260 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:02.526263  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.518608 11091 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.511606 11229 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:02.498322 11178 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260501 14:00:02.563050  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 57330.3us
I20260501 14:00:02.553319 11172 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:02.550664 11230 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.532675 10900 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.539683 11187 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.574455  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:02.559719 11241 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.583344 10900 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.584128 11289 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:02.576871 11172 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:02.587368 11172 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:02.626693  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 432910us
I20260501 14:00:02.627202 11282 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 14:00:02.680341  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 126857us
I20260501 14:00:02.629470 11179 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:02.578495 11230 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:02.631836 11286 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:02.611132 11289 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:02.571094 11229 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.633765 11207 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.633953 11187 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.636246 11252 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:02.638063 11249 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.006s
I20260501 14:00:02.640532 11262 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.641551 11175 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.642159 11240 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.578765 11210 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.577312 11216 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.716094  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:02.716742  7821 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:02.716893  7827 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:02.649142 11236 consensus_meta.cc:287] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.004s
I20260501 14:00:02.655463 11184 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:02.662573 11253 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:02.666061 11096 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.667420 10896 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.669446  7752 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:02.728180  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:02.732784  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.733620  7752 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:02.611696  7679 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:02.643234 10903 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:02.694670  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 129414us
I20260501 14:00:02.698696  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.639732 11283 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260501 14:00:02.680742 11193 consensus_meta.cc:287] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.701s	user 0.018s	sys 0.001s
I20260501 14:00:02.613101 11205 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:02.705919  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.703878  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.707968  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:02.709961  7825 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:02.684461 11179 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:02.686395 11286 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:02.680542 11282 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:02.714686  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.715281  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:02.715626  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:02.724066  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:02.758718  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55005us
I20260501 14:00:02.730957  7828 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:02.731295  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:02.736889  7819 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:02.756212  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:02.758605  7750 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:02.777758 11289 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:03.428360 10632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.009s	sys 0.012s
W20260501 14:00:03.428853 10632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.009s	sys 0.012s
I20260501 14:00:02.759472  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:03.594430  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 834967us
I20260501 14:00:03.594767 11330 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:03.595350 11330 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:02.710577 11294 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260501 14:00:03.595736 11330 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:02.771720 11300 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:02.786247 10903 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.165484  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 281) took 1561 ms. Trace:
W20260501 14:00:02.771799  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet eed0026bd9c541b7b89c956e31761d54, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.260398  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2568) took 1185 ms. Trace:
I20260501 14:00:03.824843  7679 rpcz_store.cc:276] 0501 14:00:02.074884 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.075046 (+   162us) service_pool.cc:224] Handling call
0501 14:00:03.260050 (+1185004us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540019c154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:03.260267 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230911744}
I20260501 14:00:03.822248  7576 rpcz_store.cc:276] 0501 14:00:01.604215 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:01.604398 (+   183us) service_pool.cc:224] Handling call
0501 14:00:03.165401 (+1561003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:02.081486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:02.238612 (+157126us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:02.241121 (+  2509us) write_op.cc:435] Acquired schema lock
0501 14:00:02.246406 (+  5285us) tablet.cc:662] Decoding operations
0501 14:00:02.305349 (+ 58943us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:02.339268 (+ 33919us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:02.343653 (+  4385us) tablet.cc:685] Acquiring locks for 1 operations
0501 14:00:02.372124 (+ 28471us) tablet.cc:701] Row locks acquired
0501 14:00:02.385528 (+ 13404us) write_op.cc:260] PREPARE: finished
0501 14:00:02.410720 (+ 25192us) write_op.cc:270] Start()
0501 14:00:02.418599 (+  7879us) write_op.cc:276] Timestamp: P: 1777644002404510 usec, L: 0
0501 14:00:02.424745 (+  6146us) op_driver.cc:348] REPLICATION: starting
0501 14:00:02.555253 (+130508us) log.cc:844] Serialized 533 byte log entry
0501 14:00:02.707264 (+152011us) op_driver.cc:464] REPLICATION: finished
0501 14:00:03.159377 (+452113us) write_op.cc:301] APPLY: starting
0501 14:00:03.159489 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:03.159614 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:03.159743 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:03.160032 (+   289us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:03.160231 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0501 14:00:03.160273 (+    42us) write_op.cc:312] APPLY: finished
0501 14:00:03.160493 (+   220us) log.cc:844] Serialized 23 byte log entry
0501 14:00:03.160693 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:03.160808 (+   115us) write_op.cc:454] Released schema lock
0501 14:00:03.160850 (+    42us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:03.166735 (+  5885us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:03.166771 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":451396,"apply.run_cpu_time_us":1982,"apply.run_wall_time_us":7473,"num_ops":1,"prepare.queue_time_us":12465,"prepare.run_cpu_time_us":5615,"prepare.run_wall_time_us":497926,"replication_time_us":266990,"thread_start_us":142645,"threads_started":1}]]}
I20260501 14:00:03.507114 11315 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:03.508235 11312 log.cc:927] Time spent T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260501 14:00:03.826175 11315 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.828524 11315 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.519310 11321 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:03.829278 11321 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.831470 11321 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.525771 11323 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.530421 11319 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:03.558081 11329 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:03.833124 11323 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.833259 11319 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.835342 11323 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.565835 11322 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.833331 11329 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.836144 11322 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.838109 11329 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:03.566623 11311 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.838369 11322 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:03.568297  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.016s	sys 0.012s
I20260501 14:00:03.586969 11327 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:03.839296  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.017s	sys 0.012s
I20260501 14:00:03.838881 11311 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:03.839699  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 1.26522e+06us
I20260501 14:00:03.839454 11327 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.841291 11311 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.835543 11319 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.841877 11327 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:02.790755  7746 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:03.844165  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:03.844954  7670 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:03.845901  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:03.847550  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:03.291352  7749 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260501 14:00:03.849954  7749 pending_rounds.cc:85] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 5
I20260501 14:00:03.850211  7749 pending_rounds.cc:107] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260501 14:00:03.850435  7749 raft_consensus.cc:2889] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:03.850651  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:03.851373 11243 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.605504  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1840) took 1562 ms. Trace:
I20260501 14:00:03.622011 11330 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.853547  7745 rpcz_store.cc:276] 0501 14:00:02.043361 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.043537 (+   176us) service_pool.cc:224] Handling call
0501 14:00:02.075408 (+ 31871us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:02.550090 (+474682us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:02.550151 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:02.560091 (+  9940us) log.cc:844] Serialized 26 byte log entry
0501 14:00:02.687203 (+127112us) raft_consensus.cc:1645] Marking committed up to 5
0501 14:00:02.687241 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:02.687314 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:03.605079 (+917765us) raft_consensus.cc:1685] finished
0501 14:00:03.605114 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:03.605381 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9580,"raft.queue_time_us":22674,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":12225,"thread_start_us":530176,"threads_started":2,"wal-append.queue_time_us":189609}
I20260501 14:00:03.855015 11330 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:03.349045  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 592876us
I20260501 14:00:03.859480  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2882) took 2291 ms. Trace:
I20260501 14:00:03.556442 11020 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:03.861819 11020 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.771607 10905 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:03.050056 11096 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.349669 11173 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:02.753722 11179 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:03.244428 11182 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.875067 10632 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:03.885819 11182 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.886447 11173 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.877424 11311 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:02.731551 11184 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.865450  7749 rpcz_store.cc:276] 0501 14:00:01.567961 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:01.607433 (+ 39472us) service_pool.cc:224] Handling call
0501 14:00:01.607729 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:03.850899 (+2243170us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:03.859154 (+  8255us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001d4cd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:03.859392 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649748224}
I20260501 14:00:03.889644  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:03.890183  7749 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 9
I20260501 14:00:03.890512 11184 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.245131 11186 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:02.790995 11193 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:03.891875 11186 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:02.776494 11205 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.894084 11186 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.403668 11210 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:03.530356 11216 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:03.897576 11210 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.898079 11216 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.900063 11216 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:02.737339 11212 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.781s	user 0.005s	sys 0.008s
I20260501 14:00:03.531371 11237 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.904269 11237 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.906530 11237 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:03.907040 11187 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.907582 11187 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.910378 11187 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.904704  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:03.911733  7748 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:02.722241 11236 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.916357 11236 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.784487 11229 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.772993 11230 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.330286 11240 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:03.921053 11240 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.922839 11179 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:03.303193 11245 consensus_meta.cc:287] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.911s	user 0.014s	sys 0.000s
I20260501 14:00:03.927063 11245 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.930544 11245 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.713392 11259 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260501 14:00:03.562415 11232 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:03.934183 11179 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:03.934506 11232 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.106698 11262 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.936762 11262 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.066967 11253 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.940877 11253 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.943194 11253 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:02.705257 11249 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.946530 11249 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:02.782356 11260 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.949713 11260 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.419678 11272 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.951539 11272 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.954146 11272 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:03.246594 11275 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:02.771337 11282 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:03.628644 11284 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.999s	user 0.006s	sys 0.002s
I20260501 14:00:03.406889 11281 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:03.505904 11285 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.011s	sys 0.014s
I20260501 14:00:02.757534 11286 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:03.969601 11232 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:03.603157 11287 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.956s	user 0.000s	sys 0.006s
I20260501 14:00:03.587092 11290 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:03.975625 11290 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:03.211839 11291 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.577s	user 0.000s	sys 0.005s
W20260501 14:00:02.981230 11280 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.413s	user 0.000s	sys 0.006s
I20260501 14:00:03.523036 11283 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:03.983227 11283 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:03.986052 11283 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.987071  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2888) took 2015 ms. Trace:
W20260501 14:00:03.058350 11295 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.423s	user 0.005s	sys 0.000s
W20260501 14:00:03.356993 11296 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.688s	user 0.001s	sys 0.003s
I20260501 14:00:03.597930 11300 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.994460 11300 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.997114  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1844) took 2054 ms. Trace:
I20260501 14:00:03.400652 11297 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:04.002463 11297 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.004683  8375 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 4: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:03.150663 11299 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.007367 11299 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.008386  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.009582 11299 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.010381  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:04.011165  8373 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:03.158896 11307 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.648689 11333 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.012326  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:03.670133 11336 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.013191  8376 raft_consensus.cc:2368] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7.
I20260501 14:00:04.012758 11333 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.013139 11336 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.014295  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:04.014950  8372 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:04.012742 11307 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.015278 11333 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.016137  7674 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 6: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:04.017026 11307 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.997720  7822 rpcz_store.cc:276] 0501 14:00:01.942807 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:01.943404 (+   597us) service_pool.cc:224] Handling call
0501 14:00:02.034409 (+ 91005us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:02.064897 (+ 30488us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 14:00:02.469851 (+404954us) log.cc:844] Serialized 14 byte log entry
0501 14:00:02.588168 (+118317us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18003988c0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2fe5c33ef 00007fb2f7643bb1 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d
0501 14:00:02.659049 (+ 70881us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:02.659721 (+   672us) log.cc:844] Serialized 52 byte log entry
0501 14:00:02.659892 (+   171us) raft_consensus.cc:1645] Marking committed up to 5
0501 14:00:02.659930 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:02.660015 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:03.356426 (+696411us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:03.995216 (+638790us) raft_consensus.cc:1685] finished
0501 14:00:03.995250 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:03.996798 (+  1548us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b54002e9350. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:03.996984 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140176,"prepare.queue_time_us":139608,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":6043,"raft.queue_time_us":135801,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":12472,"spinlock_wait_cycles":251282304,"thread_start_us":425763,"threads_started":2,"wal-append.queue_time_us":172020}
W20260501 14:00:03.716784  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 121240us
I20260501 14:00:04.020606  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:03.762092 11332 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:04.024166 11332 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.025029  8372 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:04.026742 11332 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:04.027375 11332 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260501 14:00:03.766440 11178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.129s	user 0.013s	sys 0.007s
W20260501 14:00:04.029188 11178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.014s	sys 0.007s
I20260501 14:00:03.800761 10812 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.029898 10812 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.030812 11249 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.031363 11249 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.032135 10812 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:03.823906  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet eed0026bd9c541b7b89c956e31761d54, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.033591 11249 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.325755  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 195) took 1073 ms. Trace:
I20260501 14:00:04.034227  7574 rpcz_store.cc:276] 0501 14:00:02.252307 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.252446 (+   139us) service_pool.cc:224] Handling call
0501 14:00:03.325660 (+1073214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54270,"reported_tablets":4}
I20260501 14:00:03.523263 11318 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:03.332196  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 541794us
I20260501 14:00:03.848196  7819 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:03.197011  7752 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:03.852116  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:03.851922 11243 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:03.852542  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:03.852823  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:03.856498  7746 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:02.739806 10896 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.264144  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:03.864171  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.265786  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.266188 10896 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:04.266536  7825 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:04.267711  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.268529  7825 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:04.269351  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.270450  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:03.865011 11020 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.886132 10632 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.887216 11311 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:03.389884 11175 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:03.869626  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:03.870710  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:03.877115 11217 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:04.270715  7746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2897) took 1565 ms (client timeout 1523 ms). Trace:
I20260501 14:00:04.273844 11217 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.275064 11311 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:03.476802 11199 raft_consensus.cc:993] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: : Instructing follower 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 14:00:03.900357 11210 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:03.900458 11182 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.278048 11217 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.925213 11240 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.199576 11252 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.279614 11252 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.281327 10632 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.932348 11237 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.282930 11237 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.285157 11237 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:03.933261 11186 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:03.955767 11275 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.285908 11186 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.287256 11275 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:03.956398  8381 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:04.288868 11186 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.290184  7825 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:03.963351  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2569) took 1872 ms. Trace:
I20260501 14:00:03.963753  7753 raft_consensus.cc:2368] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 14:00:03.962998 11281 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.291105  7676 rpcz_store.cc:276] 0501 14:00:02.093124 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.093273 (+   149us) service_pool.cc:224] Handling call
0501 14:00:02.123652 (+ 30379us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:02.235715 (+112063us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:02.235764 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:02.236457 (+   693us) log.cc:844] Serialized 26 byte log entry
0501 14:00:02.251366 (+ 14909us) raft_consensus.cc:1645] Marking committed up to 2
0501 14:00:02.251416 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:02.657494 (+406078us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54003606d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:02.657560 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:03.627961 (+970401us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:03.963059 (+335098us) raft_consensus.cc:1685] finished
0501 14:00:03.963087 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:03.963277 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82285,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":10897,"spinlock_wait_cycles":221917312,"thread_start_us":19978,"threads_started":2,"wal-append.queue_time_us":330320}
W20260501 14:00:04.293009  7753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 797) took 1939 ms (client timeout 1883 ms). Trace:
W20260501 14:00:03.968997 11285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.434s	user 0.013s	sys 0.014s
W20260501 14:00:04.293475  7753 rpcz_store.cc:269] 0501 14:00:02.353702 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.353970 (+   268us) service_pool.cc:224] Handling call
0501 14:00:04.292781 (+1938811us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400106dd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:04.292931 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3681185664}
I20260501 14:00:04.293813  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:03.974280  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1599) took 1936 ms. Trace:
I20260501 14:00:03.979041 11286 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.294795  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.296075 11286 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.294648  7673 rpcz_store.cc:276] 0501 14:00:02.038068 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.038197 (+   129us) service_pool.cc:224] Handling call
0501 14:00:02.038567 (+   370us) raft_consensus.cc:1471] Updating replica for 3 ops
0501 14:00:02.074508 (+ 35941us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 14:00:02.247243 (+172735us) log.cc:844] Serialized 14 byte log entry
0501 14:00:02.355265 (+108022us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:02.358002 (+  2737us) log.cc:844] Serialized 52 byte log entry
0501 14:00:02.358148 (+   146us) raft_consensus.cc:1645] Marking committed up to 5
0501 14:00:02.358181 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:02.358252 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:02.646827 (+288575us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b180033e020. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:03.602527 (+955700us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:03.974021 (+371494us) raft_consensus.cc:1685] finished
0501 14:00:03.974048 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:03.974213 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294117,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":64,"raft.queue_time_us":12728,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":11261,"spinlock_wait_cycles":62486528,"thread_start_us":209349,"threads_started":2,"wal-append.queue_time_us":185365}
I20260501 14:00:03.980455  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 721) took 2233 ms. Trace:
I20260501 14:00:04.295653  7753 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:04.005561  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.297139  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.297914  7673 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:04.298223  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.298311  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.298802  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:03.656587 11335 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.017849 11216 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:04.299867  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.293844 11281 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.300266 11216 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.301373  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.301966  7753 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:03.695308 11337 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:03.987553  7754 rpcz_store.cc:276] 0501 14:00:01.971803 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:01.995535 (+ 23732us) service_pool.cc:224] Handling call
0501 14:00:02.004671 (+  9136us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:02.067596 (+ 62925us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:02.067629 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:02.090704 (+ 23075us) log.cc:844] Serialized 26 byte log entry
0501 14:00:02.286863 (+196159us) raft_consensus.cc:1645] Marking committed up to 4
0501 14:00:02.286911 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:02.286986 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:02.980418 (+693432us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:03.986672 (+1006254us) raft_consensus.cc:1685] finished
0501 14:00:03.986708 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:03.987001 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3396,"raft.queue_time_us":58371,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12478,"spinlock_wait_cycles":86601472,"thread_start_us":97866,"threads_started":1,"wal-append.queue_time_us":390139}
I20260501 14:00:04.302603  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.040493  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.300186 11335 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.302702 11216 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.303862  7754 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:03.976774 11290 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.303072 11337 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.306370 11290 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:03.933498  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:04.303352  7673 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:04.309846  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 376439us
I20260501 14:00:04.310331  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.311033  7673 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:04.311950  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.312546  7673 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:04.313424  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.314038  7673 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 14:00:04.314917  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:04.060299 11297 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:04.302870  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:04.316639  7753 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:04.320123 11217 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:04.320766 11217 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:04.321046  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:04.321636  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:04.321738 11217 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.329228 11315 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:04.329938 11315 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.299546  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.332435 11315 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.305331 11335 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.335068  8344 leader_election.cc:400] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 14:00:04.335489  8344 leader_election.cc:403] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260501 14:00:04.296862  7826 rpcz_store.cc:276] 0501 14:00:01.746675 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:01.746898 (+   223us) service_pool.cc:224] Handling call
0501 14:00:01.747294 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:01.891955 (+144661us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:01.896083 (+  4128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:01.925440 (+ 29357us) log.cc:844] Serialized 26 byte log entry
0501 14:00:02.473767 (+548327us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:02.473826 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:02.473924 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:03.211073 (+737149us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:03.980034 (+768961us) raft_consensus.cc:1685] finished
0501 14:00:03.980073 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:03.980361 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31679,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":11825,"spinlock_wait_cycles":10137856,"thread_start_us":629198,"threads_started":2,"wal-append.queue_time_us":630223}
I20260501 14:00:04.341763  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1860) took 1625 ms. Trace:
I20260501 14:00:04.342476  7820 rpcz_store.cc:276] 0501 14:00:02.716457 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.716646 (+   189us) service_pool.cc:224] Handling call
0501 14:00:02.717056 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:04.267223 (+1550167us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:04.267261 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:04.267781 (+   520us) log.cc:844] Serialized 26 byte log entry
0501 14:00:04.324221 (+ 56440us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b54003d9b20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa658a98 00007fb2fa6e1d0b 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc
0501 14:00:04.324292 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0501 14:00:04.324348 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:04.336266 (+ 11918us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002cced4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:04.336324 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:04.341439 (+  5115us) raft_consensus.cc:1685] finished
0501 14:00:04.341466 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:04.341652 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2045,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":3568875008,"thread_start_us":52451,"threads_started":1,"wal-append.queue_time_us":50802}
I20260501 14:00:04.368270 11186 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:04.369073  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.372970  8373 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 14:00:04.374619  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:04.375408  8376 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:04.052559 11299 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.220450  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.221659 11178 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:04.376466 11178 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.377374  7819 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260501 14:00:04.220755  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 101739us
I20260501 14:00:04.292025  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.379267 11299 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.380170  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.380653  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:04.381172  7675 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:04.220760 11333 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.391947  7676 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:04.378523 11178 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.392228 11333 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.394682 11333 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.062621 11262 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:04.219296  7752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2898) took 1505 ms (client timeout 1994 ms). Trace:
W20260501 14:00:04.395401  7752 rpcz_store.cc:269] 0501 14:00:02.714153 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.732404 (+ 18251us) service_pool.cc:224] Handling call
0501 14:00:04.219182 (+1486778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 14:00:04.397040  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:04.398659  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:04.220474  7678 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 14:00:04.222559  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.223258  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:04.088409 11232 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.401218 11232 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.401762  7826 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:04.223637  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:04.404088  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:04.404306  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:04.404912  7670 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:04.225090 11259 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.408288 11259 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.411451 11259 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.229133 11282 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.413444 11282 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.230245  7749 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:04.414710  7673 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:04.108314  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.416186  7679 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:04.417044  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.414346  7825 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:04.418365  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.419101  7679 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:04.122856  7576 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 3 to 4, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 4 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:04.232100 11336 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.233212  7747 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:04.110309  7677 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 3 FOLLOWER]: Advancing to term 4
I20260501 14:00:04.109181  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:04.183334  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.082108 11307 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.236462  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.069156  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.238581 11249 raft_consensus.cc:1064] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
W20260501 14:00:04.239537  7823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1690) took 1744 ms (client timeout 1515 ms). Trace:
I20260501 14:00:04.235227 11327 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.118294 11332 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.180881 11207 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:04.246249  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:04.240831 10905 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.243076 11193 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.245891 11179 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.244956 11322 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.245735 10903 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.246246 11323 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.244328 11300 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.246784 11329 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:04.247435 11330 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.257296 11211 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.259554 11271 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:04.262746  7643 leader_election.cc:400] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7.
W20260501 14:00:03.861151  7608 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1380 after lost signal to thread 6457
I20260501 14:00:04.485922  7643 leader_election.cc:403] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260501 14:00:04.487118  7608 debug-util.cc:398] Leaking SignalData structure 0x7b0800034760 after lost signal to thread 7611
W20260501 14:00:04.488878  7608 debug-util.cc:398] Leaking SignalData structure 0x7b08000834c0 after lost signal to thread 7703
W20260501 14:00:04.452600  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 70777.9us
I20260501 14:00:04.489835  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:04.273994  7746 rpcz_store.cc:269] 0501 14:00:02.705537 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.705672 (+   135us) service_pool.cc:224] Handling call
0501 14:00:04.270495 (+1564823us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54000ada54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:04.270624 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98352896}
I20260501 14:00:03.887143 11173 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.276160  7827 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:04.273238 11243 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.276811 11175 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.279059  7824 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:04.278915  8379 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:03.334818 11256 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.483263 11322 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.476260 10905 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.500614 11322 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.484407 11300 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.278100 11199 raft_consensus.cc:1081] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Signalling peer 109c9ba263c34ff8aee17bc446cf258e to start an election
I20260501 14:00:04.501734 10905 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.470780 11327 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.503062 11300 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.503557 11232 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:04.281862 11252 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.503914 11327 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.304037  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:04.504725  7821 raft_consensus.cc:2368] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10.
I20260501 14:00:04.504657  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:04.308655  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:04.483700 11323 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.507604  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.508188  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.308913 11337 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.381369 11299 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.381939  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.509263 11323 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.478262 11259 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:04.510275 11259 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:04.510648 11259 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:04.383862  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:04.055205 11318 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.505402  8375 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:04.512936  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.386533  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.513762  7825 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:04.389218 11186 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 14:00:04.389386 10896 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:04.399323  7675 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:04.518712  8344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.643s (SENT) [suppressed 37 similar messages]
I20260501 14:00:04.421475  7576 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 7, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 7 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:04.426298  7678 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:04.431113  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:04.439306  7672 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:04.453823  7674 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260501 14:00:04.443199  7676 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:04.453126  7823 rpcz_store.cc:269] 0501 14:00:02.495117 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:02.495280 (+   163us) service_pool.cc:224] Handling call
0501 14:00:04.239352 (+1744072us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400133dd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:04.239471 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3945319296}
I20260501 14:00:04.467315  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:04.471799  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 225612us
W20260501 14:00:04.488229  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 225616us
I20260501 14:00:04.478147 11179 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.529659  7672 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 14:00:04.530309 11179 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.487880 11330 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.520944  7576 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:04.532562  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:04.533150  7821 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:04.533416 11330 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:04.478003 11193 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.522492  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.522702  7679 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260501 14:00:04.536226  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.485291 11329 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.523052  7674 pending_rounds.cc:85] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:04.537298  7674 pending_rounds.cc:107] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260501 14:00:04.537532  7674 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:04.472031 11207 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.538174  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.539558  7819 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:04.491937 11211 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.536995  7826 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:04.541615  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:04.494114  7608 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7de0 after lost signal to thread 7778
I20260501 14:00:04.495469 11336 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 7
I20260501 14:00:04.485253 10903 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.497402 11319 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:04.524797  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:04.491864 11271 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.476431 11332 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.446874 11307 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:04.546247  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.498157  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.547012  7750 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:04.513098 11318 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.533556  7576 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 14:00:04.564851  7608 debug-util.cc:398] Leaking SignalData structure 0x7b0800330280 after lost signal to thread 7852
I20260501 14:00:04.465904  7673 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:04.565672  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.496335  7670 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:04.566548  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.567355  7826 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:04.562471  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 11, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 14:00:04.569263  7608 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7a40 after lost signal to thread 8405
W20260501 14:00:04.574010  7608 debug-util.cc:398] Leaking SignalData structure 0x7b080039af80 after lost signal to thread 11267
I20260501 14:00:04.570911  7576 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 6, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:04.578189  7576 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:04.584527  7821 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
W20260501 14:00:04.586786  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 62471.2us
I20260501 14:00:04.589872  8375 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:04.566434  7822 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:04.520681 11350 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:04.591279  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:04.592195  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 67508.4us
I20260501 14:00:04.598143  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.597515  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:04.598584  7677 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 14:00:04.604341  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.606523  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.604835  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:04.598086  7675 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:04.608966  7753 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:04.602728  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:04.617911  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:04.536258 11193 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.619711  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.622030  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:04.623574  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:04.599422 11299 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:04.622447  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.546278 11319 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.625628  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:04.622370  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 103695us
I20260501 14:00:04.598981 11173 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:04.599344 11323 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.177s
W20260501 14:00:05.128948 11356 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.104s	user 0.004s	sys 0.000s
I20260501 14:00:04.945505  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.764493  7672 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 14:00:05.166457  7576 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.085s	sys 0.099s
W20260501 14:00:05.177968  7576 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.086s	sys 0.099s
I20260501 14:00:04.802137  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.627166 11290 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.559s
I20260501 14:00:04.806721 11307 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.179450 11290 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:05.014568  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.179953 11290 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:04.862660 11207 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:04.770341  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:05.144876  7748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.008s
I20260501 14:00:04.631636  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:04.801353 11286 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:04.648936  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:04.703274 11285 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:05.182224 11286 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.626993 11252 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:05.182677 11285 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:05.183336 11252 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:04.616171 11232 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:05.183750 11252 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:05.184417 11232 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:05.184486 11286 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.702302 11020 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.484s
I20260501 14:00:04.930073 11271 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:05.118443  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.185210 10812 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:04.956358  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.602814 11337 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.574s
I20260501 14:00:04.747009  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.901014  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:04.714605  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:04.806026  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:04.869570  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.180783 11290 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.628832 11256 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:04.785772  8376 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:05.191401 11290 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:05.140089  7679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.006s
W20260501 14:00:05.192036  7679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.004s	sys 0.006s
I20260501 14:00:04.800645  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.193287  7749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:42716
I20260501 14:00:05.197926  7749 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:05.187580 10812 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:05.198519  7749 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:05.199436 10812 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:05.185634  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 415424us
I20260501 14:00:04.810761 11211 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.178560  7750 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:05.205509  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:04.705591 11319 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:04.965117 11175 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:04.628691 11275 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260501 14:00:05.057126 11353 log.cc:927] Time spent T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260501 14:00:04.916160 11329 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:04.804593  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2f80 after lost signal to thread 6457
I20260501 14:00:05.196261 11300 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:04.862933 10903 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.197357 11271 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:05.211191 11271 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:05.212018  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800324ca0 after lost signal to thread 7611
I20260501 14:00:04.814736  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:05.048000 11346 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260501 14:00:04.770875  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.208971 11173 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 14:00:05.212900  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.213176 11173 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:05.213570 11173 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:05.128238 11354 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.106s	user 0.004s	sys 0.000s
I20260501 14:00:05.212108 11271 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:04.654635  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:05.103950 11259 consensus_meta.cc:287] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.005s
I20260501 14:00:05.184808 11249 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:05.181607  7748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.002s	sys 0.009s
I20260501 14:00:05.204222  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "294b76c5890f455f97130fdbedace9af"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:04.602011 11350 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:05.182583  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 533725us
I20260501 14:00:04.705111 11327 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:04.706044 11282 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:04.877314 11332 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:05.207140  7749 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.210688 11300 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:05.196635  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 565090us
I20260501 14:00:05.228083 11350 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:05.245786  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:05.247504 11243 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:05.247925 11243 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:05.216279 11285 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.248308 11243 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:05.215215 11271 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:05.175413 11299 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:05.222708  7751 raft_consensus.cc:606] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.225719  7753 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:05.185350 11232 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:05.227914  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:05.228075  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 573775us
W20260501 14:00:05.209424 11336 consensus_meta.cc:287] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.007s
I20260501 14:00:05.243031  7750 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:05.244488 11327 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:05.212500  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080008d140 after lost signal to thread 7625
I20260501 14:00:05.252007  7749 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:05.253592  7754 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260501 14:00:05.260974  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:05.261588  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd720 after lost signal to thread 7703
W20260501 14:00:05.262455  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd240 after lost signal to thread 7746
I20260501 14:00:05.262372  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.256593  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.258714  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.241138 11175 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:05.263378  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800382b80 after lost signal to thread 7778
I20260501 14:00:05.245000 11300 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:05.264797 11252 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.265976 11290 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 14:00:05.257666  7747 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
W20260501 14:00:05.267288  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080037cf40 after lost signal to thread 7779
I20260501 14:00:05.264364  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:05.273677  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080039dae0 after lost signal to thread 7852
I20260501 14:00:05.216012 11259 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.269579  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:05.276252  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce0e0 after lost signal to thread 8405
I20260501 14:00:05.277663  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:05.279656  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.281628  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:05.279681  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080034a200 after lost signal to thread 8406
W20260501 14:00:05.282846  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800363d80 after lost signal to thread 10905
W20260501 14:00:05.283203  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2aa0 after lost signal to thread 11179
I20260501 14:00:05.283041  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:05.283490  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080023e1c0 after lost signal to thread 11184
W20260501 14:00:05.283797  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbf00 after lost signal to thread 11193
W20260501 14:00:05.284390  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080029ad20 after lost signal to thread 11205
W20260501 14:00:05.284745  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2f40 after lost signal to thread 11212
I20260501 14:00:05.283625  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:05.285219  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080036f160 after lost signal to thread 11229
W20260501 14:00:05.285557  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800366ca0 after lost signal to thread 11230
W20260501 14:00:05.285841  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800367960 after lost signal to thread 11236
W20260501 14:00:05.286213  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800332220 after lost signal to thread 11249
W20260501 14:00:05.286573  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08003f10e0 after lost signal to thread 11259
W20260501 14:00:05.286825  7700 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdce0 after lost signal to thread 11260
W20260501 14:00:05.287140  7700 debug-util.cc:398] Leaking SignalData structure 0x7b0800104d00 after lost signal to thread 11282
W20260501 14:00:05.287456  7700 debug-util.cc:398] Leaking SignalData structure 0x7b080034d280 after lost signal to thread 11286
I20260501 14:00:05.288585  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.289984  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.290710  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.291915  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.263469 11336 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 6. Current term is 7.
I20260501 14:00:05.292565  7821 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:05.294323  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.294919  7749 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:05.294323  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.297014  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.297457  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.298416  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.299592  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.302559  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.303313  7823 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:05.303419  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.267488 11237 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:05.303730  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.306102  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.289027  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.307068  7749 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:05.307468  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.309790  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3031b746c62f413a9da6fed211d638da"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:05.310601  7751 raft_consensus.cc:606] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.311039  7751 raft_consensus.cc:614] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:05.311348  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.309685  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.314205  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.315439  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.312827  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.277258 11256 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:05.315518  7819 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:05.318188  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.318609  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.317920  8376 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:05.301894 11175 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:05.309252 11217 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:05.301400 11297 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:05.304147 10632 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:05.327678  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.333770  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:05.338181  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75245.1us
I20260501 14:00:05.324353 11256 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:05.425247 11256 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:05.425467 11336 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:05.329460 11175 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:05.426049 11336 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.426601 11175 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:05.428314 10632 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:05.408555  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.318817 11232 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.340363  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.431335  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:05.433385  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:05.434733 11336 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:05.437139  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:05.428182  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:05.438006  7747 raft_consensus.cc:606] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.328279 11327 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.434746 11179 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:05.434005 11318 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:05.439131 11179 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:05.305009 11182 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:05.439906 11182 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:05.440503 11182 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:05.440091 11179 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.440835 11319 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.441923 11318 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:05.443048 11319 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:05.320788 11299 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.445317 11252 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:05.443065  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:05.423880  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2572) took 1171 ms. Trace:
I20260501 14:00:05.455564  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.456570  7754 raft_consensus.cc:2368] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:05.457664 11332 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:05.459537  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e99f3322c2477888132a818eae4971"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:05.459918 11259 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.460261  7824 raft_consensus.cc:606] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.452342  7672 rpcz_store.cc:276] 0501 14:00:04.252633 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:04.530472 (+277839us) service_pool.cc:224] Handling call
0501 14:00:04.530954 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:04.564343 (+ 33389us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:04.564373 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:04.595787 (+ 31414us) log.cc:844] Serialized 437 byte log entry
0501 14:00:04.764289 (+168502us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:05.243885 (+479596us) log.cc:844] Serialized 14 byte log entry
0501 14:00:05.252849 (+  8964us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:05.327611 (+ 74762us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54003ffcd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:05.327682 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:05.327747 (+    65us) raft_consensus.cc:1685] finished
0501 14:00:05.337694 (+  9947us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:05.423777 (+ 86083us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3750,"raft.queue_time_us":103,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5413,"spinlock_wait_cycles":63428992,"thread_start_us":168086,"threads_started":1,"wal-append.queue_time_us":359429}
I20260501 14:00:05.469554  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.471359  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.471755  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.472254  7822 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:05.473726  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.475009  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.475718  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.477113  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.478893  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.479947  7749 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:05.481462  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.481505  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.482822  7751 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:05.484057  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:05.489858  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 187509us
I20260501 14:00:05.463184 11300 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.480664 10632 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:05.500428  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.501221  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.500353  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.505026  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:05.505715  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.492551  7748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2905) took 1455 ms. Trace:
I20260501 14:00:05.507836  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:05.486063 11362 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.007s
I20260501 14:00:05.508814  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.509442  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:05.520498  7750 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.520656  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.522413  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.506968  7748 rpcz_store.cc:276] 0501 14:00:04.036621 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:04.332906 (+296285us) service_pool.cc:224] Handling call
0501 14:00:04.333275 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:04.535135 (+201860us) raft_consensus.cc:1534] Early marking committed up to index 5
0501 14:00:04.637566 (+102431us) log.cc:844] Serialized 14 byte log entry
0501 14:00:05.226376 (+588810us) log.cc:844] Serialized 14 byte log entry
0501 14:00:05.226965 (+   589us) log.cc:844] Serialized 14 byte log entry
0501 14:00:05.269883 (+ 42918us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002172a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2fa297110 00007fb2fa28a633 00007fb2fa28008a 00007fb2fa2805da 00007fb2fa6ebe0a 00007fb2fa6fb49f 00007fb2fa6fb418
0501 14:00:05.437629 (+167746us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b18002172a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:05.444135 (+  6506us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b48000f1a58. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2ff6191a1 00007fb2ff610237 00007fb2ff6100ca 00007fb2ff70792f 00007fb2ff7075f7 00007fb2ff71bc1c 00007fb2ff71bbc8 00007fb2ff71bb48 00007fb2ff71bb03 00007fb2ff71adac 00007fb2fe643b36
0501 14:00:05.445837 (+  1702us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b18002172a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7611be6 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01
0501 14:00:05.468957 (+ 23120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:05.469037 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0501 14:00:05.469090 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:05.492213 (+ 23123us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000af854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:05.492302 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:05.492471 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107174,"prepare.queue_time_us":482960,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":136,"raft.queue_time_us":74576,"raft.run_cpu_time_us":2935,"raft.run_wall_time_us":220480,"spinlock_wait_cycles":539719936,"thread_start_us":739729,"threads_started":3,"wal-append.queue_time_us":505736}
I20260501 14:00:05.512291  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.514938  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:05.526650  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.424819 11207 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:05.527603  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.526667  7747 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:05.529209  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.529839  7675 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 14:00:05.534260  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.536100  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.538700  7674 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:05.538945  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:05.540669  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.541100  7673 raft_consensus.cc:2368] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 14:00:05.539726  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.546190  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.546406  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:05.549614  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.496742 10903 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:05.459421 11243 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.546808  8380 raft_consensus.cc:2368] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:05.551187  7753 raft_consensus.cc:2368] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:05.446966 11323 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260501 14:00:05.551772  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.554379  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.561640  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.561686  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.562412  8377 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:05.563722  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.521993 11285 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:05.572705 10632 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.496907 11319 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260501 14:00:05.572803  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.497440 11175 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:05.568624  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 298516us
I20260501 14:00:05.492136 11256 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:05.576815  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.569664  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.577699  7676 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:05.583680  7747 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:05.553666 11282 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 14:00:05.584383  7718 leader_election.cc:400] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10.
I20260501 14:00:05.525337 11252 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:05.584298 10632 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:05.588068  8377 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260501 14:00:05.591288  7718 leader_election.cc:403] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260501 14:00:05.568156 11286 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:05.544945 11207 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.572808 11237 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:05.636682  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.631700  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:05.638000  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 113166us
I20260501 14:00:05.639132  8377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:05.632599  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.633982  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.639770  8377 raft_consensus.cc:606] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:05.640458  7822 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:05.641829  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.643425  7792 leader_election.cc:400] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:05.644362  7792 leader_election.cc:403] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:05.574775 11311 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260501 14:00:05.570926 10903 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.649277  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.649997 11282 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 14:00:05.646634  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.647197  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.646571  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.647430  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.593250 11307 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:05.645846  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.655702 11307 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:05.655938  7827 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:05.651392  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.656177 11307 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:05.656361  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:05.662196  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:05.654556  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.651645  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.665139 11307 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.668246 11350 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.670467 11350 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:05.580317 11371 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260501 14:00:05.672641  7826 raft_consensus.cc:2368] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:05.639277 11211 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10.
I20260501 14:00:05.640445 11237 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:05.680879  7671 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:05.685883  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:05.652985  7718 connection.cc:254] RPC call timeout handler was delayed by -1.5201783600000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260501 14:00:05.687693  7718 connection.cc:254] RPC call timeout handler was delayed by -1.5201783600000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260501 14:00:05.688016  7753 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:05.688117  7718 connection.cc:254] RPC call timeout handler was delayed by -1.4346783600000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260501 14:00:05.690050  7718 connection.cc:254] RPC call timeout handler was delayed by -1.0125783600000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260501 14:00:05.690073  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:05.692538  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:05.695588 11319 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:05.696988  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:05.697952 11319 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:05.698527 11319 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:05.698796  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:05.699142 11319 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:05.700716  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.654151 10905 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:05.630510 11336 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260501 14:00:05.626844 11252 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.720423  7827 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
W20260501 14:00:05.813585 11375 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260501 14:00:05.687781 11237 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:05.874715  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:05.667552 11173 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.680379 11282 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:05.832873  7745 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260501 14:00:05.833393  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:05.880618  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 47475.9us
W20260501 14:00:05.837567  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 175423us
W20260501 14:00:05.882318  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 313119us
I20260501 14:00:05.842265 10903 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:05.885852 11307 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.886175 11259 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:05.881273 11368 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:05.886857  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.844362 11175 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:05.847427 11297 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.002s
I20260501 14:00:05.888620 11297 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:05.848349 11300 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.834105 11290 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:05.853039 11243 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:05.889664 11319 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.890214 11243 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:05.855716 10632 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:05.890986 10632 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:05.891664  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:05.892266 11319 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:05.850977 11299 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
W20260501 14:00:05.862063  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 148606us
I20260501 14:00:05.892967 11299 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:05.876947  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:05.882633  7643 leader_election.cc:400] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:05.895027  7643 leader_election.cc:403] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260501 14:00:05.897791  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.898178  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.638754 11366 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260501 14:00:05.885581 11282 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:05.870162 11329 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:05.891868 10632 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:05.850101 11379 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:05.898840  7674 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:05.898985  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.909642  7677 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:05.909462  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.910530  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.910692  7675 raft_consensus.cc:2376] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10. Re-sending same reply.
I20260501 14:00:05.911177  7677 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:05.899493  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.899919  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.912165  7671 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:05.902915 10632 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:05.904685  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.906589  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.913870  8377 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:05.915333  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.908119  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:05.917826  7675 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:05.929113  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.929113  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.930439  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.939144  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.940326  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:05.931324  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.892968 11271 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:05.955857  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.942323  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.958781  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.965456  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:05.940732  7678 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 14:00:05.949860  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.952421  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:05.953745  7677 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:05.970305  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.971419  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.955339  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:05.972723  7677 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:05.972906  7674 raft_consensus.cc:2368] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:05.974400  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.975097  7671 raft_consensus.cc:2368] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:05.976227  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:05.978080 11249 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:05.932067 11175 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:05.978642  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.979463  7748 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:05.979193 11175 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.980118  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.981168  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:05.981352 11175 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.982618 11256 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:05.982365 11282 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.984315 11323 raft_consensus.cc:993] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:05.893957 11299 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:05.986804  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.997174  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.978607 11249 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:05.986831  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.981246  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:05.939085 11193 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
W20260501 14:00:06.044171  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 57419.9us
I20260501 14:00:05.998167  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:06.009246  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:06.045444  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.045509  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:05.889741 11290 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.043840  7672 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:05.978721  7676 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:06.051256  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.053020  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:05.970024 11380 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:05.995800 11271 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:06.066236  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:06.076414  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 154308us
I20260501 14:00:06.076572  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.078186  7675 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:06.002492 11336 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:06.079865 11336 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.080083  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:06.080427 11336 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:06.086323 11290 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:06.025298 11249 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:06.088770  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:06.089327 11387 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.003223 11207 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:06.080304 11178 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:06.094671  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.079157 11379 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:05.987504 10903 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:06.078269  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:06.149892  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 71728.3us
I20260501 14:00:06.053406 11175 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:06.046111 11193 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:05.997776 11020 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260501 14:00:06.058244 11350 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260501 14:00:06.145608  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 156872us
I20260501 14:00:06.146234  7670 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:06.163589  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.134783 11290 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.134444 11243 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.133106 11178 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:06.224146  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 60748.3us
W20260501 14:00:06.260221  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 122840us
I20260501 14:00:06.211515 11366 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260501 14:00:06.166302 11387 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:00:06.255313 11217 consensus_meta.cc:287] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.922s	user 0.006s	sys 0.007s
I20260501 14:00:06.222999 11173 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.244342 11379 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:06.269522  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.270558 11178 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:06.258016 10905 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
W20260501 14:00:06.332110  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 62435.3us
I20260501 14:00:06.333201  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:06.358582 11399 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260501 14:00:06.359242  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:06.335003 11252 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:06.360559 11390 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260501 14:00:06.362324  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.389426  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.256932 11271 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.260901 11403 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260501 14:00:06.329805 11217 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.334738 11243 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260501 14:00:06.334116 11175 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:06.267693 11336 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:06.323307 11182 consensus_meta.cc:287] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.882s	user 0.018s	sys 0.003s
I20260501 14:00:06.394574  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.337693 11211 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260501 14:00:06.369318 11387 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 14:00:06.396363  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 129545us
I20260501 14:00:06.392551 11252 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.406441  7823 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:06.394227 11379 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:06.409441  7643 leader_election.cc:400] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:06.398643 11175 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:06.411566  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.416522 11336 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.418088  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.428215  7750 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:06.429028 11384 raft_consensus.cc:993] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:06.438516 11350 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.439167 11350 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:06.443610  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.444233  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.445091  7822 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:06.446779  7819 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:06.443985  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 366483us
I20260501 14:00:06.448796  7822 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:06.448518  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.450209  7826 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:06.453466  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.404268 11256 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.455317  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.472687  8376 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:06.449355 11175 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:06.455701  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.444031 11290 raft_consensus.cc:993] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
W20260501 14:00:06.457475 11237 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260501 14:00:06.330369 11193 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.457993  8375 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260501 14:00:06.411605 11182 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:06.459075 11285 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.879s	user 0.008s	sys 0.002s
I20260501 14:00:06.451792 11252 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:06.459798 11380 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.460091 11336 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.460825  7750 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:06.496788 11290 raft_consensus.cc:1081] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:06.503764  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:06.464928 11384 raft_consensus.cc:1081] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:06.497148 11237 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.528543  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.474511  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.532088 11384 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:06.475800  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:06.476168  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.535955 11371 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:00:06.488492  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.494573  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.536917  7747 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:06.473616 11369 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260501 14:00:06.537591 11371 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:06.537987 11371 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:06.538830 11371 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.506357 11327 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:06.540096 11327 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.541790 11249 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.542335 11327 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:06.513458 11400 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260501 14:00:06.502944  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:06.502377  7746 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:06.501711 11319 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:06.488389 11323 raft_consensus.cc:1081] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:06.501641 11182 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.543566 11319 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.546372 11378 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260501 14:00:06.546702 11319 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:06.532140  7750 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260501 14:00:06.547436 11319 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:06.547998 11319 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:06.549489  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:06.549258 11319 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.537458  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.516446 11193 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:06.552317 11182 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.553892 11237 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.555040  8376 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:06.555428 11249 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.461395  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:06.556466  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 95185.4us
I20260501 14:00:06.557055 11252 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:06.557211  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.557992 11252 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.558444  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.559152 11252 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 14:00:06.559916 11395 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260501 14:00:06.562646  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:06.562968 11388 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260501 14:00:06.559659  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:06.564491 11311 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 14:00:06.551730 11350 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.564864 11311 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:06.565248  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.566443  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:06.567148 11398 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.306s	user 0.004s	sys 0.000s
I20260501 14:00:06.567299 11336 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.565275 11311 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:06.568104 11336 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:06.569736  7643 leader_election.cc:400] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:06.566238 11380 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.570046  7643 leader_election.cc:403] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:06.570612 11380 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:06.570676 11243 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:06.571029  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.566318 11350 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:06.571357 11243 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.544235 11371 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:06.572579  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:06.573376 11173 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.573573 11243 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:06.574828  8344 leader_election.cc:400] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7.
I20260501 14:00:06.577086  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.581502  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:06.584942  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:06.585728  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:06.586894  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.587486  7820 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:06.589483  8376 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 14:00:06.591784  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.595762  7745 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260501 14:00:06.596308  7745 pending_rounds.cc:85] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 6
I20260501 14:00:06.596691  7745 pending_rounds.cc:107] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260501 14:00:06.596879  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:06.597018  7745 raft_consensus.cc:2889] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:06.597091  7747 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:06.591264  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.578706  8377 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:06.602380  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.602744  7679 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:06.604012  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:06.605118 11402 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:06.605635 11402 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:06.606105 11402 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:06.607968  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:06.609016 11366 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 14:00:06.609654 11366 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:06.610813 11366 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.576885 11380 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:06.618773  7750 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260501 14:00:06.619619  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.546411 11178 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.580152 11336 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260501 14:00:06.629660  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:06.637249  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:06.638595  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:06.562148 11175 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.644826  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:06.640911  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.614230 11379 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.643235 10896 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:06.580365 11252 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260501 14:00:06.649222  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.658305  7750 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:06.653327  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:06.659096  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.654343  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.660048  7671 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:06.655650  7676 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:06.660986  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.656234  7677 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260501 14:00:06.661682  7676 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:06.662344  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:06.663113  7677 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:06.656221  7674 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:06.656622  7678 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:06.657222  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:06.668464  7670 raft_consensus.cc:2376] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9. Re-sending same reply.
I20260501 14:00:06.653703  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:06.660983  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:06.670051  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 94409.7us
I20260501 14:00:06.621006 11380 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:06.671489  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.624451 11387 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:06.652338 11420 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:06.676561  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.678632  7677 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:06.678658  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:06.624792 11299 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.681918  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.689328  7672 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:06.657831 11350 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:06.686508  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.658779 11384 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.704857  7671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43e99f3322c2477888132a818eae4971"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 14:00:06.705528  7671 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:06.705871  7671 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:06.692385  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.707162 10632 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:06.707733 10632 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.708382 10632 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:06.678840 11275 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:06.698506  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.700248  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:06.681778 11179 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:06.680352 11380 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:06.723593  8380 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:06.710204  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.687748  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:06.716301  7822 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:06.627997 11377 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260501 14:00:06.718612  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.728951 10632 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.709674 11408 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
W20260501 14:00:06.720212  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260501 14:00:06.733237  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 365625e9a5a1458e951f04698e1cc682, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:06.733585  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 365625e9a5a1458e951f04698e1cc682, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.733767  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.721580  8376 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:06.722312  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:06.691996 11237 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.659148 11379 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.725384  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.706967 11327 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:06.743999 11327 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.744433 11327 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:06.678972 11173 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260501 14:00:06.706877 11217 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.670714 10896 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.749123  7821 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:06.750243 10896 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:06.718930  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 60431.3us
I20260501 14:00:06.751734  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:06.752697 11336 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.753273  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.754812  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.682677 11271 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260501 14:00:06.732402  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.755540 11336 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:06.715417 11275 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.726598  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:06.756536 11275 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:06.756669 11423 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.757727  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:06.765566 11179 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.766050  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.767401 11350 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:06.766181 11179 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.767899 11350 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:06.768322 11350 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:06.772660  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.773617 11179 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:06.774093 11179 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:06.776595 11178 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.740839 11389 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260501 14:00:06.775187 11179 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.695900 11420 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.789799 11420 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:06.790936 11175 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.684787 11387 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.791473  7671 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.793462 11387 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:06.795472 11379 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.708328 11299 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.801397 11408 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:06.740963  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.737448 11290 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.729456 11384 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.808063 11182 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:06.809453 11327 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:06.811370  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 56661.9us
I20260501 14:00:06.814990 11259 raft_consensus.cc:993] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:06.830109 10632 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:06.820804  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:06.774114  7792 leader_election.cc:400] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:06.840292  7671 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:06.847436  7677 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:06.848682  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.834977  7820 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
W20260501 14:00:06.833804  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 93080.6us
W20260501 14:00:06.819993  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 76033.6us
W20260501 14:00:06.847218  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 73229.8us
I20260501 14:00:06.850503  7675 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:06.851534  7792 leader_election.cc:400] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:06.852815  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:06.853206  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:06.854808  7672 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:06.858685  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.859987  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:06.843909 11271 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:06.865530  7679 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:06.866428  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.868937  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:06.869644  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:06.877676  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:06.879312 10632 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:06.880072 10632 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:06.861061 11259 raft_consensus.cc:1081] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:06.865620  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:06.866065  7678 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:06.882304  8371 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:06.883028  7672 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:06.887940 10632 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.889181  7752 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:06.869364  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.811741 11275 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.890401 11419 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.870074 11290 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:06.890955  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.867195  7675 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:06.853205 11379 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260501 14:00:06.853380 11387 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260501 14:00:06.890784 11408 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.863075 11378 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
W20260501 14:00:06.891661  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:06.907147  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:06.895618  7746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2915) took 1995 ms (client timeout 1979 ms). Trace:
W20260501 14:00:06.908205  7746 rpcz_store.cc:269] 0501 14:00:04.900514 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:04.900667 (+   153us) service_pool.cc:224] Handling call
0501 14:00:06.895362 (+1994695us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540022c254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:06.895524 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020330880}
I20260501 14:00:06.908803  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:06.869127 11410 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:06.868541 11271 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:06.915208 11416 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260501 14:00:06.919849 10812 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:06.920650 10812 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:06.921933 10812 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.928869  7679 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260501 14:00:06.901213 11318 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:06.933311  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 77646.1us
I20260501 14:00:06.936501  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:06.942348 11432 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:06.924132 11378 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:06.950639  7820 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:06.977244  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:06.951969  7823 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:06.951283  7825 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:06.950112  7821 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260501 14:00:06.995297  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:06.943138 11432 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:06.924728 11297 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.925238 11271 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:06.907147 11350 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:06.931272 10896 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:06.934924 11259 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:06.994343 11243 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:06.999506 11410 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:07.025655  7672 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260501 14:00:06.980939 10905 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260501 14:00:06.950090 11290 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260501 14:00:07.000998 11372 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:07.014112 11186 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:07.014472 11366 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:07.031255  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 122574us
I20260501 14:00:07.040881  7678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "294b76c5890f455f97130fdbedace9af"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:07.041524  7678 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:07.041884  7678 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.023485 11020 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260501 14:00:07.047259  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.034644 11243 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260501 14:00:07.050689  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:07.050989  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.052124  7673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:07.052703  7673 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:07.053061  7673 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.053622 11350 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.037096 11366 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:07.054311 11366 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.035861 11410 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.038779 11186 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.056521  7671 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:07.052709  7674 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260501 14:00:07.057479  7676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:07.058892  7676 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:07.059285  7821 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:07.059219  7676 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.060088  8381 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:07.071444  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.069059  7673 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.073242  7748 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:07.075140 11186 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.039352 11299 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.028364 10896 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.030701 11311 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.079442  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.081216  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.078544  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.087363  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.088558  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.090595  7745 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:07.090919  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:07.089236  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.088816  7678 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.096468  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:07.097338  7671 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:07.083951  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.100126  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.104730  7753 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260501 14:00:07.104813  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.108186  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.112025  7678 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.110145  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.113359  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.115003  7676 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.116187  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.096474  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.059031 11327 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.116804  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:07.112581  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:07.119400  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.100984  7748 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:07.097807 11311 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.123162  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:07.111953 11424 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 14:00:07.128522 11427 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260501 14:00:07.128715  7674 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260501 14:00:07.130931 11429 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260501 14:00:07.046978 11259 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260501 14:00:07.132263  7676 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.039136 11372 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.113606  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:07.203564  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 90019.6us
I20260501 14:00:07.149307  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.112247 11350 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:07.225767  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 166125us
I20260501 14:00:07.112092 11379 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:07.219764  7820 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:07.247924  7820 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:07.229830  7745 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:07.079250 11290 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260501 14:00:07.241118  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.272523  7827 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.254859  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.273911  7819 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.107396 11275 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.278450  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.132151 11387 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:07.249066  7820 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.275192  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.286942  7748 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:07.287097  7820 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:07.287326  7748 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.267421  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.201454 11403 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:07.293291  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.294184  7745 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:07.294632  7745 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.111799 11299 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260501 14:00:07.290423  7748 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.298038  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.295670  7745 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.225739 11175 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:07.303803  7748 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.191910 11249 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260501 14:00:07.318187  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 320629us
I20260501 14:00:07.320281  7820 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:07.323942  7754 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:07.047415 11378 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:07.299425 11410 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.326323 11372 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:07.327448  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.328469 11243 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:07.328521 11432 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.331414 11366 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.292125 11379 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:07.270668 11350 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.353610  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.318380 11175 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:07.361409 11366 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:07.348721 11426 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260501 14:00:07.336073  7827 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:07.337742  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.367238  7753 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:07.368830  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.338109  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.339387  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:07.340018  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.293813 11403 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:07.309895 11411 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260501 14:00:07.269053 11420 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260501 14:00:07.347909  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 59160.8us
I20260501 14:00:07.415129  7748 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
W20260501 14:00:07.364182 11380 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.007s
I20260501 14:00:07.422797  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.430171  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.368283 10896 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:07.434028  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.436236  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:07.434939 11299 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260501 14:00:07.420670 11441 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:07.438315  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:07.432327 11451 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:07.435940 11379 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:07.432399 10905 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260501 14:00:07.440124 11422 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:07.452116 10905 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:07.452576 10905 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:07.453411 10905 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.431169 11387 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260501 14:00:07.439040 11178 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 14:00:07.451200  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 81002.7us
I20260501 14:00:07.428200 11380 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:07.457497 11402 consensus_meta.cc:287] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.004s
I20260501 14:00:07.456485 11397 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:07.464502 11451 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:07.467402 11422 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:07.495298  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 57061.6us
I20260501 14:00:07.496400  7670 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260501 14:00:07.497005  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:07.490541 11397 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:07.437747 11403 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.499249  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.441116 11175 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:07.503391  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.502733 11178 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 14:00:07.508390 11436 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.153s	user 0.001s	sys 0.007s
I20260501 14:00:07.510131 11422 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.511804 11319 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:07.506695 11379 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:07.516477  7819 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
W20260501 14:00:07.521845  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45532.1us
I20260501 14:00:07.522888  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:07.523519  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.480794 11453 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260501 14:00:07.491197 11384 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260501 14:00:07.498557 11451 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:07.528173  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 232586us
I20260501 14:00:07.529322  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.493646 11402 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.556006  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:07.558485  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.540513 11445 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:07.533129 11350 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:07.560117  7819 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:07.538203 11396 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:07.562373  7819 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:07.562608  7751 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:07.564158  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.525656 11394 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260501 14:00:07.572276  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:07.552135 11444 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:07.575950  7754 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:07.577276  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.578045  7672 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:07.576706  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.578845  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:07.579069  7827 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:07.579447  8377 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:07.580785  8380 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260501 14:00:07.580793  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.581408  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.584448  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.585276  7819 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260501 14:00:07.582046  7827 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.582638 11350 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:07.582726  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.587316  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.588742  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:07.590242  8380 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260501 14:00:07.590430  7674 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:07.590850  7674 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:07.592767  8379 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260501 14:00:07.593622  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:07.594367  7819 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 12. Ops: []
I20260501 14:00:07.594739  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.594938  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:07.596841  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:07.599296  7827 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:07.584885  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.591601  7674 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.600950  7674 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:07.604171  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:07.604583  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.604990  8374 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.573800 11173 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:07.610520  7819 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:07.611425  7827 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:07.581501 11178 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:07.617318  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.600833 11408 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:07.601486 11318 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:07.593201 11350 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:07.629966 11350 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.633122 11318 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.634454  8374 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:07.611696 11193 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:07.619386  7752 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260501 14:00:07.614095 11447 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260501 14:00:07.622561 11448 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260501 14:00:07.646324 11448 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:07.646803 11448 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:07.627442  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55249.9us
I20260501 14:00:07.616829 11173 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.648742 11368 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:07.649158 11368 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.649807 11173 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:07.650064 11368 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.620736 11178 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:07.651386 11368 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.651158  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:07.652187 11178 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.624766  7820 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:07.649749 11318 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.626508 10632 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:07.655345 11318 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.628187 11249 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:07.664605 11249 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:07.665174 11249 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.666245 11249 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.623137 11371 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:07.624528  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.656531 11384 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:07.668713 11384 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:07.669174 11384 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:07.671046 11457 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:07.620937 11458 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:07.656747 11402 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.620330 11243 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:07.671891 11458 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:07.672344 11458 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:07.669178  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44779.2us
I20260501 14:00:07.604595 11300 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:07.674062 11300 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:07.674450 11300 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.675295 11445 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:07.675833 11366 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:07.676852 11366 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:07.677225 11366 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.678007 11366 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.679154 11366 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:07.661374 11380 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:07.616420 11451 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:07.643613 11271 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.005s
I20260501 14:00:07.685940  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.693019 11318 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:07.693871 11394 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:07.700243 11271 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.701925  7747 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:07.702379  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:07.704176 11441 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:07.704419 11394 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:07.704819 11394 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:07.705662 11394 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.707844  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 503) took 1228 ms. Trace:
I20260501 14:00:07.708218  8381 rpcz_store.cc:276] 0501 14:00:06.479185 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:06.484080 (+  4895us) service_pool.cc:224] Handling call
0501 14:00:07.707634 (+1223554us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540051e5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:07.707739 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125593344}
I20260501 14:00:07.709801  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.711153  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:07.712086 11445 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:07.712491 11445 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:07.712545 11193 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:07.713639 11445 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:07.713847 11193 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:07.714265 11193 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.717538  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:07.717861 11448 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:07.717401 11439 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:07.718587 11448 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:07.719240 11448 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.719966 11439 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:07.720096 11448 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.723873  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:07.724639 11457 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:07.725891 11420 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:07.725831 11457 consensus_queue.cc:1059] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260501 14:00:07.685159 11249 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.726662  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.727054 11439 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:07.727475 11439 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:07.729452 11455 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260501 14:00:07.717461  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.730641 10903 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:07.730995 10903 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.731261 11243 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:07.732100 11243 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:07.732461 11243 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:07.731817 10903 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.733183 11243 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:07.733805 10903 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.734416 11243 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:07.702858 11397 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.735417 11397 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:07.736199 11439 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.737424 11439 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:07.742244  7670 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:07.743785  7674 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260501 14:00:07.744249  7674 pending_rounds.cc:85] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:07.744516  7674 pending_rounds.cc:107] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260501 14:00:07.744787  7674 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:07.746817  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:07.761547  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:07.762348  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 60064.3us
I20260501 14:00:07.762609  7745 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:07.762395  7676 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:07.774015  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:07.767637  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:07.859537  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:07.871309  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 244693us
W20260501 14:00:07.873824  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 106240us
I20260501 14:00:07.875604  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.881253  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.416518  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:07.909246  7673 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.917128  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2613) took 1264 ms. Trace:
I20260501 14:00:07.919020  7679 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:07.920585  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:07.922835  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.726536 11420 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:07.703001 11271 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:07.780773 11256 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260501 14:00:07.938459  7823 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260501 14:00:07.938862  7823 pending_rounds.cc:85] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 3
I20260501 14:00:07.939060  7823 pending_rounds.cc:107] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260501 14:00:07.939302  7823 raft_consensus.cc:2889] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:07.932960  7827 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:07.930347  7675 rpcz_store.cc:276] 0501 14:00:06.653073 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:06.653456 (+   383us) service_pool.cc:224] Handling call
0501 14:00:07.916599 (+1263143us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540004ddd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:07.917035 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416490880}
I20260501 14:00:07.890093 11380 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:07.926755 11217 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:07.947407  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:07.919746 11447 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:07.954535  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:07.962693 11237 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 14:00:07.967253 11380 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:07.967888 11380 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:07.969153  7745 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:07.969964 11464 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:07.970067 11380 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:07.973415 11450 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:07.918773 11311 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260501 14:00:07.937685 11299 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260501 14:00:07.990005  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:08.000555  7745 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 14:00:08.006652  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:07.982255  7827 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:07.995878  7828 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:08.013027  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:08.013999  7673 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
W20260501 14:00:08.015620  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:08.015498  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:07.949050 11217 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:08.017421  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:08.022238  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.995455 11237 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.025904 11186 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:08.026054 11237 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.015229 11466 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:08.028712  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:07.944876 11271 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260501 14:00:08.030411  8381 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:08.031744  8379 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:08.041913  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:08.045506  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:07.989426 11450 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:08.017069 11447 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:08.038630 11217 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:08.063141  7677 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 9. Ops: []
W20260501 14:00:08.066862  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 194585us
I20260501 14:00:08.028730 11237 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:07.992163 11464 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.079896  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:08.081316  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:08.082113  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 127714us
I20260501 14:00:08.082924  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:08.090406  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:08.094319  7672 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260501 14:00:08.068383 11299 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:08.024181 11445 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.088124 11350 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:08.170324 11474 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:08.122306  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:08.093808 11444 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 14:00:08.168345  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 78051.2us
W20260501 14:00:08.133391  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:08.036010 11420 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.199167  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.096349 11020 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260501 14:00:08.093813 11318 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260501 14:00:08.164340 11447 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260501 14:00:08.123070 11323 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260501 14:00:08.183296 11464 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:08.185077 11299 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.185525 11483 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.173298 11453 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:08.188356 11178 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.069321 11458 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:08.218166 11470 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260501 14:00:08.198236  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.219509  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1895) took 1104 ms. Trace:
I20260501 14:00:08.219615  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.220098 11299 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.220013  7746 rpcz_store.cc:276] 0501 14:00:07.115295 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.116364 (+  1069us) service_pool.cc:224] Handling call
0501 14:00:07.121844 (+  5480us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:07.427634 (+305790us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:07.427657 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:07.479291 (+ 51634us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b48000f1a58. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2ff6191a1 00007fb2ff610237 00007fb2ff6100ca 00007fb2ff70792f 00007fb2ff7075f7 00007fb2ff71bc1c 00007fb2ff71bbc8 00007fb2ff71bb48 00007fb2ff71bb03 00007fb2ff71adac 00007fb2fe643b36
0501 14:00:07.718103 (+238812us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b2c00010c48. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:00:07.718725 (+   622us) log.cc:844] Serialized 26 byte log entry
0501 14:00:07.944286 (+225561us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:07.944348 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:07.944455 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:08.219281 (+274826us) raft_consensus.cc:1685] finished
0501 14:00:08.219307 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:08.219449 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105050,"raft.queue_time_us":183380,"raft.run_cpu_time_us":3483,"raft.run_wall_time_us":169254,"spinlock_wait_cycles":13930752,"thread_start_us":425340,"threads_started":2,"wal-append.queue_time_us":316945}
I20260501 14:00:08.222198 11299 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.199973  7745 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:08.222795 11453 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:08.223378 11453 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.223865  7745 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:08.224232  7745 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:08.225636 11445 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.172936  7748 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260501 14:00:08.226238 11453 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.225754  7745 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.227460  7745 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:08.217864 11178 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.229799 11178 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.199782  7754 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:08.231594 11458 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.219547 11483 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.234591 11483 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.097393 11384 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.111680 11259 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.205655  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:08.172109  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 130271us
I20260501 14:00:08.195269 11444 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:08.221282  7753 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260501 14:00:08.204268  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:08.207387 11422 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.208799 11419 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:08.262161  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:08.204476  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 82282.7us
I20260501 14:00:08.256158  7821 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:08.258281  7753 pending_rounds.cc:85] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 6
I20260501 14:00:08.263411  7753 pending_rounds.cc:107] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260501 14:00:08.259811  7754 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:08.237005 11175 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.251731 11458 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:08.262301 11193 consensus_meta.cc:287] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.003s
I20260501 14:00:08.272680  7745 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260501 14:00:08.292862  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 88695.7us
I20260501 14:00:08.295025 11486 raft_consensus.cc:2764] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260501 14:00:08.310962  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:08.315675  7824 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 9. Ops: []
I20260501 14:00:08.260401 11444 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:08.316855 11481 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.317720  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.108300 11450 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.295733  7754 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:08.296008  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:08.294502  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:08.301247  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:08.125519 11300 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.317464 11481 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.319725 11466 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.263767  7753 raft_consensus.cc:2917] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260501 14:00:08.321822  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.322279  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.328678  7754 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260501 14:00:08.329126  7754 pending_rounds.cc:85] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 7
I20260501 14:00:08.329394  7754 pending_rounds.cc:107] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260501 14:00:08.329677  7754 raft_consensus.cc:2889] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:08.332051  7753 raft_consensus.cc:2889] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260501 14:00:08.335312  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 312666us
I20260501 14:00:08.342032  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:08.295208 11419 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:08.346346  7825 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 14:00:08.346379  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:08.325821 11193 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.351967 11323 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:08.352988 11193 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.347905 11488 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.353830  7751 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:08.353952 11488 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.261019 11259 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.358031  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:08.291883 11422 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.365855 11488 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.366868 11481 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.344107 11450 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:08.369055 11300 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.337037 11466 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.370833  7824 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:08.371676 11466 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.326627 11458 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.373562 11384 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:08.373890 11456 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.815s	user 0.001s	sys 0.010s
I20260501 14:00:08.322476 11175 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.375284 11458 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.375927 11175 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.376680 11419 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.377218  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:08.377552  7574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 196) took 4253 ms. Trace:
I20260501 14:00:08.377882  8381 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:08.378165 11259 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.382036 11494 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.383603  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2962) took 1043 ms. Trace:
I20260501 14:00:08.377935  7574 rpcz_store.cc:276] 0501 14:00:04.123798 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:04.124023 (+   225us) service_pool.cc:224] Handling call
0501 14:00:08.377464 (+4253441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1157628,"reported_tablets":1}
I20260501 14:00:08.384496  7747 rpcz_store.cc:276] 0501 14:00:07.340304 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.354700 (+ 14396us) service_pool.cc:224] Handling call
0501 14:00:07.419283 (+ 64583us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:07.702288 (+283005us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:08.383372 (+681084us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54000af854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:08.383543 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649531776}
W20260501 14:00:08.359578 11243 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.001s
I20260501 14:00:08.390666  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:08.392611  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:08.393391  8377 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:08.393214  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:08.393988  7825 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:08.394418 10903 consensus_meta.cc:287] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.012s
W20260501 14:00:08.363432 11480 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260501 14:00:08.395910  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 86732.6us
I20260501 14:00:08.397471  8374 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:08.394922 11300 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:08.399219  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 70743.4us
I20260501 14:00:08.389240 11488 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260501 14:00:08.430203  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:08.437247  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:08.412120  7825 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:08.390054 11387 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
W20260501 14:00:08.395293 11366 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260501 14:00:08.397441 11178 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:08.438681  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:08.447300  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:08.510728  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:08.444355 11387 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:08.423192 11300 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:08.575999 11491 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260501 14:00:08.473860 11178 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.574422 11493 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260501 14:00:08.476684  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:08.685711 11422 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.423779 11481 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:08.687383 11217 consensus_meta.cc:287] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.006s
I20260501 14:00:08.477423 11243 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
W20260501 14:00:08.688108  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:08.478206 11441 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260501 14:00:08.454618 11175 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:08.382575 11494 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.701323 11237 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.702623 11492 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.703262 11300 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:08.705705  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 229224us
I20260501 14:00:08.716562 11481 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.734336  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:08.708652  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 232074us
I20260501 14:00:08.707695 10632 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.736338 10632 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:08.711900 11465 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.588s	user 0.002s	sys 0.000s
W20260501 14:00:08.705837 11397 consensus_meta.cc:287] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.970s	user 0.024s	sys 0.000s
W20260501 14:00:08.717123  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:08.729280  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:08.793728  7674 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:08.793820 10632 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.731237  7673 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 14:00:08.716470 11489 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:08.718665 11496 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260501 14:00:08.733064 11237 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.737434  7671 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260501 14:00:08.796964  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:08.798048  7824 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:08.798161  7673 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:08.696851 11249 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.970s	user 0.018s	sys 0.003s
I20260501 14:00:08.743769  7679 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:08.735558 11481 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.803117  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:08.727658 11497 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.708693 11483 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260501 14:00:08.730022 11243 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:08.735571 11494 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.719338 11217 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.725883 11299 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260501 14:00:08.818935  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:08.829308  7678 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:08.796568 11489 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.808089 11450 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.739612 11175 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.792965 11492 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.800295 11449 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260501 14:00:08.838264 11249 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.871978 11449 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:08.805964 11384 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260501 14:00:08.805523 11327 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260501 14:00:08.878526  8371 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:08.828617 11479 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.873132 11445 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.838552 11300 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:08.873149 11449 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.899403 11300 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.854018 11489 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:08.885349 11450 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.818404 11497 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.897017 11492 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.895750 11445 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.898537 11175 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.863786 11249 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.894531 11479 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.899785 11178 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.900779 11449 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.906852 11450 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.901428 11300 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.803916  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:09.037238 11300 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:09.037879 11380 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:08.983256  7673 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:08.985821  7679 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
W20260501 14:00:08.993907  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.041553 11447 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.041935 11445 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.905907 11217 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:09.039296  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 235388us
I20260501 14:00:09.042544 11447 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:08.878357  7749 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:08.999563  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 264222us
W20260501 14:00:09.000458  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 259609us
I20260501 14:00:09.045608  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:09.005580  7824 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:09.005765  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.048015 11380 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 14:00:09.006942  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.050597 11380 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:09.042713 11445 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.053056 11445 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.008764  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.054925  7821 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:09.056504 11445 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.927484 11387 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.059051  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.060472  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:08.918558 11444 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.013s
I20260501 14:00:09.020774 10903 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.020550 11020 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:09.070313 11444 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.070813 11020 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.072834  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.073459 11020 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:08.904738 11237 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.076633  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.077657  8375 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:09.077754  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.079751  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:09.023465 11259 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.080475  8373 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260501 14:00:09.081192 11259 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:08.945698 11479 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.946732 11497 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.030042 11505 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.116492 11259 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.116413 11505 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.119324 11505 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.034544 11249 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:08.903680 11243 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.040657 11403 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:09.042713  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.122080 11513 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.123005 11513 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.124843  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.065791  7827 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:09.125993  7754 raft_consensus.cc:2410] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260501 14:00:09.066766  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.127568  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.128276  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.068758  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:09.085671  7825 raft_consensus.cc:2410] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260501 14:00:09.131244  8374 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:09.070327 10903 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.095587  8381 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:09.080492  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.103711  8375 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:09.067572 11447 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.121212  7821 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:09.062812  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.126019 11479 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.128433  7753 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:09.109117  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1648) took 2057 ms. Trace:
I20260501 14:00:09.134790  7822 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:09.155202 10903 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.156211  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1922) took 1418 ms. Trace:
I20260501 14:00:09.163683  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1912) took 1585 ms. Trace:
I20260501 14:00:09.164337  7828 rpcz_store.cc:276] 0501 14:00:07.578127 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.578567 (+   440us) service_pool.cc:224] Handling call
0501 14:00:07.603989 (+ 25422us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:08.016487 (+412498us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.163028 (+1146541us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54002e9854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.163436 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900704640}
I20260501 14:00:09.135427  7677 rpcz_store.cc:276] 0501 14:00:07.051158 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.051712 (+   554us) service_pool.cc:224] Handling call
0501 14:00:07.916771 (+865059us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:08.066245 (+149474us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.077570 (+1011325us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540004ddd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.096223 (+ 18653us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540004ddd0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:09.108848 (+ 12625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324763392}
I20260501 14:00:09.171952 11444 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.156711  7819 rpcz_store.cc:276] 0501 14:00:07.737904 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.738049 (+   145us) service_pool.cc:224] Handling call
0501 14:00:07.738375 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:07.738736 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:07.738762 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:07.739296 (+   534us) log.cc:844] Serialized 26 byte log entry
0501 14:00:09.155118 (+1415822us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800399340. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471
0501 14:00:09.155454 (+   336us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:09.155517 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.155621 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:09.155669 (+    48us) raft_consensus.cc:1685] finished
0501 14:00:09.155680 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:09.155994 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14816,"raft.queue_time_us":7533,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":106282,"spinlock_wait_cycles":5318528,"thread_start_us":145730,"threads_started":1,"wal-append.queue_time_us":198129,"wal-append.run_cpu_time_us":2244,"wal-append.run_wall_time_us":1112231}
I20260501 14:00:09.187543 10903 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.188367 10903 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.143167 11497 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.199333  7824 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:09.190784 10903 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:09.203611  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.211778 11497 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.208304 11513 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.214740 11497 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.217233 11207 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.218171 11207 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.223136  8374 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:09.221566  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 80460.6us
I20260501 14:00:09.227403  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.230576  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.233929 11402 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Stepping down as leader of term 4
I20260501 14:00:09.234584 11402 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:09.223419 11479 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.238242 11207 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.241879  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1654) took 1647 ms. Trace:
I20260501 14:00:09.242580 11402 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.244518 11377 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:09.245486 11377 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.247659  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.248353 11497 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:09.248672  7822 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:09.248839 11377 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.249354 11497 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.249914  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.250739  7822 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:09.254688 11489 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.255544  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.256500  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:09.242390  7672 rpcz_store.cc:276] 0501 14:00:07.594766 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.594876 (+   110us) service_pool.cc:224] Handling call
0501 14:00:07.595169 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:08.096840 (+501671us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.241348 (+1144508us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003f4154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.241691 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147251072}
I20260501 14:00:09.267295  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.262382  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.269922  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.251751 11497 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.273326  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:09.277951  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.268106 11479 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.279556  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.280776  7825 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:09.283200 11410 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260501 14:00:09.285642  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:09.286828  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.288913  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.289672  7827 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:09.294955 11394 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:09.296480  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.291543  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.298169  7825 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:09.300016  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.300997  7828 raft_consensus.cc:2410] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:09.300925  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.302204  7745 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:09.289666 11441 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:09.305429 11441 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:09.307175  7754 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:09.306725 11441 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.307940 11217 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.308801 11217 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.314031 11441 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:09.317855  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.323452 11387 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:09.328786  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 2970) took 1130 ms. Trace:
I20260501 14:00:09.329344  7752 rpcz_store.cc:276] 0501 14:00:08.198492 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:08.198755 (+   263us) service_pool.cc:224] Handling call
0501 14:00:08.199071 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:08.378981 (+179910us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:08.379014 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:08.379058 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:08.379089 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.328168 (+949079us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001072d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.328259 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:09.328537 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413316480}
I20260501 14:00:09.333295 11217 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.333778 11488 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:09.334563 11488 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:09.336160 11488 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.337638 11488 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:09.338371 11402 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:09.342666  7750 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:09.349936 11489 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
W20260501 14:00:09.351016  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.353543  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.354220  8371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 570) took 1099 ms. Trace:
I20260501 14:00:09.354629  8371 rpcz_store.cc:276] 0501 14:00:08.254828 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:08.255023 (+   195us) service_pool.cc:224] Handling call
0501 14:00:08.257532 (+  2509us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:08.885408 (+627876us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.353745 (+468337us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54004b1254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.354012 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427523840}
I20260501 14:00:09.355266  7750 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:09.356003 11366 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:09.356274  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.356583 11366 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.357120 10905 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:09.360833 11505 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:09.361562 11505 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.362699  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.363799  7828 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 7: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:09.365172  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.365424  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.366390  7828 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:09.367390 11505 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.376952  7748 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:09.377290  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 517) took 1370 ms. Trace:
I20260501 14:00:09.377557  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.377746  8379 rpcz_store.cc:276] 0501 14:00:08.006492 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:08.008145 (+  1653us) service_pool.cc:224] Handling call
0501 14:00:08.008513 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:08.032125 (+ 23612us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.376796 (+1344671us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b540051d954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.377070 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52580608}
I20260501 14:00:09.378298  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:09.380119  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1737) took 2141 ms. Trace:
I20260501 14:00:09.380566  7823 rpcz_store.cc:276] 0501 14:00:07.238439 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.238661 (+   222us) service_pool.cc:224] Handling call
0501 14:00:07.253739 (+ 15078us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:07.939752 (+686013us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:09.379542 (+1439790us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400133dd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:09.379890 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573789952}
I20260501 14:00:09.381125 11505 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.382385  7752 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:09.399964 11300 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.404098 11300 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.405027  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 2971) took 1199 ms. Trace:
I20260501 14:00:09.405507  7749 rpcz_store.cc:276] 0501 14:00:08.205279 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:08.205397 (+   118us) service_pool.cc:224] Handling call
0501 14:00:09.401421 (+1196024us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54003ad9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:09.404820 (+  3399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290235264}
I20260501 14:00:09.406672 11300 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.406935  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.407680  7749 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
W20260501 14:00:09.407829  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.411248  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.408188 11020 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.412379 11020 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.414736 11020 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.415454 11410 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.415654  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.415934 11513 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:09.416456 11513 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:09.416901 11513 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:09.418908  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.402616 11505 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:09.430467  7750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 1898) took 2185 ms (client timeout 1686 ms). Trace:
W20260501 14:00:09.430994  7750 rpcz_store.cc:269] 0501 14:00:07.245405 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:07.245549 (+   144us) service_pool.cc:224] Handling call
0501 14:00:09.430183 (+2184634us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b540012cfd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:09.430353 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4700180864}
I20260501 14:00:09.432219  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.432405 11419 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:09.435312  7751 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260501 14:00:09.436094  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.437029  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.438207  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.441016  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.441776  7750 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:09.442819  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:09.444021  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.444205 11366 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.444031  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.445363  7750 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:09.449411  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:09.450809 11476 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:09.452117  7752 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:09.453437 11458 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:09.456359 11311 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:09.460069  7827 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:09.424726 11410 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.455442  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.472281  7754 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:09.472551  7820 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:09.476778 11379 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.476989 11179 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.477618 11179 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.486617 11179 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.486742  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 282) took 5461 ms. Trace:
I20260501 14:00:09.483196  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.499001  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.509941  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.529624  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.536286  7672 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:09.539105  7748 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:09.477626 11379 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.541595  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.522957 11489 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:09.543763  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:09.545300 11419 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:09.553781  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:09.549917 11243 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:09.557624  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:09.557794 11243 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.558897 11487 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.559635 11487 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:09.562283  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:09.562832  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.563999 11237 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:09.564167 11475 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.564580 11237 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:09.564735  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.565086 11237 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:09.566100 11419 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:09.566421 11454 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.566622 11419 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:09.567123 11454 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.567984  7677 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:09.568919 11402 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.569454 11454 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.569604 11402 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:09.570297  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.570801 11379 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.570852  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.571270 11300 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:09.571727 11300 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:09.572296 11300 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:09.574080  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.491633  7576 rpcz_store.cc:276] 0501 14:00:04.024741 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:04.024945 (+   204us) service_pool.cc:224] Handling call
0501 14:00:09.486472 (+5461527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:05.167125 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:05.167975 (+   850us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:05.168027 (+    52us) write_op.cc:435] Acquired schema lock
0501 14:00:05.168053 (+    26us) tablet.cc:662] Decoding operations
0501 14:00:05.169508 (+  1455us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:05.169614 (+   106us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:05.169660 (+    46us) tablet.cc:685] Acquiring locks for 7 operations
0501 14:00:05.170485 (+   825us) tablet.cc:701] Row locks acquired
0501 14:00:05.170521 (+    36us) write_op.cc:260] PREPARE: finished
0501 14:00:05.170740 (+   219us) write_op.cc:270] Start()
0501 14:00:05.170901 (+   161us) write_op.cc:276] Timestamp: P: 1777644005170664 usec, L: 0
0501 14:00:05.170932 (+    31us) op_driver.cc:348] REPLICATION: starting
0501 14:00:05.229000 (+ 58068us) log.cc:844] Serialized 2835 byte log entry
0501 14:00:05.873066 (+644066us) op_driver.cc:464] REPLICATION: finished
0501 14:00:06.094463 (+221397us) write_op.cc:301] APPLY: starting
0501 14:00:06.097345 (+  2882us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:06.267255 (+169910us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:06.325527 (+ 58272us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:06.326467 (+   940us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:06.326758 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0501 14:00:06.326808 (+    50us) write_op.cc:312] APPLY: finished
0501 14:00:06.394612 (+ 67804us) log.cc:844] Serialized 59 byte log entry
0501 14:00:06.400822 (+  6210us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:06.406866 (+  6044us) write_op.cc:454] Released schema lock
0501 14:00:06.409246 (+  2380us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:06.456111 (+ 46865us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:06.456147 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":486618,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":174934,"apply.run_cpu_time_us":3741,"apply.run_wall_time_us":381294,"num_ops":7,"prepare.queue_time_us":565305,"prepare.run_cpu_time_us":14065,"prepare.run_wall_time_us":377002,"raft.queue_time_us":204133,"raft.run_cpu_time_us":19114,"raft.run_wall_time_us":101259,"replication_time_us":701955,"thread_start_us":1099760,"threads_started":4,"wal-append.queue_time_us":323003,"wal-append.run_cpu_time_us":74735,"wal-append.run_wall_time_us":1957748}]]}
I20260501 14:00:09.556571 11175 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.575150 11175 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.575935  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.549933  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.576671  7827 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:09.577373  7674 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:09.572139 11479 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:09.578333 11479 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:09.578805 11479 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:09.578938 11256 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.515615 10905 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260501 14:00:09.547374 11489 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:09.547538 11387 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:09.596323  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 52684.4us
I20260501 14:00:09.596572  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.556394 11505 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.553934 11458 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:09.591037  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:09.579759 11256 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.603509 11387 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.550863 11179 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260501 14:00:09.604979 11487 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.579774 11497 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:09.640270  7679 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260501 14:00:09.640661 11522 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260501 14:00:09.642047  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:09.643509  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.643868 11387 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.644198  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:09.647706 11327 raft_consensus.cc:2764] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260501 14:00:09.564877 11475 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.649307 11327 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:09.650695 11475 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.596238 11489 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:09.657398 11256 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.658301  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:09.659300 11475 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:09.660643 11175 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:09.662465  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 116694us
I20260501 14:00:09.662964 11173 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:09.663390 11173 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:09.607628 11243 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.590909 11379 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.664757  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:09.665261  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.554306 11410 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.616801 11420 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:09.629948  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.636935 11473 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:09.656937 11458 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:09.666580  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:09.680409  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.598438  7819 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:09.665364  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.677821  8374 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEARNER]: Advancing to term 8
I20260501 14:00:09.678059  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.678194  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.663734 11173 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:09.692149 11384 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:09.569139  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 10, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:09.697636 11458 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.688807  7825 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:09.689013  7672 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:09.704556  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:09.704838  7674 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 14:00:09.689757 11473 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:09.705986  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:09.706248 11473 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:09.690004  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:09.707023  7676 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:09.712790 11402 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.714416  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.678864 11217 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.664855 11379 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.706238 11441 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:09.767990  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:09.774461  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.776711  8374 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260501 14:00:09.777952  7753 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:09.768452 11403 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:09.782859  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:09.780802  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:09.785888  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 95985.5us
I20260501 14:00:09.788545  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:09.788841  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 73587.5us
I20260501 14:00:09.783648  7822 raft_consensus.cc:606] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:09.786909  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:09.685398 11419 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.775636 11441 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:09.799211  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:09.801826  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.809257  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.800462  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.811590  7826 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:09.773818 11217 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:09.814949  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.800235 11408 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.817166 11408 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.817965 11217 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:09.819233 11408 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.820075  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.820256  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.821521  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.822679  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.824435  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.825878  8379 raft_consensus.cc:2393] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:09.826879  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.827517  7674 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:09.829007  7577 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 5 to 6, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 6 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:09.831753  7745 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260501 14:00:09.832000 10896 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:09.833076 11419 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:09.833453 11528 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260501 14:00:09.834097  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.835228  7672 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:09.835181  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:09.836730  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.837965  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.838761 11473 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.841128  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.842249  7745 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 14:00:09.843190 11479 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.846233  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.847007 11479 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.847077  8379 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:09.846374 11473 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.848011  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.852274  8380 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:09.853377  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:09.809103 11366 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:09.862967  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.869760  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:09.885522 11300 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.890861  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:09.895174  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45304.6us
I20260501 14:00:09.880779  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:09.865002 11384 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.877671 11366 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:09.893982 11473 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:09.924430  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:09.925123  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44474.2us
I20260501 14:00:09.916049  7676 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:09.932062  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.898401 11476 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:09.937386  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.934127  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.941110  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:09.942559  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.943630  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:09.944175  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 90897.4us
I20260501 14:00:09.929528 11420 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.929775 11473 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:09.949793  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.949765  7826 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:09.950807  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:09.949558  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:09.954919  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:09.955515  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.957643  7825 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:09.940490 11243 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:09.971731 10632 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:09.972434  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.971804 11371 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:09.974908  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:09.899610 11441 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.974045 11371 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:09.979274 11182 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260501 14:00:09.968300 11473 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:09.986200 11379 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:09.987366 11300 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:09.980623 11488 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:09.973352 11366 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:09.975255  7643 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.130:41997 timed out after 1.686s (SENT) [suppressed 8 similar messages]
I20260501 14:00:09.980006 11371 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:09.991899 11513 consensus_meta.cc:287] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.001s
I20260501 14:00:09.977980 11476 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:09.999899  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:10.001482  7745 raft_consensus.cc:606] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.001845  7745 raft_consensus.cc:614] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:09.988305 11488 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:09.993574 11479 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:09.983371 11403 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:09.974284 11384 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:09.984392 11420 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.006654 11488 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.008200  7827 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 14:00:10.017633 11476 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.018172 11479 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.020140 11441 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:10.021114 11237 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.023056  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:10.003041 11513 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.018229  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:10.023041 11173 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.038013  7745 raft_consensus.cc:606] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.040428  7745 raft_consensus.cc:614] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:10.045498  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.032660 11403 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.043424 11311 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:10.049491  7750 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260501 14:00:10.061475 11420 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.051308 11311 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.067194 11311 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.063172 11182 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:10.070039 11182 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:10.062877 11488 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:10.075289  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.078572 11243 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:10.079119 11243 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:10.080536  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.081501  7753 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260501 14:00:10.083446  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.084142  7745 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:10.087054 11479 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.087769 11479 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:10.088894  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.090560 11173 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.071051 11182 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.097157  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:10.098347  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:10.106581 11384 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.111348 11237 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.065950 11489 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.116744  8372 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:10.117955 11489 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.119405  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.120298 11479 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:10.121524  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:10.125279  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.125885  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.101030  7752 raft_consensus.cc:606] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:10.128453  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 153225us
I20260501 14:00:10.128883  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.102133 11402 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:10.100445 11408 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260501 14:00:10.134034  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.091598 11419 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260501 14:00:10.135221  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68576.9us
I20260501 14:00:10.116788 11513 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.130306 11479 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:10.130045 11475 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 14:00:10.143162  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.134146 11402 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.101531 11410 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260501 14:00:10.134963 11300 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:10.156709  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:10.151356  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 210040us
I20260501 14:00:10.167991  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.157182  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:10.141898 11479 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.147639 11182 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:10.172638  7828 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:10.173386  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.173971  7820 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:10.143882 11475 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:10.164961 11530 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
W20260501 14:00:10.163955 11529 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.084s	user 0.004s	sys 0.000s
W20260501 14:00:10.155670 11532 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
I20260501 14:00:10.177227  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:10.179245  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.179461  7827 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:10.161666 11371 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.179854  7822 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.148157 11402 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.176879  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.167130 11300 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.171545 11473 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.183033  7819 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:10.179409  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:10.174307 11479 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.185685  7825 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:10.175714 11475 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.196794  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:10.197597  7752 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.198050  7752 raft_consensus.cc:614] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:10.186305 11300 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.201907  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.205304  7825 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.202041 11387 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:10.212193  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.222402 11504 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:10.223186 11504 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.223807  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:10.224852 11451 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:10.225212  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:10.225883 11420 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:10.226490 11175 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:10.226922 11175 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.227275 11175 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.227334 11420 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:10.225284 11451 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:10.230619  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:10.232813  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47457.2us
I20260501 14:00:10.205864 11387 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.235743 11379 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:10.235987 11387 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:10.236392 11379 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.250425  7822 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:10.259230  7825 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:10.253664  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.225412 11504 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.264098 10896 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:10.268035  7749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee17e865655f4db7affb37902439a8be"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:10.230958 11451 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:10.269155  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:10.272490  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.274483  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.271466  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.284018  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:10.285483 11539 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.259s	user 0.000s	sys 0.002s
I20260501 14:00:10.285332 11243 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.288012 11366 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:10.288537 11410 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:10.289979 11311 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.292349 11379 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.227980 11420 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.270859  7749 raft_consensus.cc:606] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.295950 11441 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:10.297122 11329 raft_consensus.cc:2764] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260501 14:00:10.298774 10896 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:10.231218 11403 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.299497 11387 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.304528  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:10.340116  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.265100 11485 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:10.345495 11420 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.345796 11403 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.341317 11410 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:10.326516  7820 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:10.336373  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.337040  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.338459  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.341418  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.336004 11379 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:10.343084 11450 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:10.343720 10896 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.344892 11311 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.316128 11479 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.348661  7750 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:10.348170  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.334812  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.350286  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.356884  7745 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:10.350864  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 79529.3us
W20260501 14:00:10.351935  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 47513.7us
I20260501 14:00:10.346634 11410 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:10.359311  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.348609 11217 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:10.345513 11485 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.356889  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.353842 11379 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.374495  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.375805  7751 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:10.347144 11441 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.376075  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:10.383152 11387 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.384569 11379 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.367488 11402 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.355443 11550 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 14:00:10.367686 11366 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:10.368048 11473 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:10.417140  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.405550  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:10.372124 11485 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:10.423976  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 46652.1us
I20260501 14:00:10.367533 11300 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.405010 11403 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:10.402005 11550 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:10.441006 11394 raft_consensus.cc:993] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:10.440685 11486 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260501 14:00:10.440574  7823 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:10.430203 11552 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260501 14:00:10.442924  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.428983  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:10.448917  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 74481.4us
I20260501 14:00:10.420452 11366 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:10.446815 11473 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260501 14:00:10.455065 11179 raft_consensus.cc:1081] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:10.469154 11410 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.473835 11475 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.476753 11441 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.445850 11550 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:10.444872 11403 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.454304 11419 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260501 14:00:10.485491  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56641.5us
I20260501 14:00:10.445974 11402 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.480544  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.490442  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:10.494709  7828 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:10.465422 11366 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.431596 11451 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:10.509673  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 66816.8us
I20260501 14:00:10.490525 11403 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:10.518052  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.501786 11179 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:10.492170 11552 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:10.536742 11217 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:10.489777 11419 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.489355 11243 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.534888  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.484229 11175 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.555267  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.590070  7751 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:10.503567 11504 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260501 14:00:10.540699 11475 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:10.593750  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 133107us
I20260501 14:00:10.541296 11387 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:10.553246 11419 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:10.556571 11179 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260501 14:00:10.599046  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:10.602134  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 146384us
I20260501 14:00:10.602814  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.539240 10905 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260501 14:00:10.604231  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 113873us
I20260501 14:00:10.604936  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.557408 11479 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.606770  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.598007 11387 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:10.609298 11387 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:10.609625 11552 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:10.609869  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.607455  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.613448  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.613786  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.616293 11445 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:10.604609 11179 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.618207  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.611282 11243 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:10.612112 11552 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:10.619899 11179 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:10.620536 11555 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260501 14:00:10.617271 11402 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:10.624501 11504 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:10.624651  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.626034  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.626250 11311 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:10.626662 11311 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:10.626869 11182 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:10.627050 11311 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.627332 11182 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:10.627760 11182 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:10.632629  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.633630  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:10.635008  7825 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:10.637557  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.638173  7820 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.608260 11475 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:10.656069  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:10.666540  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 52814.7us
I20260501 14:00:10.668988  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.672160  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.672988  7827 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:10.674145  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 119164us
I20260501 14:00:10.693408  7820 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:10.642541 11300 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:10.698832  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 66301.6us
I20260501 14:00:10.699529  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.653708 11243 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:10.705066 11182 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.706585 11243 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.707000 11179 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.708906 11182 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.710651  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 14:00:10.711972 11371 consensus_meta.cc:287] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260501 14:00:10.712435 11175 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.690534 11445 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:10.689447 11475 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:10.713833 11445 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.714102 11475 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.705003 11311 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.656544 11402 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:10.670331 11217 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:10.737031  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.738229  7820 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:10.745543  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:10.746999  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.749936  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.751145  7822 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:10.750504  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.755414  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.761036  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.761802 11179 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.762638 11179 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:10.763043 11179 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.763411 11179 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.763803  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.768237  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.769156  7745 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:10.770493 11573 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:10.771138 11573 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.771497  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.771968 11175 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.773890 11458 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:10.774641 11458 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.773830 11179 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.776886 11458 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:10.784049  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 84607.5us
I20260501 14:00:10.784228 11402 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.786048  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:10.699319 11557 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:10.787752 11557 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:10.788174 11557 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:10.761108  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:10.749135 11451 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.761883  7753 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:10.795077 11329 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:10.806111  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.806973  7820 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:10.782195 11179 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.814076  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.817655 11568 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260501 14:00:10.811647 11552 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:10.759166 11300 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:10.824492  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.834800  7747 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:10.830119  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.830724  7751 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:10.819743 11419 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.803756 11573 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.847486  8371 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:10.825441 11488 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:10.800541 11387 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.852831  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:10.877863  8372 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:10.834015 11504 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:10.871995  7752 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260501 14:00:10.874538  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:10.853045  8380 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:10.833958 11402 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:10.825207 11451 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260501 14:00:10.879132  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:10.881930  7827 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:10.843295 11300 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:10.893591  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 67438.1us
I20260501 14:00:10.893940  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:10.853223 11488 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:10.829622 11329 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.890398 11504 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:10.912669  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:10.880898 11384 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260501 14:00:10.917155  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:10.917954  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:10.918176 10905 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:10.919067 11550 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:10.945907 11576 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260501 14:00:10.946961 11550 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.914036  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:10.947966  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:10.948153  7672 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:10.902165 11488 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:10.921341 11580 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:10.921691  8380 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260501 14:00:10.952365 11580 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.917954  7677 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:10.953419  8380 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:10.953760 11300 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.954542 11580 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.923995 11485 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.924583  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:10.924902  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:10.956504  7819 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:10.956817  8373 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:10.957618 11387 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.903112 11402 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:10.960232 11402 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:10.960578 11485 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:10.964883 11419 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:10.927524  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:10.928270  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:10.930923  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:10.938431  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:10.938859  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:10.940517 11384 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:10.921259 11403 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.998054  7670 raft_consensus.cc:2368] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:10.941408  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:10.920248  8379 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:10.971324  7753 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
W20260501 14:00:10.972831  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:10.973809  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:10.974509  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:11.003374  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:10.977845  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.978281  7745 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:10.978807  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54313us
I20260501 14:00:10.978919 11182 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:10.980986  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.981166  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:10.981725  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:10.982033  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.025843  7827 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:10.982466  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:10.983055  7822 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:11.026654  7820 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:10.923282 11366 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:10.983682  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.028303  7825 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:10.984690 11311 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.034500  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:10.985070 11175 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:10.989778  8376 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:10.990103  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:10.994526  7677 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:11.040797  8380 raft_consensus.cc:2393] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:11.022549  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.041617 10632 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:10.971920 11504 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:11.032749  7747 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:11.057160  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.057902  7819 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:10.972174 11243 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:11.063006  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.039788  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:11.031925  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:11.044937  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:11.046972  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:11.056654  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.058130  7748 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:11.073239  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.063772  7823 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 4.
I20260501 14:00:11.074106  7747 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:11.074034  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:10.993620 11384 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:11.078884  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:11.080940  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.081153  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.069104 10905 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260501 14:00:11.083168  7745 raft_consensus.cc:2368] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:11.027865 11402 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:11.086047  7672 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:11.083721  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.023408 11419 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:11.028090 11182 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:11.086643  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.109737  7752 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:11.109874  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.113855  7826 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:11.061388 11550 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.075415 10896 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:11.115473  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.106635 11243 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:11.033099 11371 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260501 14:00:11.130385  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:11.142673  7747 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:11.111702 11445 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:11.109098 11311 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:11.040395 11451 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:11.156652  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:11.134414  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.084422 11479 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:11.109690 11182 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:11.141124  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c445f628c10d40b5a232bb391c4c92de. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:00:11.160533  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 80259.3us
I20260501 14:00:11.148025  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.116252 11571 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:11.184036 11571 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:11.185086 11571 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.186460 11571 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:11.152539  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 313) took 6800 ms. Trace:
I20260501 14:00:11.156037  7825 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260501 14:00:11.084666 11485 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260501 14:00:11.132436  7573 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 5 to 8, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 8 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:11.188969 11485 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:11.189400 11485 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:11.190359 11485 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.141000 11585 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:11.147734 11568 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:11.158612 11311 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.164561  7748 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:11.106320 11564 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260501 14:00:11.170233  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.171217  7826 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:11.207973  7753 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:11.208221  7820 raft_consensus.cc:2368] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:11.208420  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:11.106101 11475 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260501 14:00:11.177520 11329 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.159164 11217 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:11.178292 11451 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.179921  7828 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260501 14:00:11.182019 11573 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.148445 11379 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:11.187039 11402 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:11.141472 11420 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.194010  7752 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:11.195039  7751 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:11.190866  7573 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 7 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:11.176153 11387 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:11.192196 11585 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.144834 11175 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:11.218123  7747 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:11.220098  7745 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:11.191741 11485 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:11.143428 11513 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260501 14:00:11.223079 11479 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:11.213224 10632 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:11.220837 11217 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:11.223990 11580 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:11.219187 11568 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.209829 11550 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.262300 11488 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.187480  7577 rpcz_store.cc:276] 0501 14:00:04.352146 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:04.352341 (+   195us) service_pool.cc:224] Handling call
0501 14:00:11.152442 (+6800101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:10.016576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:10.017388 (+   812us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:10.017463 (+    75us) write_op.cc:435] Acquired schema lock
0501 14:00:10.017484 (+    21us) tablet.cc:662] Decoding operations
0501 14:00:10.017985 (+   501us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:10.018096 (+   111us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:10.018143 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0501 14:00:10.018745 (+   602us) tablet.cc:701] Row locks acquired
0501 14:00:10.018772 (+    27us) write_op.cc:260] PREPARE: finished
0501 14:00:10.018981 (+   209us) write_op.cc:270] Start()
0501 14:00:10.019126 (+   145us) write_op.cc:276] Timestamp: P: 1777644010018901 usec, L: 0
0501 14:00:10.019181 (+    55us) op_driver.cc:348] REPLICATION: starting
0501 14:00:10.024967 (+  5786us) log.cc:844] Serialized 923 byte log entry
0501 14:00:10.159499 (+134532us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2f762682c 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab
0501 14:00:10.461762 (+302263us) op_driver.cc:464] REPLICATION: finished
0501 14:00:10.731671 (+269909us) write_op.cc:301] APPLY: starting
0501 14:00:10.758623 (+ 26952us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:10.778814 (+ 20191us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:10.778864 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:10.779452 (+   588us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:10.779757 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0501 14:00:10.779857 (+   100us) write_op.cc:312] APPLY: finished
0501 14:00:10.780162 (+   305us) log.cc:844] Serialized 29 byte log entry
0501 14:00:10.780410 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:10.780512 (+   102us) write_op.cc:454] Released schema lock
0501 14:00:10.780572 (+    60us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:10.781030 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:10.781062 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":170077,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":171891,"apply.run_cpu_time_us":2713,"apply.run_wall_time_us":84046,"num_ops":2,"prepare.queue_time_us":175127,"prepare.run_cpu_time_us":27528,"prepare.run_wall_time_us":248281,"raft.queue_time_us":123256,"raft.run_cpu_time_us":23934,"raft.run_wall_time_us":198097,"replication_time_us":410578,"spinlock_wait_cycles":28076928,"thread_start_us":417943,"threads_started":4,"wal-append.queue_time_us":250073}]]}
I20260501 14:00:11.242910 11458 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.247025 11564 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.299577  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.242475 11573 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.294569 11366 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.221468 11384 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.294899 10632 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.249500 11387 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.300876 11580 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:11.291954 11557 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.317970  7754 raft_consensus.cc:2368] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12.
I20260501 14:00:11.317826 11580 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.318813 11550 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.294747 11175 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.320369 11384 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:11.288905 11552 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:11.323618  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.325107  7825 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:11.286015 11479 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:11.265493 11379 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.333217  7821 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:11.332211  7676 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:11.305357 11408 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.268571 11420 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:11.343427  7825 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:11.305514 11403 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.274819 11243 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.352195 11419 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260501 14:00:11.355347 11585 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.357059 11568 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.341449 11552 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.362684 11597 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:11.363408 11597 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.359136 11175 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.311165 11458 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.373246  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:11.376423  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.379855  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.380930  7677 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:11.380023  7674 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:11.386350  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.387120  7672 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:11.387939  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.389604  7821 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:11.403736  7819 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:11.350737 11408 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.410161 11561 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:11.410744  7820 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:11.412094 11590 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260501 14:00:11.331946 11564 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:11.379081 11451 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:11.450860  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.417529 11552 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.375892 11479 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.362751 11473 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260501 14:00:11.383581 11311 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:11.558115  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:11.564918  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.617444  7748 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:11.359572 11217 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:11.615803  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:11.574138  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:11.622119  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 59893.7us
I20260501 14:00:11.640316  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.644196 11387 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.644318 11408 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.645068 11561 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:11.644917 11488 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.645658 11561 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:11.617621 11182 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.646798 11561 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:11.648325  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.648804 11564 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.648931 11182 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:11.650127  8375 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:11.650323 11597 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:11.658957 11504 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.575s	user 0.014s	sys 0.000s
I20260501 14:00:11.659888 11504 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.645694 11420 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.669654 11557 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.670797  7671 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:11.668766 11458 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:11.671865  7672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38226
I20260501 14:00:11.672204  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.672638  7672 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:11.673032  7672 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:11.673405  7678 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:11.673004  7677 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:11.631605  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:11.676134  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 45975.3us
W20260501 14:00:11.677626  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 119522us
I20260501 14:00:11.680962  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.682056  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.683132  7819 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260501 14:00:11.683938  7677 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:11.687772  7826 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:11.688308  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.688901  7678 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:11.697198  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:11.697954  7822 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:11.700109  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:11.702000  7826 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:11.708319  7677 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:11.709535  8375 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:11.704826  7672 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.715322  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:11.715925  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.716233  7678 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:11.721755  7672 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.722954  8372 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:11.716588  7670 raft_consensus.cc:2376] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8. Re-sending same reply.
I20260501 14:00:11.680493 11458 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:11.723760  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:11.729465  8371 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:11.732391  7678 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260501 14:00:11.738066  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.739620  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.741074  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:11.741881  7754 raft_consensus.cc:2368] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:11.742784  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:11.746855 10905 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:11.750483  7677 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:11.753691  7822 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:11.762032  7748 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:11.762502  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.761561  7750 raft_consensus.cc:2955] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:11.763113  7678 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:11.763278  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.764035  7670 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:11.758826 11419 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260501 14:00:11.771040  7678 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:11.772152  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.772929 11504 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.773135  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.773478  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.774202 10632 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.775043  7672 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:11.778718  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.784600  7672 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:11.786803  7677 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:11.777381 10632 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.804526  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.811642  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.719158 11445 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260501 14:00:11.778648 11379 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.831604  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.836583  7672 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:11.836959  7677 raft_consensus.cc:2368] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12.
I20260501 14:00:11.820811 11384 raft_consensus.cc:1064] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:00:11.841744  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.841550  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.842423  7677 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:11.842625  7672 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:11.811633 11458 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.830850  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.834324 10632 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.839833  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:11.841239  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.809204 11419 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:11.854575  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.856221  7672 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:11.875367  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:11.830423  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 84245.3us
W20260501 14:00:11.877198  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.880142  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.881865  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.883399  7678 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
W20260501 14:00:11.884508  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.885365  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:11.885516  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.852010 11403 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:11.888204 10632 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:11.894033  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:11.896306  7672 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:11.897519  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:11.889485 11403 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:11.957670  7676 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:11.948097  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.888288 11618 ts_tablet_manager.cc:933] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:11.880723 11419 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.846843 11458 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:11.950142  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.897998  7746 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260501 14:00:11.937630 11573 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:11.909505  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:11.908694  7677 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
W20260501 14:00:11.958062  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 60622.9us
W20260501 14:00:11.979029  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:11.988422  7676 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:11.995972  7679 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:11.960938 11403 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:11.903731 11329 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260501 14:00:11.998999  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.001200  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:12.002796  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 53331.3us
W20260501 14:00:11.988471 11608 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260501 14:00:12.004946  7672 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:12.005369  7672 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:12.003391  7677 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:11.961850 11619 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:12.009341  8344 leader_election.cc:400] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:12.009723  8344 leader_election.cc:403] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260501 14:00:12.010486  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 163953us
I20260501 14:00:12.012481  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:12.013864  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.014600  7822 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:12.019671  7672 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.025880  7672 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:12.023247  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.031977  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.032931 11419 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.030850  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:12.033336 11379 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:12.034144  7679 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260501 14:00:12.034807 11573 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:12.034689  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.037227  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:12.044152  7676 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:12.036803  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.045200 11408 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:12.045208 11379 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:12.045848 11408 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:12.046414 11379 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:12.050555  7751 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:12.059113  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:12.059113  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:12.059950  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.060374  7677 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:12.063566  7672 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:12.065526  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.066020  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:12.068274  8381 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:12.020694 11557 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:12.071111  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.021500 11604 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:12.071725  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:12.034713 11479 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:12.072044  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:12.102017  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.102799  7828 raft_consensus.cc:2368] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.104053  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.076126  7748 raft_consensus.cc:2368] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.076761  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:12.077217  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.078066  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.078238  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.079737  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:12.081526 11616 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260501 14:00:12.021727 11619 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260501 14:00:12.084649  7824 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260501 14:00:12.115622  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.046806 11408 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:12.089479 11613 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260501 14:00:12.095064  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.095973  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.096272  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1936) took 1116 ms. Trace:
I20260501 14:00:12.082639 10896 raft_consensus.cc:2955] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:12.129930  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:12.130770  7827 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:12.131124  7827 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:12.110668  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.112953  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:12.117278  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:12.118374  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.122208  7746 rpcz_store.cc:276] 0501 14:00:10.980284 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:10.982173 (+  1889us) service_pool.cc:224] Handling call
0501 14:00:10.982508 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:11.997855 (+1015347us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:12.095968 (+ 98113us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b540012cfd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:12.096192 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834346240}
I20260501 14:00:12.123210  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:12.127489  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:12.134483 11573 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:12.134660 11384 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.136281  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.137511  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.138584  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.139580  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:12.100477 11606 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.285s	user 0.003s	sys 0.000s
I20260501 14:00:12.140564  8374 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:12.141415  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 116631us
I20260501 14:00:12.143886  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.145108  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.145355  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:12.146137  8381 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260501 14:00:12.147486  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.150549  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:12.140385 11571 consensus_meta.cc:287] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.004s
I20260501 14:00:12.116683 11458 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:12.154776  7754 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 5.
I20260501 14:00:12.155073  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.158260  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:12.159288  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:12.110013  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 101664us
I20260501 14:00:12.161324  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.122702 11557 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:12.167418  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:12.176151  8374 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 5.
I20260501 14:00:12.161722  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.150503  7827 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.180414  7827 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.171420 11420 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:12.159408  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.180711  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.141628 11379 raft_consensus.cc:2764] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260501 14:00:12.180675  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:12.149281 11573 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:12.185292  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.159336 11488 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 14:00:12.171979 11618 tablet_copy_client.cc:323] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 14:00:12.232023 11594 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:12.232497  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.232108 11300 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:12.232952 11594 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:12.233994  7718 leader_election.cc:400] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12.
I20260501 14:00:12.234550 11300 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:12.251360  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.253144  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.258615  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.260149  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:12.268541  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.224700 11488 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:12.218214 11573 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:12.153347 11408 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:12.187973 11371 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260501 14:00:12.245054 11594 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:12.288793  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.266126 11473 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:12.271024 11410 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:12.271272 11300 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:12.290670 11475 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:12.195834 10632 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:12.211925 11403 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.270884 11419 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:12.268172 11450 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260501 14:00:12.314633  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 155012us
I20260501 14:00:12.254408 11597 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:12.322589  7827 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:12.323918  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.284847 11488 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:12.325537 10905 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:12.320405 10632 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.284209 11573 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:12.332240  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 147042us
I20260501 14:00:12.333684  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.317296 11300 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.334843  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.329599  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:12.336301 10905 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.338716  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.338939  7643 leader_election.cc:400] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.339347  7643 leader_election.cc:403] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260501 14:00:12.339007 10905 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.330338 11217 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.344664  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.333204 11419 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:12.331311 11597 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:12.347939  7643 leader_election.cc:400] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.348459 10632 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:12.376745  7643 leader_election.cc:403] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260501 14:00:12.341610 11636 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:12.352537 11612 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260501 14:00:12.330010 11557 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.340373 11619 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:12.376536 11450 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:12.388918 11475 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:12.355420 11403 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:12.405565  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 221971us
I20260501 14:00:12.316677 11594 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.340423 11504 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.358355 11458 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260501 14:00:12.360455 11623 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260501 14:00:12.324266 11410 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.342226 11567 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:12.372575 11627 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260501 14:00:12.338953 11300 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.381950 11597 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.432250 11597 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:12.378141 11379 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.346853 11639 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:12.434762 11604 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:12.434893 11639 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:12.435237 11604 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:12.436205 11604 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.436353 11639 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.437562 11604 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:12.438107 11631 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260501 14:00:12.445534 11410 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.428013 11567 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.413954  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:12.426221 11504 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260501 14:00:12.448799  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.449174 11567 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.449759 11567 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:12.450352 11567 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:12.450722 11567 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:12.451107 10905 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:12.453270  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:12.454197 11611 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.492s	user 0.002s	sys 0.007s
I20260501 14:00:12.416494  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:12.411420 11619 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:12.447443 11594 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:12.455772  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:12.415202 11636 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:12.456709 11630 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:12.468680 11630 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:12.469273 11630 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:12.469152 11636 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.471930  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 576) took 1535 ms. Trace:
I20260501 14:00:12.472062 11619 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.472412  7671 rpcz_store.cc:276] 0501 14:00:10.937041 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:10.937207 (+   166us) service_pool.cc:224] Handling call
0501 14:00:10.937587 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:11.671308 (+733721us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:12.471652 (+800344us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540024b154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:12.471864 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685332352}
I20260501 14:00:12.473088 11625 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:12.457396 11573 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.473788 11625 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.474761 11619 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:12.475390 11630 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.476759 11573 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.472863  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 585) took 1483 ms. Trace:
W20260501 14:00:12.478034 11617 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260501 14:00:12.478229 10905 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:12.478287  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:12.479765 11625 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:12.480365 11485 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:12.480566 11625 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:12.480787 11485 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:12.481024  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:12.481249 11485 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:12.481163 11625 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.481822 11617 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:12.482360 11617 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:12.483163 11617 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.483299 11625 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.484601 11488 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.471868 11476 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260501 14:00:12.497794 11300 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.504465 11504 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:12.504944 11504 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:12.505915 11504 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.507237 11504 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:12.380759  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.508450 11564 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:12.508931 11564 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:12.509100 11379 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:12.509518 11564 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:12.509764 11379 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:12.511641 10632 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:12.512107 10632 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:12.510848 11379 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.512923 10632 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.499931  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:12.509007  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 92620.7us
W20260501 14:00:12.515514  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 134836us
I20260501 14:00:12.488516  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.477790  8375 rpcz_store.cc:276] 0501 14:00:10.989646 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:10.989805 (+   159us) service_pool.cc:224] Handling call
0501 14:00:12.472425 (+1482620us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540049c0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:12.472727 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400854272}
W20260501 14:00:12.517741  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 174819us
I20260501 14:00:12.522889  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:12.531765  7821 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:12.539428 10632 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.523083 11580 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:12.549815  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.554893  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet c445f628c10d40b5a232bb391c4c92de from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 14:00:12.555584  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet c445f628c10d40b5a232bb391c4c92de from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-c445f628c10d40b5a232bb391c4c92de
W20260501 14:00:12.550366  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.520303 10896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45434 (request call id 25) took 2137 ms. Trace:
I20260501 14:00:12.529479 11311 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:12.551435  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.566475  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.567258  7746 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:12.567198  7643 leader_election.cc:400] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.568770  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.507390 11567 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.570571  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.565667 11311 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.573446  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:12.575742  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.563074 11625 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:12.576440  7821 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:12.584151  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.585263  7746 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:12.590886  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.572880 11573 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:12.571295 11488 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.569608 11646 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:12.595387  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:12.579628 11311 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.599862  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.572700 11420 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:12.611681  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:12.612957  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:12.596657 11573 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.677253  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.678735  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.679378  7745 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:12.677856  7821 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260501 14:00:12.685160  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 111788us
I20260501 14:00:12.592815 11625 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.689952 11630 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:12.676359 11488 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:12.680961 11573 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.696803  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:12.702034  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:12.695408 11479 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.002s
I20260501 14:00:12.671631 11410 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260501 14:00:12.708124  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 95091.7us
I20260501 14:00:12.715301  7819 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:12.694278 11300 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:12.716364  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 106772us
I20260501 14:00:12.690544 11630 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.725054  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:12.723965  7746 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:12.726469  7643 leader_election.cc:400] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12.
I20260501 14:00:12.727442  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.724066  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.710996 11545 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:12.696244 11420 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260501 14:00:12.715878 11597 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:12.712495 11513 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:12.733223  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:12.714394 11441 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:12.754520  7821 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:12.755585  7643 leader_election.cc:400] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8.
I20260501 14:00:12.753765  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:12.757926  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.760912 11657 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:12.785763 11597 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:12.728195 11402 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:12.820987  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 66525.3us
W20260501 14:00:12.824790  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 99516us
I20260501 14:00:12.720716 11488 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260501 14:00:12.734613 11243 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:12.755226 11513 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.832561  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:12.833315  7751 raft_consensus.cc:606] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.836333  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:12.770073 11617 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:12.770591 11585 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:12.768720 11479 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:12.819484 11371 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:12.824465 11561 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:12.858222  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 97103.1us
I20260501 14:00:12.858254  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:12.839133 11644 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260501 14:00:12.831105 11567 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:12.829078 11580 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:12.767963 11441 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.833091 11513 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:12.864746  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.838047 11651 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:12.830493 11408 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260501 14:00:12.537158 11643 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.319s
I20260501 14:00:12.872267  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:12.888752  7754 raft_consensus.cc:2368] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:12.844726 11617 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.885820  7748 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:12.890384  7792 leader_election.cc:400] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:12.891743  7792 leader_election.cc:403] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:12.830063 11402 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.891985  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:12.892462  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:12.898238  7822 raft_consensus.cc:606] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:12.849035 11488 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
W20260501 14:00:12.899232  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.838052 11243 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.560842 10896 rpcz_store.cc:276] 0501 14:00:10.357174 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:10.357490 (+   316us) service_pool.cc:224] Handling call
0501 14:00:10.540232 (+182742us) log.cc:844] Serialized 499 byte log entry
0501 14:00:10.789087 (+248855us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18000f20e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:10.973104 (+184017us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18000f20e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7611be6 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01
0501 14:00:10.987038 (+ 13934us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18000f20e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:12.487229 (+1500191us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8049,"mutex_wait_us":1508,"raft.queue_time_us":27390,"raft.run_cpu_time_us":2456,"raft.run_wall_time_us":157199,"spinlock_wait_cycles":76195712,"thread_start_us":280339,"threads_started":2,"wal-append.queue_time_us":150447,"wal-append.run_cpu_time_us":1640,"wal-append.run_wall_time_us":1007634}
I20260501 14:00:12.878245 11371 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:12.884258 11300 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:12.897194 11617 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:12.855988 11479 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.924561 11641 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260501 14:00:12.939103  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 182666us
I20260501 14:00:12.939978  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:12.900792 11488 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:12.947858 11649 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260501 14:00:12.950382 11571 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:12.952901 11441 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:12.761670 11657 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.955792 11657 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:12.960199 11642 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260501 14:00:12.961184 11479 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:12.962332 11647 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260501 14:00:12.963601 11630 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.918416 11371 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.940864 11597 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.941630 11564 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.968362 11488 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.969606 11488 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:12.970185 11564 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:12.970964  7753 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:12.884666 11580 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:12.973271 11580 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:12.884116 11561 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.981403 11243 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.981690 11561 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:12.753719 11545 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:12.935786 11625 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:12.991458  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:12.941129 11641 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:12.992327 11641 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:12.996599  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:13.000696 11670 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 14:00:13.000880  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 60978.8us
I20260501 14:00:12.965538 11371 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.002696  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.008738  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.018632  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.009788  7838 tablet_copy_source_session.cc:215] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:00:12.983598 11545 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.014461  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:13.016551 11485 consensus_meta.cc:287] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.004s
I20260501 14:00:13.025830 11670 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:13.026413 11485 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.027545  7821 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:13.036945 10905 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
W20260501 14:00:13.043866  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 185706us
I20260501 14:00:13.045367 11485 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:13.044690  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.046897 11545 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:13.046818  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.052331  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.027220 11646 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:13.056651  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.056571 11545 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:13.057601  8381 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:13.060334 11311 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.062486 11311 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.062402 11617 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:13.040575 11504 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.533s	user 0.015s	sys 0.000s
I20260501 14:00:13.066759  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.076973  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.072189  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:13.080750  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.081604  8374 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:13.082526  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:13.082629 11651 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.083210  7748 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:13.083375 11651 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.085722 11651 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:13.085592 11513 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.086691  7747 raft_consensus.cc:606] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:13.087085  7747 raft_consensus.cc:614] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:13.087670 11651 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election won for term 5
I20260501 14:00:13.088320 11651 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:13.077643  7826 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:13.090162 11651 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.091429  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:13.094440  7819 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:13.088543  8375 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:13.089083  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.095108  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.087810 11513 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:13.080080  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.099251  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.101485  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.102308  7672 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:13.104919  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.105540  7677 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:13.105758  7674 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
I20260501 14:00:13.108722  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.109405  7677 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:13.110235  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:13.112716  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.113451  8374 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:13.111315 11504 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:13.114229  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.114843  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.116029  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.116228 11617 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:13.117223  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.117797  7679 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:13.118089  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.093761 11646 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:13.118587  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.120133 11641 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.122267 11641 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:13.125671  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:13.128545  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.118646  7676 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10. Re-sending same reply.
I20260501 14:00:13.130678  7675 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:13.133417  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.134119  7819 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:13.134559  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.135140  7677 raft_consensus.cc:2376] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10. Re-sending same reply.
I20260501 14:00:13.136319  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.137245  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.139397  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:13.143409  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.143519  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:13.144125  7675 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:13.144659  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.065424 11636 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:13.147218  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.147645  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.147871  7672 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:13.149044  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.149935  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.160127  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:13.161810  7670 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:13.163456  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.164265  7824 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:13.164785  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:13.165913  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.166915  7679 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:13.164024  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.166285  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.168409  8375 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:13.169885  7754 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:13.173144  7751 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:13.176671  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.177366  7673 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260501 14:00:13.177778  7673 pending_rounds.cc:85] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 6
I20260501 14:00:13.178925  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.179674  7676 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:13.184074  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:13.182149  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:13.178069  7673 pending_rounds.cc:107] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260501 14:00:13.190698  7673 raft_consensus.cc:2889] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:13.191205  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.193011  7677 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:13.195106  7827 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:13.209050  7675 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260501 14:00:13.159531 11641 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:13.227881  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:13.235984  7678 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:13.236369  7678 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:13.150504 11504 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:13.237417  7827 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260501 14:00:13.243270  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:13.150910  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 246089us
I20260501 14:00:13.171452 11612 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:13.235595  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:13.244019  7751 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.246622  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.250089  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.253993  7677 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:13.260142  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.270162  7675 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:13.272466 11597 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 14:00:13.247545 11623 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260501 14:00:13.226605 11311 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:13.234930 11641 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:13.284312  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 56575.4us
I20260501 14:00:13.247447 11420 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:13.274330  7678 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.290984  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.252128 11639 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.264628 11604 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:13.246552 11637 consensus_queue.cc:1059] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260501 14:00:13.266157 11612 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:13.257692 11636 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:13.303377  7678 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:13.303571  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:13.253345 11504 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.292755 11641 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:13.351570  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 48101.9us
I20260501 14:00:13.360096  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:13.345579 11659 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260501 14:00:13.362933 11670 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:13.302348 11604 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:13.289916 11545 consensus_queue.cc:1059] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260501 14:00:13.305826 11311 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:13.307269 11643 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260501 14:00:13.368923  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:13.365764  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 116304us
I20260501 14:00:13.362213  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:13.362367 11623 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 14:00:13.417973  7678 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260501 14:00:13.418665  7678 pending_rounds.cc:85] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:13.418944  7678 pending_rounds.cc:107] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260501 14:00:13.419227  7678 raft_consensus.cc:2889] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:13.398877  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:13.386706 11573 consensus_meta.cc:287] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.005s
I20260501 14:00:13.304627 11639 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:13.441705  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44168.6us
I20260501 14:00:13.443094  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:13.395427 11604 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.360339 11636 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:13.486940  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 88160.5us
I20260501 14:00:13.489049  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:13.441998 11573 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:13.494490  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51450.7us
I20260501 14:00:13.495674  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.499711  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:13.499974  7672 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:13.441191 11597 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260501 14:00:13.495745 11687 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:13.502259 11311 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.506434 11573 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.506610  8372 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:13.507031 11691 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
W20260501 14:00:13.543165 11679 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260501 14:00:13.551267  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51627.8us
I20260501 14:00:13.502966 11420 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:13.550810 11504 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.560989 11695 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:13.513901 11691 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:13.549070 11545 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:13.565573 11639 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:13.572078 11690 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260501 14:00:13.573516 11687 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:13.574563 11585 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260501 14:00:13.584918  7671 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:13.555601 11618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c445f628c10d40b5a232bb391c4c92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:00:13.496188 11612 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:13.598295  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:13.562038 11597 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.609975  7676 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:13.611472  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.601742  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.612946  7671 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.617303  7678 raft_consensus.cc:2955] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:13.587112 11695 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:13.627110  7751 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:13.629000 11402 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:13.629877 11676 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.478s	user 0.002s	sys 0.000s
I20260501 14:00:13.593678 11643 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.646908 11695 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.651193 11643 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.634603 11689 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:13.653793 11643 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.654646 11686 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:13.655566 11691 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.595207 11646 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260501 14:00:13.662321 11687 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.678545  7671 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:13.620231 11573 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:13.682366 11573 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.604444 11651 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260501 14:00:13.684110 11651 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:13.684512 11651 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:13.684616 11573 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:13.686062 11681 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.422s	user 0.004s	sys 0.000s
I20260501 14:00:13.685619 11651 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.687251 11651 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:13.687196  7671 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260501 14:00:13.676244 11371 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.000s
W20260501 14:00:13.694392  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 139210us
W20260501 14:00:13.684546 11680 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.416s	user 0.004s	sys 0.000s
I20260501 14:00:13.681493 11691 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
W20260501 14:00:13.701664  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 84172.8us
I20260501 14:00:13.717144  7675 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260501 14:00:13.618821 11597 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.732589  8377 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260501 14:00:13.737898  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:13.738566  8377 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:13.738874  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:13.675601 11504 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260501 14:00:13.746054 11698 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:13.746837 11698 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:13.759665 11182 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.719198 11371 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.768169  8376 raft_consensus.cc:2368] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:13.741343 11545 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:13.771560 11545 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.774212 11545 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.782297 11371 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.783699 11641 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.786302 11641 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.792309  7677 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:13.793884  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.796813 11504 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:13.796948 11703 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:13.797574 11504 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.798183 11597 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:13.736244 11636 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:13.800642  7819 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260501 14:00:13.802482  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 557815us
I20260501 14:00:13.803547  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:13.804241  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.804955  7828 raft_consensus.cc:2368] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11.
I20260501 14:00:13.809103  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.811003  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:13.811596  7828 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.811996  7678 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:13.736675 11604 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.817094  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.760599 11182 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.819025  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.820304  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.822950  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:13.824051  8375 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:13.830122  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.836107  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:13.836827  7824 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.838979  8381 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:13.842581  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.854756 10632 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.855754 10632 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.862285  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:13.863018  7676 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:13.868765  8344 leader_election.cc:400] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11.
I20260501 14:00:13.869213  8344 leader_election.cc:403] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:13.871393  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:13.874282 10632 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:13.808584 11641 consensus_queue.cc:1059] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260501 14:00:13.843420  7671 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:13.887094  7674 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 14:00:13.838222 11504 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.908174  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.900615  7677 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:13.913635  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:13.914575  8381 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:13.867444  7828 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:13.915977  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.914672 11476 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:13.919245  7824 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:13.919559 11476 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:13.919960 11604 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:13.920886  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:13.921720  7823 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:13.921646 11476 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:13.949327  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:13.956741 11705 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260501 14:00:13.968736  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.817742 11698 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:13.976997  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 53381.8us
I20260501 14:00:13.913666 11617 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:13.923839 11667 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:13.978334  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:13.979120  7826 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:13.951964 11652 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:13.983871  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:13.985168  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:13.988862  7826 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260501 14:00:13.988724  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:13.992133  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.992906  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.993549 11182 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:13.994241  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:13.994194 11667 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.987679 11329 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:13.996408 11708 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260501 14:00:13.996532 11667 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:13.997076 11671 raft_consensus.cc:3055] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:13.997303  7826 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:13.997514 11671 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:13.998363  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:13.998449 11671 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.999902 11548 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:00:14.000023 11670 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:14.000635 11670 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.001055 11670 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:13.985052 11652 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.002218 11652 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:13.977391 11384 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:14.003084  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:14.006224  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.003623 11545 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.019433 11711 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:13.999974 11505 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:14.000662 11710 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
W20260501 14:00:14.008770 11640 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 1.292s	user 0.003s	sys 0.004s
I20260501 14:00:14.027005  7643 leader_election.cc:400] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:14.028182  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.028455  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.025056 11695 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:14.003794 11476 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:14.003140 11671 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
W20260501 14:00:14.041836 11648 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 1.318s	user 0.000s	sys 0.009s
I20260501 14:00:14.033721  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:14.029623 11182 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.026683 11711 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:14.032810 10896 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.008903 11504 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260501 14:00:14.057344 11182 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.065222 11711 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.066633 11182 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.067992 10896 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.070010 10896 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.047727 11695 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:14.020076 11597 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:14.072085 11597 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.072512 11597 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:14.051172  8371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 546) took 2315 ms. Trace:
I20260501 14:00:14.074625  8371 rpcz_store.cc:276] 0501 14:00:11.730869 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:11.731018 (+   149us) service_pool.cc:224] Handling call
0501 14:00:11.731387 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:11.748865 (+ 17478us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:11.748897 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:11.749392 (+   495us) log.cc:844] Serialized 26 byte log entry
0501 14:00:12.452410 (+703018us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18002beb20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:12.586241 (+133831us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:12.586294 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:12.586362 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:14.041179 (+1454817us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:14.045728 (+  4549us) raft_consensus.cc:1685] finished
0501 14:00:14.045752 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:14.045884 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11589,"raft.queue_time_us":42360,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":29547,"spinlock_wait_cycles":62954624,"thread_start_us":133623,"threads_started":1,"wal-append.queue_time_us":905261}
I20260501 14:00:14.085573 11548 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11.
I20260501 14:00:14.087736 11656 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:14.088176 11656 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:14.089021 11656 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.090564 11656 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.020360 11384 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.086083 11618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:51744 (request call id 1133) took 2372 ms. Trace:
I20260501 14:00:14.092101 11618 rpcz_store.cc:276] 0501 14:00:11.721287 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:11.732300 (+ 11013us) service_pool.cc:224] Handling call
0501 14:00:12.011990 (+279690us) ts_tablet_manager.cc:934] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
0501 14:00:13.183543 (+1171553us) tablet_copy_client.cc:368] Tablet copy session begun
0501 14:00:13.981939 (+798396us) tablet_metadata.cc:665] Metadata flushed
0501 14:00:13.986056 (+  4117us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 14:00:14.080425 (+ 94369us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 14:00:14.080769 (+   344us) tablet_replica.cc:206] Creating consensus instance
0501 14:00:14.081120 (+   351us) ts_tablet_manager.cc:989] Replica registered.
0501 14:00:14.081206 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":649,"tablet-copy.queue_time_us":84349,"thread_start_us":132172,"threads_started":2}
I20260501 14:00:14.093961 11618 tablet_copy_client.cc:806] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:00:14.094573 11618 tablet_copy_client.cc:670] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:00:14.054039  8377 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:14.095510  8375 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [4.7-5.8]
W20260501 14:00:14.099323  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:14.118815  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.119800  7822 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:14.009282 11667 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260501 14:00:14.127727  8372 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:14.071178 11695 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:13.990720 11617 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.134922 11617 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.129969 11652 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.122179 11485 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.136186 11485 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.137502  7828 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260501 14:00:14.138258 11485 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.138645 11652 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.023988 11545 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.139176  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.144353  7678 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:14.140447  7823 raft_consensus.cc:2410] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260501 14:00:14.140607  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.146443 11384 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.153261  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.154081  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1793) took 1016 ms. Trace:
I20260501 14:00:14.154327  7828 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:14.154469  7819 rpcz_store.cc:276] 0501 14:00:13.137520 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:13.137695 (+   175us) service_pool.cc:224] Handling call
0501 14:00:13.800358 (+662663us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:13.801876 (+  1518us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:14.153900 (+352024us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54002e9350. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:14.154022 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503787392}
I20260501 14:00:14.126966 11504 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260501 14:00:14.149752  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 893113us
I20260501 14:00:14.153270  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3050) took 1552 ms. Trace:
I20260501 14:00:14.147209 11545 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.156769  8377 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260501 14:00:14.150805 11696 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.569s	user 0.004s	sys 0.002s
I20260501 14:00:14.158638  7753 rpcz_store.cc:276] 0501 14:00:12.601213 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:12.601577 (+   364us) service_pool.cc:224] Handling call
0501 14:00:12.601984 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:12.971374 (+369390us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:14.153038 (+1181664us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003ad9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:14.153197 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848105728}
W20260501 14:00:14.193257 11682 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.924s	user 0.003s	sys 0.000s
I20260501 14:00:14.159684 11686 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260501 14:00:14.194382 11403 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.195021 11651 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:14.194958 11403 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:14.201382  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.177209 11639 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.178824 11402 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.179365 11513 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.179883 11612 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.182607 11561 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.184721  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1723) took 1050 ms. Trace:
I20260501 14:00:14.228284  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.240615  7749 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:14.158671 11594 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.238003 11561 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.244503 11561 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.244763 11403 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.225564  7679 rpcz_store.cc:276] 0501 14:00:13.133794 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:13.167612 (+ 33818us) service_pool.cc:224] Handling call
0501 14:00:13.192411 (+ 24799us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:13.228208 (+ 35797us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:13.228242 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:13.247774 (+ 19532us) log.cc:844] Serialized 52 byte log entry
0501 14:00:13.711233 (+463459us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800340b40. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:13.734659 (+ 23426us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:13.744294 (+  9635us) log.cc:844] Serialized 14 byte log entry
0501 14:00:13.808109 (+ 63815us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:13.808356 (+   247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:13.985839 (+177483us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:14.184478 (+198639us) raft_consensus.cc:1685] finished
0501 14:00:14.184503 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:14.184642 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99333,"prepare.queue_time_us":8932,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":117432,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":14205,"spinlock_wait_cycles":13761024,"thread_start_us":22388,"threads_started":1,"wal-append.queue_time_us":547933}
I20260501 14:00:14.198807 11670 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.248402  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:14.185171  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 158464us
I20260501 14:00:14.187146  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 1988) took 2820 ms. Trace:
I20260501 14:00:14.187597 11243 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:14.187984 11408 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:14.190312  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:14.261435  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 71190.9us
I20260501 14:00:14.191045 11450 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:14.191596 11479 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.192030 11473 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.192688 11300 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.158324 11579 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.198801  7823 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:14.157943 11691 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:14.195940  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1725) took 1061 ms. Trace:
I20260501 14:00:14.199744  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.170933 11504 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:14.200102  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.200739  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.210561  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.213429  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2689) took 1031 ms. Trace:
I20260501 14:00:14.217589  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.218564  7751 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:14.219149  7750 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:14.196635  8377 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260501 14:00:14.222499  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.222886  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.223474 10905 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.212980 11410 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:14.224824 11402 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.261526 11488 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.262068 11403 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:14.258854  7825 rpcz_store.cc:276] 0501 14:00:11.366297 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:11.368250 (+  1953us) service_pool.cc:224] Handling call
0501 14:00:11.380801 (+ 12551us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:11.566035 (+185234us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:11.566080 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:12.312542 (+746462us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b2c00163b48. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:00:12.313200 (+   658us) log.cc:844] Serialized 52 byte log entry
0501 14:00:12.574013 (+260813us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:12.574053 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:12.574123 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:13.899541 (+1325418us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:14.186885 (+287344us) raft_consensus.cc:1685] finished
0501 14:00:14.186910 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:14.187082 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51495,"raft.queue_time_us":43404,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"spinlock_wait_cycles":11010176,"thread_start_us":237512,"threads_started":1,"wal-append.queue_time_us":284675}
I20260501 14:00:14.252707 11618 tablet_copy_client.cc:538] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:00:14.269786  7826 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:14.239548 11612 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.257082 11671 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:14.225128 11513 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.258428  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.261252 11311 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.247725 11594 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.326467 11182 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.332198 11311 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.225334 11639 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:14.320374  7752 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:14.275548  7576 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 8, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:00:14.335350  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 112551us
I20260501 14:00:14.275132  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.335585  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.336526  7746 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:14.336634  7751 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:14.274971  7824 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:14.330502  7750 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260501 14:00:14.292131 11561 raft_consensus.cc:993] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:14.277700  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 302) took 8416 ms. Trace:
I20260501 14:00:14.332165 11637 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:14.331334 11488 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.333451 11182 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.320180 11504 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:14.326681 11671 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.338801  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:14.265070 11408 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.344486  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:14.369299  7678 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:14.372678  8372 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:14.273669 11479 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.399847 11479 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.402530 11182 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.356037 11379 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.404132  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.404315 11379 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.405010  7823 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:14.406865 11379 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.394333  7751 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
W20260501 14:00:14.328564  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 70231.2us
I20260501 14:00:14.273313  7670 rpcz_store.cc:276] 0501 14:00:13.134306 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:13.169828 (+ 35522us) service_pool.cc:224] Handling call
0501 14:00:13.170122 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:13.184161 (+ 14039us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:13.358296 (+174135us) log.cc:844] Serialized 14 byte log entry
0501 14:00:13.496597 (+138301us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:13.502278 (+  5681us) log.cc:844] Serialized 26 byte log entry
0501 14:00:13.502494 (+   216us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:13.502534 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:13.502612 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:14.150470 (+647858us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b24000f8a08. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7495e94 00007fb2f7493f9b 00007fb2f7522d39 00007fb2f75229c5 00007fb2f752200d 00007fb2fa2644ae 00007fb2fa27bc2c 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1
0501 14:00:14.195585 (+ 45115us) raft_consensus.cc:1685] finished
0501 14:00:14.195697 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:14.195872 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1667,"prepare.queue_time_us":398641,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":8868,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":12389,"spinlock_wait_cycles":18099840,"thread_start_us":195329,"threads_started":2,"wal-append.queue_time_us":117951}
I20260501 14:00:14.293581 11670 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.320914 11691 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.420213 11691 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.273326 11564 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260501 14:00:14.321411 10905 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.327217 11579 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.342818 11686 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.346776  7576 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:14.293813 11473 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.376941 11311 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.376621 11504 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.428658 11686 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.429998 11504 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:14.379791 11408 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.384935 11513 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.343951  7573 rpcz_store.cc:276] 0501 14:00:05.861280 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:05.861528 (+   248us) service_pool.cc:224] Handling call
0501 14:00:06.211589 (+350061us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:14.277594 (+8066005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:11.701332 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:11.851908 (+150576us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:11.872176 (+ 20268us) write_op.cc:435] Acquired schema lock
0501 14:00:11.874469 (+  2293us) tablet.cc:662] Decoding operations
0501 14:00:11.909594 (+ 35125us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:11.912919 (+  3325us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:11.940461 (+ 27542us) tablet.cc:685] Acquiring locks for 2 operations
0501 14:00:12.002487 (+ 62026us) tablet.cc:701] Row locks acquired
0501 14:00:12.002514 (+    27us) write_op.cc:260] PREPARE: finished
0501 14:00:12.012721 (+ 10207us) write_op.cc:270] Start()
0501 14:00:12.020033 (+  7312us) write_op.cc:276] Timestamp: P: 1777644012009687 usec, L: 0
0501 14:00:12.026081 (+  6048us) op_driver.cc:348] REPLICATION: starting
0501 14:00:12.100164 (+ 74083us) log.cc:844] Serialized 913 byte log entry
0501 14:00:13.111833 (+1011669us) op_driver.cc:464] REPLICATION: finished
0501 14:00:13.449134 (+337301us) write_op.cc:301] APPLY: starting
0501 14:00:13.452169 (+  3035us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:13.452345 (+   176us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:13.496114 (+ 43769us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:13.505316 (+  9202us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:13.505515 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0501 14:00:13.505567 (+    52us) write_op.cc:312] APPLY: finished
0501 14:00:13.505771 (+   204us) log.cc:844] Serialized 29 byte log entry
0501 14:00:13.505946 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:13.506067 (+   121us) write_op.cc:454] Released schema lock
0501 14:00:13.506112 (+    45us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:13.506540 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:13.506572 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61246,"reported_tablets":13,"spinlock_wait_cycles":226156288,"child_traces":[["op",{"apply.queue_time_us":313067,"apply.run_cpu_time_us":7796,"apply.run_wall_time_us":63507,"num_ops":2,"prepare.queue_time_us":334208,"prepare.run_cpu_time_us":35219,"prepare.run_wall_time_us":872451,"raft.queue_time_us":82456,"raft.run_cpu_time_us":57662,"raft.run_wall_time_us":294910,"replication_time_us":1013319,"thread_start_us":774449,"threads_started":4,"wal-append.queue_time_us":494318}]]}
I20260501 14:00:14.330751 11300 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.385743  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.433461  7754 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260501 14:00:14.433756  7748 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.434020  7754 pending_rounds.cc:85] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 6
I20260501 14:00:14.434382  7754 pending_rounds.cc:107] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260501 14:00:14.385967  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.434734  7754 raft_consensus.cc:2889] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:14.435160  7750 raft_consensus.cc:2368] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11.
I20260501 14:00:14.386299  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.436408  7746 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:14.437614  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.350389 11667 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:14.344543 11651 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:14.445145  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.389515 11618 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 14:00:14.390563 11561 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.358561 11217 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260501 14:00:14.393007 11639 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.394306 11402 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.396258 11594 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:14.370958 11671 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.397758 11612 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.409101  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.355664 11403 raft_consensus.cc:1081] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:14.407938  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.414517  7745 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:14.317107  7673 rpcz_store.cc:276] 0501 14:00:13.181601 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:13.285933 (+104332us) service_pool.cc:224] Handling call
0501 14:00:13.286375 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:13.385202 (+ 98827us) raft_consensus.cc:1534] Early marking committed up to index 6
0501 14:00:13.549007 (+163805us) log.cc:844] Serialized 14 byte log entry
0501 14:00:13.591092 (+ 42085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:13.591188 (+    96us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:13.591256 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:13.955766 (+364510us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b180042b200. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:14.213115 (+257349us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b54002ba7d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:14.213191 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:14.213353 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4901,"prepare.queue_time_us":209432,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":5121,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":4069,"spinlock_wait_cycles":237073920,"thread_start_us":146864,"threads_started":2,"wal-append.queue_time_us":11158}
I20260501 14:00:14.416698 11488 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.359248 11573 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260501 14:00:14.325311 11410 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.417975  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.290191 11243 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260501 14:00:14.423400  7576 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 5 to 6, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 6 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:14.483630  7576 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 8, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:14.485875  7576 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:14.425995  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.427767  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.428057 10905 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.440825  7746 raft_consensus.cc:2410] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260501 14:00:14.441725  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.448443  7826 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:14.451553  8374 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
W20260501 14:00:14.457018  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48043.6us
I20260501 14:00:14.431203 11597 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:14.457347  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 190272us
I20260501 14:00:14.470530 11594 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:14.511391  8344 leader_election.cc:400] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11.
I20260501 14:00:14.512602  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:14.513603 10905 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:14.464334  7748 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:14.465569  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:14.514192 10905 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.514566 10905 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:14.513511  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 87611.7us
I20260501 14:00:14.456875 11561 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.528890  7675 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:14.530829  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:14.519726  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:14.521930  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 170690us
I20260501 14:00:14.537743 10905 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.534977  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.515363 11473 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.516552 11594 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.541643  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.546677 10905 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.548139  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.548518  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.550173  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.550293  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.557468  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:14.558986  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.538467 11182 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:14.539748 11384 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:14.565230  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.524497 11612 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260501 14:00:14.525148 11564 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260501 14:00:14.562510 11505 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260501 14:00:14.555840 11573 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:14.605564 10905 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:14.545687 11693 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:14.546293 11594 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:14.551432 11637 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:14.547760 11402 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:14.607332  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:14.558785 11670 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:14.545111 11714 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260501 14:00:14.585974 11485 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.624260  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:14.614734 11679 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260501 14:00:14.561983 11617 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:14.567430 11384 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:14.567061 11182 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.614419 11579 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.635186  7824 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:14.629659  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.607918 11639 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.645771 11639 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.608614 11652 raft_consensus.cc:2764] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260501 14:00:14.571027 11311 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:14.614339 10896 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:14.566066 11379 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260501 14:00:14.620678 10905 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:14.654208  7750 raft_consensus.cc:606] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:14.630734  7753 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:14.628911 11573 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:14.654876  7750 raft_consensus.cc:614] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:14.657838 11488 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:14.633248 11300 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.630769 11686 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:14.656484  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 91346.7us
I20260501 14:00:14.662410  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:14.663264  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:14.664362  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.667073 10905 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:14.640504 11384 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:14.670130  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.670329  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.638134 11402 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:14.643203 11670 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:14.644289 11182 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.634352 11505 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260501 14:00:14.653616 11652 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.680521 11652 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.642526 11485 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.682721 11652 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.683979 11485 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:14.660547 11667 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:14.685500 11667 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:14.685573 10905 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:14.686666 10905 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.649839 11597 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.694774  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.695564  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.691432  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.697108  7746 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:14.698426  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.699985  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.701565  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:14.654193 10896 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:14.705650  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.708113  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.711862  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:14.714078  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 102789us
I20260501 14:00:14.667922 11488 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:14.714829  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.716717  7751 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:14.717617  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.718665  7754 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:14.671183 11545 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.718734  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.722644  7821 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:14.724344 11639 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.724532  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.725261  7675 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:14.705708 11410 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.726406 11545 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.726536 10896 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.702425 11723 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:14.728036 10896 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:14.728639  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:14.729295 11545 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.728415 11723 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.731931 11561 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.687980 11402 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.733186 11488 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.12, Last appended by leader: 12, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.734257 11488 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.734393 11723 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:14.735033 11723 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.740435  7675 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260501 14:00:14.742345 11717 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260501 14:00:14.693126 11686 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260501 14:00:14.743000  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.748123  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.749672  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.750278  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.751525  7670 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:14.756160  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:14.761577  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:14.761979  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.763077  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.763201  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:14.763933  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.764511  7677 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:14.765156  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.765852  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.769891 11691 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.771735  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.735462 11723 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.782249  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.783346  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.783396  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.791177  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.792973  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.794777  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:14.794902  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:14.796911  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.814617  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.818104  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:14.775909 11726 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.782721 11656 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:14.821404  7826 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:14.818900  7674 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
W20260501 14:00:14.835588  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:14.836486  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:14.807044 11617 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:14.867704  7828 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260501 14:00:14.825697  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.826347  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.828056  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.828148  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.829674 11217 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260501 14:00:14.819563 11485 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.787868 11597 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.837553  8381 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:14.806957 11714 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.771061 11671 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.836166 11505 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260501 14:00:14.842087 11719 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260501 14:00:14.833461 11651 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:14.836512 11726 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.839659 11689 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260501 14:00:14.843168  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.844067 11594 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.838110  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.848521  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:14.851641 11727 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260501 14:00:14.852088  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:14.904837  8377 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260501 14:00:14.853296 11182 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.862402 11723 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.870472  8373 raft_consensus.cc:2368] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
I20260501 14:00:14.870613  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.871599  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:14.872007  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46407.6us
I20260501 14:00:14.873301  7746 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:14.878454  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:14.907100  8371 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:14.907400  7828 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.882783  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.908407  7747 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:14.847455 11667 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.889297  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.866781 11402 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:14.870644 11656 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:14.870644 11735 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.878870 11731 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:14.901566  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.904959  8379 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:14.859274  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:14.929258  7750 raft_consensus.cc:606] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:14.885738 11711 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260501 14:00:14.910044  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.915078  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:14.915362  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.916374  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:14.933671  8373 raft_consensus.cc:2368] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:14.934015  7821 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.12-9.12]
I20260501 14:00:14.917629 11594 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.918354 11548 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:14.919569 11182 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:14.941452  7824 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:14.921821  8375 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:14.923367  8371 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:14.894469 11651 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.843664 11691 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.889726 11311 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260501 14:00:14.936087  7754 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:14.936065  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.937723  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:14.890159 11597 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.989331  8376 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:14.939462  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:14.892201 11384 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.993379 11594 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:14.993853 11594 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:14.994196 11594 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:14.994299 11384 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:14.915777  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:14.944119 11731 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:14.995440 11731 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:14.997880 11731 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.001808 11597 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.004671 11667 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:15.006124 11671 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.928812 11402 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.009094 11402 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:14.931128 11617 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.944330  7828 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
W20260501 14:00:14.944727  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 104557us
I20260501 14:00:14.978457  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee17e865655f4db7affb37902439a8be"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:14.973723 11548 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:14.893155 11714 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:14.984760  7749 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:14.981920  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:14.990871  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51479.9us
I20260501 14:00:15.018759  7746 raft_consensus.cc:606] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:14.952049 11651 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:15.025862  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 110171us
I20260501 14:00:15.038244  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.039535 11548 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.040091 11731 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:15.040531 11731 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:15.040874 11731 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.041270 11686 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:15.042732  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.044013  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.046921  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.048061  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:15.048607  7677 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 10
I20260501 14:00:15.027657  8379 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:14.933357 11693 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260501 14:00:15.050942  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:15.052044  7670 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:15.053678  7643 leader_election.cc:400] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:15.054003  7643 leader_election.cc:403] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:15.054322  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:14.951756 11726 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.056023  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.058528  7679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3df4d60525ad4852996138e9e813b608"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:15.059092  7679 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:15.059466  7679 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:14.983244 11723 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:15.060304  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:15.062366  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:15.063589  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:14.935778 11735 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.068178  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.073014 11504 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:15.075366  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.076588  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.085407  7824 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:15.077095  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.090122  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:15.087255 11311 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:15.092984  8380 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:15.097059  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.056797 11597 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:15.102330  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:15.106420  7677 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:15.096596  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:14.952925 11656 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:15.077602 11743 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260501 14:00:15.112061  7677 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260501 14:00:15.112424  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:15.115223 11749 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260501 14:00:15.121731  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.123490  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.122510  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.107841 11379 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:15.129877  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.128353  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.133914  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.111289 11726 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:15.120906 11734 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:15.139027  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:15.140686  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.088457 11723 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.143345  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:15.143906  7677 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260501 14:00:15.092864 11311 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.130674 11689 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:15.108057 11746 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260501 14:00:15.132220 11670 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:15.156692  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.131058 11458 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:15.114480 11597 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.140312 11730 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:15.146492 11693 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:15.144544 11182 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:15.151854 11734 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:15.181083 11730 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:15.154218 11485 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:15.165021 11217 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260501 14:00:15.219578  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58845.9us
I20260501 14:00:15.201229 11693 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:00:15.223290 11741 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260501 14:00:15.223701 11693 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.229331 11698 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:15.229866 11698 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:15.230870 11698 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.232491  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:15.234196 11698 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:15.159030 11748 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260501 14:00:15.240967 11311 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.244287 11723 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:15.179282 11735 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.249269  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:15.250253 11731 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:15.252483  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 267636us
W20260501 14:00:15.220767 11747 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260501 14:00:15.276489  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.274065  7670 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:15.286141  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.287935  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:15.288105  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:15.251567 11651 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:15.293030  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 70512.7us
I20260501 14:00:15.299188  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:15.301721  7748 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.275197 11731 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.277153 11243 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260501 14:00:15.296327 11594 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.309998 11594 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:15.316706 11731 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:15.317354 11731 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.318840  7749 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:15.322592  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.323647  7748 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:15.324826  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.325781 11656 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
W20260501 14:00:15.326107 11752 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260501 14:00:15.326534 11656 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:15.327695 11731 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.328831  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.328008 11656 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.330179  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.334888  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.336270  7671 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 14:00:15.335083  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.337111  7826 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 4.
I20260501 14:00:15.339747  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.342142  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.215641 11730 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.340894  7679 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.348209  7678 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260501 14:00:15.296473 11726 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:15.298463 11689 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:15.299755 11698 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:15.357065  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:15.357821  7749 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:15.358172  7749 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:15.348119 11747 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260501 14:00:15.359957  7679 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:15.351281  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 242090us
I20260501 14:00:15.355394  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:15.361145  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:15.366629  7826 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.366704  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.373742 11723 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:15.374346 11723 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.377394 11723 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.377463  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.378319  7671 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 6.
I20260501 14:00:15.347177 11693 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:15.359951  7749 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.381116  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.382675  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.384963 11505 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:15.385710 11505 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.351624 11504 raft_consensus.cc:2764] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260501 14:00:15.350433 11714 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:15.351661 11573 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:15.392557  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:15.395762  7749 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.400247 11505 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:15.398473 11693 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.401149 11651 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.405331  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.406384  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:15.403208  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:15.417891  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:15.418993  7671 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:15.422123  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.422835  7671 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:15.423384  7792 leader_election.cc:400] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
I20260501 14:00:15.423750  7792 leader_election.cc:403] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:15.424543  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:15.425804  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:15.428697  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.431764  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:15.432504  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:15.431680  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.432507  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:15.456200  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.457082  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:15.461607  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:15.349907 11734 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.458858  7675 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 14:00:15.452389  7749 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:15.459036  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:15.461719  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:15.416877 11748 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:15.431032 11561 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:15.452515 11597 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.453886 11573 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:15.463702  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:15.464260  7671 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.472028  8379 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:15.463647  7826 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:15.496871  7822 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:15.459271 11617 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
W20260501 14:00:15.506589  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50502.7us
I20260501 14:00:15.462853 11384 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:15.507367  7679 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:15.498508 10896 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:15.460752 11730 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.517711  8374 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260501 14:00:15.510088  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 154779us
I20260501 14:00:15.508488 11561 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:15.540701 11686 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
W20260501 14:00:15.540951 11767 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260501 14:00:15.515837  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:15.527561  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:15.459507 11764 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:15.529978  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.511039 11597 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:15.530524 11545 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:15.531036 10896 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:15.508315 11748 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:15.543951 10896 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.510510  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.514712 11736 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:15.542541 11730 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:15.536327 11243 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260501 14:00:15.529385 11761 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260501 14:00:15.541010 11561 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:15.529382 11762 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260501 14:00:15.551525 11735 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:15.564357 11735 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:15.564904 11766 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260501 14:00:15.543388 11686 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:15.565361 11617 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:15.566435 11735 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:15.567052 11730 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:15.547279 11693 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:15.544503  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.451958 11689 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.547722  7822 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:15.516517  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.577292  7826 raft_consensus.cc:2410] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260501 14:00:15.548946  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 48877.1us
I20260501 14:00:15.549432  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:15.552657  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.553035  7753 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260501 14:00:15.536867  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:15.507156 11573 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.580392  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:15.548403 11545 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.548599 11711 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:15.561065 11384 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:15.563400  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:15.547590 11736 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:15.546509  7671 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:15.570353  7745 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:15.572088  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:15.557276 11488 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.007s
I20260501 14:00:15.582558  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.550024 11748 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:15.585378  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.586942  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:15.590175  7752 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:15.590225  7748 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:15.591429  7822 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 14:00:15.593237  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:15.593650  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 57210.2us
W20260501 14:00:15.595391 11769 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260501 14:00:15.596030 11723 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:15.596450 11545 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:15.596568 11723 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:15.591553  7677 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:15.598665  7674 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 12. Preceding OpId from leader: term: 10 index: 12. (term mismatch)
I20260501 14:00:15.594686  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.599120  7674 pending_rounds.cc:85] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 11
I20260501 14:00:15.599440  7674 pending_rounds.cc:107] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 9.12
I20260501 14:00:15.599707  7674 raft_consensus.cc:2889] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:15.600512  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.601898  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.602820  7679 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:15.568076 11730 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.606127  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.581473 11505 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:15.606928  7752 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:15.587711 11597 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:15.590732 11736 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:15.616315  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.617931  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.619235  7679 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:15.619676  7752 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:15.621331  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:15.621129  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:15.604041 11726 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:15.597573 11723 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.599583 11776 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:15.606735 11243 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:15.627223 11243 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:15.627656 11243 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:15.620656 11771 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:15.634822  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:15.639371 11774 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260501 14:00:15.609494 11783 raft_consensus.cc:2764] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260501 14:00:15.634656 11597 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:15.644423  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:15.645673  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:15.646126  8376 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:15.645476  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:15.646912  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:15.648097  8374 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260501 14:00:15.616868 11505 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.652441 11564 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader election won for term 6
I20260501 14:00:15.654229 11505 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:15.654333 11182 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:15.643652 11573 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:15.654861 11182 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:15.655295 11182 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:15.611302 11384 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260501 14:00:15.641738 11693 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:15.644111 11763 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:15.664345  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.659664 11564 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:15.671452 11564 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.674305 11402 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:15.675395 11402 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:15.656735 11749 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:15.675747 11402 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:15.675989 11749 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:15.676427 11749 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.676694 11402 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.678165 11402 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:15.648294 11597 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:15.679845 11597 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:15.684204 11763 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:15.684736 11763 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:15.686934  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:15.660073 11776 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260501 14:00:15.688692  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.689354  7826 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:15.694629  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.695586  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:15.696373  7822 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:15.698630  7822 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:15.704892  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:15.695696 11693 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:15.710263  7824 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:15.713009  7822 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260501 14:00:15.717543  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.722033  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:15.729791 11744 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.754s	user 0.007s	sys 0.000s
I20260501 14:00:15.668998 11686 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.734126 11686 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:15.736234 11693 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.744760 11651 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:15.745692 11651 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.747486  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.749025  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.749711  7679 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:15.754103  7671 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260501 14:00:15.748945  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.758301  7674 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:15.758594  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:15.764444  7822 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:15.764940  7822 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:15.765951  7822 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:15.768291  7822 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:15.757121  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:15.777297  7677 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260501 14:00:15.778947  7677 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:15.771797  7679 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:15.811837  8374 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:15.842375  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2715) took 1059 ms. Trace:
I20260501 14:00:15.783444 11780 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:15.793004 11771 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:15.842933  7672 rpcz_store.cc:276] 0501 14:00:14.758513 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:14.758628 (+   115us) service_pool.cc:224] Handling call
0501 14:00:15.817896 (+1059268us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54003601d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:15.818099 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145215872}
W20260501 14:00:15.846894  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:15.849042  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 156144us
W20260501 14:00:15.862910  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 280108us
I20260501 14:00:15.863838  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:15.867674  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:15.868610  8374 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:15.876684 11505 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 14:00:15.869447 11719 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260501 14:00:15.842083 11651 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:15.900256  7822 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260501 14:00:15.880784  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:15.903309  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:15.873737 11717 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260501 14:00:15.921245  7822 pending_rounds.cc:85] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 5
I20260501 14:00:15.813297 11243 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:15.925204  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44672.1us
I20260501 14:00:15.921798  7822 pending_rounds.cc:107] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260501 14:00:15.930482  7746 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260501 14:00:15.927799  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:15.932897 11771 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:15.933063  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 211151us
I20260501 14:00:15.933450 11771 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.934108  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.935077 11778 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:15.935536 11778 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:15.935680 11771 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:15.935644  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.936069 11778 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:15.937182 11771 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:15.938123  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.939514 11771 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:15.844282 11670 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260501 14:00:15.940527  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:15.924672 11651 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:15.953140  7822 raft_consensus.cc:2889] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:15.945348  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.958186  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.955892  7674 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:15.959782  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:15.963932  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:15.924952 11784 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:15.920030 11182 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.943627 11780 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:15.923802 11736 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.928231 11561 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:15.960991 11771 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:15.942253 11689 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260501 14:00:15.961153 11776 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:15.971004 11475 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:15.999253 11787 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260501 14:00:16.022871  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:15.945366 11726 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260501 14:00:15.783350 11488 consensus_queue.cc:1175] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "91854d93e96c4756834efe8b2ef59fce" responder_term: 10 status { last_received { term: 8 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.11-9.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260501 14:00:16.035498  7824 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:16.001413 11564 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:16.036900  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:16.044682  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 128611us
I20260501 14:00:16.049302 11670 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260501 14:00:16.077281  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:16.071909 11505 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
W20260501 14:00:16.120401 11790 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260501 14:00:16.120968 11505 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:16.122732 11182 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.122125 11505 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.126667 11597 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.058178 11783 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:16.128075 11783 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:16.128476 11783 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
W20260501 14:00:16.131467 11617 consensus_meta.cc:287] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
W20260501 14:00:16.137329  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 100504us
I20260501 14:00:16.141371  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:16.132369 11774 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260501 14:00:16.142310  7675 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 14:00:16.144659  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 180832us
I20260501 14:00:16.147375  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:16.148357  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:16.148597  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:16.148736 11776 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:16.149243  7822 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 7
W20260501 14:00:16.139644 11798 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260501 14:00:16.151620  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:16.143405 11810 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260501 14:00:16.160827  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:16.159973  7751 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:16.162915  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:16.162945  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:16.169831  7822 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:16.171247 11799 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:16.171764 11799 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:16.172150 11799 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:16.172261 11805 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260501 14:00:16.042383 11748 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.174254 11748 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.175027 11618 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:00:16.176173 11618 tablet_bootstrap.cc:492] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:00:16.175961 11771 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:16.176807 11771 raft_consensus.cc:993] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:16.177027 11618 ts_tablet_manager.cc:1403] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 1.788s	user 0.036s	sys 0.025s
I20260501 14:00:16.177214 11771 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:16.175102  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:16.179116  7749 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:16.177260 11811 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:16.192540 11564 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:16.182050 11780 raft_consensus.cc:1081] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:16.182780 11736 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:16.181892 11771 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:16.214941  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:16.176205 11794 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260501 14:00:16.208271 11564 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:16.175010 11778 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:16.242689  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 78092.2us
I20260501 14:00:16.204035 11776 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260501 14:00:16.215581 11561 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:16.282742  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 630) took 1235 ms. Trace:
I20260501 14:00:16.247676  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:16.291649  7825 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 6
I20260501 14:00:16.272316  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:16.297780  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 134936us
W20260501 14:00:16.302153  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 118573us
I20260501 14:00:16.240912 11564 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:16.291050  7676 rpcz_store.cc:276] 0501 14:00:15.047499 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:15.133583 (+ 86084us) service_pool.cc:224] Handling call
0501 14:00:15.133881 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:15.134149 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 7
0501 14:00:15.156505 (+ 22356us) log.cc:844] Serialized 14 byte log entry
0501 14:00:15.293633 (+137128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:16.271768 (+978135us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b2c000014c8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:00:16.272239 (+   471us) log.cc:844] Serialized 26 byte log entry
0501 14:00:16.272402 (+   163us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:16.272462 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:16.272555 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:16.282327 (+  9772us) raft_consensus.cc:1685] finished
0501 14:00:16.282470 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:16.282660 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2938,"prepare.queue_time_us":22079,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2578,"raft.queue_time_us":3828,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":14653,"spinlock_wait_cycles":6956928,"thread_start_us":111306,"threads_started":1,"wal-append.queue_time_us":221376}
W20260501 14:00:16.283895 11749 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.003s
W20260501 14:00:16.280181 11763 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.003s
W20260501 14:00:16.282542 11402 consensus_meta.cc:287] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.604s	user 0.015s	sys 0.003s
I20260501 14:00:16.311542  7819 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:16.228827 11243 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:16.247432 11803 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260501 14:00:16.261533  8374 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:16.321388  7821 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:16.323884  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:16.278823 11597 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:16.306485 11760 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:16.287745 11778 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.330655  7825 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:16.320307 11410 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260501 14:00:16.343024 11788 log.cc:927] Time spent T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.305s	user 0.002s	sys 0.000s
I20260501 14:00:16.344695  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:16.345081 11384 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.345220  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:16.345703 11384 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.321820 11749 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.344576 11784 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260501 14:00:16.347676 11784 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:16.348052 11784 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:16.348709 11749 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:16.348858 11784 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.350247 11784 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:16.321020 11561 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260501 14:00:16.350983 11561 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:16.351323 11561 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:16.352162 11561 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.353330 11561 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:16.361901 11785 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.664s	user 0.003s	sys 0.000s
W20260501 14:00:16.372678 11796 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.334s	user 0.002s	sys 0.002s
I20260501 14:00:16.280715 11771 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.375490 11771 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:16.324923 11618 raft_consensus.cc:359] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:16.378603 11618 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:00:16.379377 11618 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:16.381222 11760 raft_consensus.cc:697] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:00:16.382473 11792 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.627s	user 0.003s	sys 0.000s
I20260501 14:00:16.382232 11760 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.322104 11763 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.386552 11763 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:16.240283 11783 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.406406  7822 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:16.411902 11731 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:16.412423 11731 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:16.413293 11384 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:16.276618 11714 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 4 to 8, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:16.422012 11731 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:16.424350  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:16.429101  7718 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93b661856a9e45bf823981177d99ae0c. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:00:16.431933  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:16.432736  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.433495  7675 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:16.432760  7754 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:16.435039  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:16.435627  8376 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:16.437901  7676 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:16.439393  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:16.439736 10905 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 14:00:16.441886  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:16.442653 11779 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:16.444406  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:16.445207 11779 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:16.447217 11779 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:16.453337  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:16.454540  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:16.455233 11794 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:16.455631 11794 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:16.456061 11794 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:16.456378 11764 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:16.457047 11764 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:16.458195 11764 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.459221 11780 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:16.462085  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.462733  7672 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:16.465602  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:16.467453  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.468333  7676 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:16.468463  7677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee17e865655f4db7affb37902439a8be"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:16.440889 11819 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:16.469134  7677 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:16.477973  7677 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:16.479616  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.480448  7676 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:16.476346  7678 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:16.481261  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:16.425007 11617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50946 (request call id 1247) took 5114 ms. Trace:
I20260501 14:00:16.428562 11778 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:16.474262 10905 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:16.484802  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:16.451222 11731 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:16.448597 11670 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:16.485982 11651 consensus_meta.cc:287] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.004s
I20260501 14:00:16.494449  7754 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:16.500425  7753 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:16.501606  7672 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:16.521307  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:16.502629 10905 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:16.450598 11656 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.483795  7751 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:16.522505 10905 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:16.516291  7676 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:16.522975 10905 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:16.477639 11488 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.484364 11783 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:16.555519  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:16.503913 11778 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.558718  7676 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:16.565600 10905 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.554029  7677 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:16.585072  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 262630us
I20260501 14:00:16.588743 10905 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:16.547943 11651 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:16.566830 11618 ts_tablet_manager.cc:1434] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.389s	user 0.012s	sys 0.000s
I20260501 14:00:16.614441  7679 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:16.589586  7677 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.627396  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:16.630625  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.631428  7677 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:16.632519  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:16.545709 11670 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.636929 11784 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:16.637975  7825 raft_consensus.cc:2410] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260501 14:00:16.639271  7819 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:16.644290  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:16.560483 11410 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260501 14:00:16.639313  8376 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:16.652462 11504 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:16.652722  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:16.653949 11597 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:16.654609 11597 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:16.566499 11652 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260501 14:00:16.563683 11488 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.557400 11656 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.660658  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:16.665068  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:16.678745  7678 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260501 14:00:16.679171  7678 pending_rounds.cc:85] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:16.679378  7678 pending_rounds.cc:107] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260501 14:00:16.679443  8377 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260501 14:00:16.679765  7678 raft_consensus.cc:2889] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:16.663228  8380 raft_consensus.cc:2955] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:16.700445  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:16.701293  8377 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:16.704401  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.706014  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:16.709203  7671 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:16.710700  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:16.713172  7672 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:16.713557  7677 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:16.716298  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:16.720017  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:16.721369  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:16.723167  8376 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:16.678028 11637 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election won for term 6
I20260501 14:00:16.679677 11730 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:16.699002 11504 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:16.699025 11686 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.666807 11748 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260501 14:00:16.667519 11182 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
W20260501 14:00:16.729612 11799 consensus_meta.cc:287] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.003s
I20260501 14:00:16.745167  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:16.754781  7747 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:16.755136  7747 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:16.730903  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 222719us
I20260501 14:00:16.736244  8377 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:16.729368 11651 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:16.759799 11548 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.665596 11597 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.744197 11652 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:16.748200 11545 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.746191 11814 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:16.757535 11686 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.750521 11730 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.797592 11830 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:16.778635 11783 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:16.798393  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:16.778443 11827 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:16.770747 11637 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:16.769917 11799 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:16.804358 11816 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260501 14:00:16.760679  7747 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.928750  7747 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:16.900125  7671 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260501 14:00:16.906216  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 153447us
I20260501 14:00:16.908563  7675 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:16.791318 11652 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:16.752909 11504 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.956422 11504 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:16.957091 11504 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:16.957721 11504 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:16.960685 11824 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260501 14:00:16.488384 11617 rpcz_store.cc:276] 0501 14:00:11.210841 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:11.211002 (+   161us) service_pool.cc:224] Handling call
0501 14:00:11.367394 (+156392us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54003de120. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa65e900 00007fb2fa6e7f22 00007fb2fa6e6be0 00007fb2fa6dfdda 00007fb2ff6b5b89 00007fb2f8c24db4 00007fb2f8c24d42 00007fb2f8c24c71 00007fb2f8c24bec 00007fb2f8c23ea2
0501 14:00:11.643028 (+275634us) log.cc:844] Serialized 494 byte log entry
0501 14:00:12.479110 (+836082us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b18004399c0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7611be6 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa661f06 00007fb2fa65b87a 00007fb2fa65aaf4
0501 14:00:12.479744 (+   634us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b54003de120. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa661f06 00007fb2fa65b87a 00007fb2fa65aaf4 00007fb2fa63b28a 00007fb2fa642133 00007fb2fa6420b9 00007fb2fa642049 00007fb2fa642011 00007fb2fa6411dd 0000000000379254
0501 14:00:16.324697 (+3844953us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6222,"raft.queue_time_us":19605,"raft.run_cpu_time_us":6492,"raft.run_wall_time_us":676342,"spinlock_wait_cycles":194469760,"thread_start_us":161450,"threads_started":1,"wal-append.queue_time_us":213051,"wal-append.run_cpu_time_us":3540,"wal-append.run_wall_time_us":1316586}
W20260501 14:00:16.964982 11561 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.001s
I20260501 14:00:16.783010 11671 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260501 14:00:16.968364 11488 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.969117 11656 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.969385 11488 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:16.942610  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:16.934651  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:16.924849 11830 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:16.982635  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 48086.3us
W20260501 14:00:16.948756 11821 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260501 14:00:16.948308 11637 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.949987 11844 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:16.951210  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-c445f628c10d40b5a232bb391c4c92de received from {username='slave'} at 127.0.0.1:45436
I20260501 14:00:16.951651 11829 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:16.952931 11826 log.cc:927] Time spent T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260501 14:00:16.953688 11564 consensus_meta.cc:287] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.006s
I20260501 14:00:16.954061 11652 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:16.911899 11778 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:16.777288 11651 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:16.988003 11505 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:00:16.909842 11771 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.527s	user 0.004s	sys 0.009s
I20260501 14:00:16.785171 11548 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:16.907397 11814 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:17.004455  8377 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:00:17.005856  8376 raft_consensus.cc:1217] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260501 14:00:16.914270 11783 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:17.016485  8375 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:17.011988  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-c445f628c10d40b5a232bb391c4c92de on tablet c445f628c10d40b5a232bb391c4c92de with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:16.979715  7671 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:17.084481  7671 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260501 14:00:16.910061 11545 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:17.016832 11794 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.005s
I20260501 14:00:16.981767 11488 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.086895  7747 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:16.928915 11827 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.024401 11504 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.027570 11778 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:17.026722 11670 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.175925  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.194322 11548 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.193967 11814 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.195930  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 4262547d9184416ab702339797bead6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 14:00:17.196223 11488 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:17.196707  7562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 177753us
I20260501 14:00:17.018002 11829 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.012835 11844 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.170686 11815 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.020910 11564 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:17.218431  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45547.7us
I20260501 14:00:17.168113 11723 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:17.202622 11829 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.179525 11771 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.186882 11243 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:17.229072 11832 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.130s	user 0.000s	sys 0.006s
W20260501 14:00:17.274617  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 476260us
I20260501 14:00:17.170280 11794 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.241062 11825 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:17.286523  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:17.240607 11746 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.240516 11504 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.291219  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:17.266892 11829 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.235302 11771 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:17.298523 11837 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260501 14:00:17.298180 11829 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.280005 11505 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.276448 11811 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.224846 11815 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.234825 11723 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.287020 11686 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:17.306268  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:17.290153 11730 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.318912  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:17.246697 11243 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.312902  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:17.313284  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:17.306171 11505 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.321007  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:17.285670 11561 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260501 14:00:17.319782  7823 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:17.304000 11488 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.306669 11830 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.302989 11504 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.294077 11825 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.302398 11764 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:17.335309 11839 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260501 14:00:17.334072  7824 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:17.342727  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:17.335245 11840 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260501 14:00:17.311869 11859 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:17.336155 11842 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260501 14:00:17.340117 11834 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.327101 11686 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.349610  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.342372  7673 raft_consensus.cc:2955] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:17.378579  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.334100 11545 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.376853 11564 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.378458 11847 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.325798 11835 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
W20260501 14:00:17.328135 11851 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260501 14:00:17.382880  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:17.297084 11746 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.340242 11408 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:17.339186  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:17.336570 11833 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260501 14:00:17.381311 11850 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260501 14:00:17.435022 11849 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260501 14:00:17.398921  8376 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:17.416715  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.326321 11817 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.262s
I20260501 14:00:17.439234  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:17.445212 11825 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.447517  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:17.326390 11799 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.326589 11651 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.381711 11829 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.380029 11243 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:17.406038  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 378993us
I20260501 14:00:17.316530 11811 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.459173  7823 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:17.338788  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.375597 11384 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.429702  7670 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:17.433041 11835 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:17.382114 11488 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.454886  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.456431  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.456884  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:17.457619  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.501838  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.503325  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.463079  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:17.471583  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.471938  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.424597 11860 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.407287 11764 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.534528  7827 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:17.531764  7819 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260501 14:00:17.535193  8377 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:17.446359 11408 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:17.536654  7820 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:17.537006  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3100) took 1060 ms. Trace:
I20260501 14:00:17.421774 11859 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.538762  7828 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:17.450803 11827 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.541332  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.461138 11651 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:17.547118  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:17.547879  8376 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:00:17.425732 11686 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.549973  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:17.553726  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1770) took 1067 ms. Trace:
I20260501 14:00:17.544260  7752 rpcz_store.cc:276] 0501 14:00:16.476251 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.477831 (+  1580us) service_pool.cc:224] Handling call
0501 14:00:16.478278 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:16.485123 (+  6845us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:16.485156 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:16.501357 (+ 16201us) log.cc:844] Serialized 26 byte log entry
0501 14:00:16.811298 (+309941us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:16.811356 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:16.811450 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:17.536767 (+725317us) raft_consensus.cc:1685] finished
0501 14:00:17.536795 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:17.536947 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6353,"raft.queue_time_us":6964,"spinlock_wait_cycles":9003264,"thread_start_us":225715,"threads_started":1,"wal-append.queue_time_us":881289}
I20260501 14:00:17.557883  7678 rpcz_store.cc:276] 0501 14:00:16.486017 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.490092 (+  4075us) service_pool.cc:224] Handling call
0501 14:00:16.545960 (+ 55868us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:16.681041 (+135081us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:17.553473 (+872432us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000c0b54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:17.553650 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304537472}
I20260501 14:00:17.485459 11794 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.560297  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.561633  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.565203  7752 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:17.562062  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.563037  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:17.422533 11834 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:17.563840  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 138332us
I20260501 14:00:17.540015 11853 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
W20260501 14:00:17.576552  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 122972us
I20260501 14:00:17.568845  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.569067  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.572480  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:17.543740 11561 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.580883  7751 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:17.501917 11384 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.557283 11829 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.546144 11844 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.583586  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:17.590245  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:17.648079  7752 raft_consensus.cc:2368] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:17.432190 11847 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.587291  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:17.581130 11827 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:17.596593 11863 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260501 14:00:17.563462 11861 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.569303 11771 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.591073 11505 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.640581  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:17.638046 11730 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:17.649847 11723 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.580791 11799 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.590674 11853 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:17.666874 11843 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.257s	user 0.001s	sys 0.001s
W20260501 14:00:17.667611  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 84753us
W20260501 14:00:17.650241  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 107804us
I20260501 14:00:17.702397  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:17.681133 11504 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.590868 11561 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.591529 11408 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.682114 11384 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.552310 11860 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.589470 11794 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.680444 11861 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.682503 11847 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.690650 11868 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260501 14:00:17.723984 11861 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.724359 11868 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:17.724779 11561 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.668605 11835 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.691376 11811 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.669466 11827 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:17.730331  7746 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260501 14:00:17.730912  7746 pending_rounds.cc:85] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 7
I20260501 14:00:17.731191  7746 pending_rounds.cc:107] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260501 14:00:17.731505  7746 raft_consensus.cc:2889] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:17.708484 11825 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.732774 11827 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:17.733047 11818 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:17.733151 11825 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.701696 11874 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:17.734200 11874 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.721585 11794 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.735489 11825 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:17.691499 11870 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:17.698271  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.705113  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:17.706557  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:17.693970 11651 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:17.746050 11859 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.638804 11829 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.683326 11730 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:17.707939 11880 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:17.722750 11846 log.cc:927] Time spent T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260501 14:00:17.717846 11505 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260501 14:00:17.728039 11864 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.781381 11829 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:17.783330 11731 consensus_meta.cc:287] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.274s	user 0.015s	sys 0.000s
I20260501 14:00:17.784307 11825 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:17.785948 11825 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.793294  7748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 1994) took 1355 ms. Trace:
I20260501 14:00:17.700877 11799 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.736647 11794 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.696017  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.799037  7754 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:17.733604 11818 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:17.709230 11746 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.743221  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:17.740047 11870 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:17.744882 11785 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.382s	user 0.004s	sys 0.008s
I20260501 14:00:17.745373 11686 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.694708  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:17.832216 11764 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.688361 11815 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.761699 11873 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:17.704125 11862 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.750778 11861 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:17.761164 11730 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:17.747052 11853 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.793905  7748 rpcz_store.cc:276] 0501 14:00:16.438285 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.438562 (+   277us) service_pool.cc:224] Handling call
0501 14:00:16.465785 (+ 27223us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:16.466137 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:16.466170 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:16.484544 (+ 18374us) log.cc:844] Serialized 26 byte log entry
0501 14:00:16.901186 (+416642us) raft_consensus.cc:1645] Marking committed up to 5
0501 14:00:16.901237 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:16.904000 (+  2763us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:17.792893 (+888893us) raft_consensus.cc:1685] finished
0501 14:00:17.792928 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:17.793168 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":21992,"spinlock_wait_cycles":1683200,"thread_start_us":342536,"threads_started":1,"wal-append.queue_time_us":891939}
I20260501 14:00:17.821347  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:17.851163 11652 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.824s	user 0.014s	sys 0.000s
I20260501 14:00:17.736385 11874 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.830171  7676 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260501 14:00:17.877395  7676 pending_rounds.cc:85] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 9
I20260501 14:00:17.877662  7676 pending_rounds.cc:107] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260501 14:00:17.877949  7676 raft_consensus.cc:2889] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:17.709053 11771 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260501 14:00:17.797264 11488 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:17.842002 11869 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.134s
I20260501 14:00:17.754719 11561 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260501 14:00:17.740294 11834 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:17.833263 11818 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:17.850937  7750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 928) took 2298 ms. Trace:
I20260501 14:00:17.822880  7747 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:17.874789 11873 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.833029 11880 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:17.873953  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:17.908502  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1160) took 1266 ms. Trace:
W20260501 14:00:17.912794  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 259685us
I20260501 14:00:17.913882  8372 rpcz_store.cc:276] 0501 14:00:16.642132 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.642284 (+   152us) service_pool.cc:224] Handling call
0501 14:00:16.642617 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:16.642964 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:16.642987 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:16.643511 (+   524us) log.cc:844] Serialized 26 byte log entry
0501 14:00:17.033719 (+390208us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:17.034077 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:17.034149 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:17.908209 (+874060us) raft_consensus.cc:1685] finished
0501 14:00:17.908242 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:17.908413 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1206,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":388595,"threads_started":1,"wal-append.queue_time_us":650622}
I20260501 14:00:17.906848  7750 rpcz_store.cc:276] 0501 14:00:15.551503 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:15.551667 (+   164us) service_pool.cc:224] Handling call
0501 14:00:15.552004 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:15.563320 (+ 11316us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:15.563362 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:15.564028 (+   666us) log.cc:844] Serialized 52 byte log entry
0501 14:00:15.589893 (+ 25865us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:15.607365 (+ 17472us) log.cc:844] Serialized 14 byte log entry
0501 14:00:15.619046 (+ 11681us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:15.619135 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:16.361515 (+742380us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b2400026648. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7495e94 00007fb2f7493f9b 00007fb2f7522d39 00007fb2f75229c5 00007fb2f752200d 00007fb2fa2644ae 00007fb2fa27bc2c 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1
0501 14:00:17.744536 (+1383021us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b2400026648. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7495e94 00007fb2f7493f9b 00007fb2f7522d39 00007fb2f75229c5 00007fb2f752200d 00007fb2fa2644ae 00007fb2fa27bc2c 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1
0501 14:00:17.849254 (+104718us) raft_consensus.cc:1685] finished
0501 14:00:17.849286 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:17.849436 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22495,"prepare.queue_time_us":17614,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":37424,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":19399,"spinlock_wait_cycles":146223872,"thread_start_us":25449,"threads_started":1,"wal-append.queue_time_us":79099}
I20260501 14:00:17.875383 11861 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:17.880306 11828 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.931102  7820 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:17.930770 11488 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.932874 11488 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.935096 11488 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:17.936512 11871 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260501 14:00:17.938833  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1772) took 1148 ms. Trace:
I20260501 14:00:17.939186  7671 rpcz_store.cc:276] 0501 14:00:16.790305 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:17.314740 (+524435us) service_pool.cc:224] Handling call
0501 14:00:17.315143 (+   403us) raft_consensus.cc:1471] Updating replica for 3 ops
0501 14:00:17.321943 (+  6800us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:17.321980 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0501 14:00:17.322745 (+   765us) log.cc:844] Serialized 78 byte log entry
0501 14:00:17.446061 (+123316us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:17.446104 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:17.446180 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:17.938563 (+492383us) raft_consensus.cc:1685] finished
0501 14:00:17.938586 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:17.938769 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10689,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":39666,"thread_start_us":37245,"threads_started":1,"wal-append.queue_time_us":350321}
I20260501 14:00:17.940904  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:17.879781 11652 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:17.942432  7826 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260501 14:00:17.781483 11864 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.862987 11862 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:17.945240 11652 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:17.948156 11869 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:17.948315  7820 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:18.007479 10896 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.906920 11874 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:18.008294  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:18.027256  7671 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:18.009325 11877 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:18.011083 11686 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:17.919939 11825 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.020226 11746 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260501 14:00:18.025311  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 435371us
I20260501 14:00:18.041638 10896 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.021021 11488 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:17.879419 11827 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.021078 11794 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 14:00:18.032402  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 330062us
I20260501 14:00:18.042886  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:18.059468  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:17.916513 11873 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.057789  7671 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:18.026115 11829 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:18.026721 11869 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:18.082921  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:18.061607  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:17.950644 11828 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.062093 11881 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:18.070067  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:18.087137  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.064083 11488 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.061869 11651 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:18.070974 11847 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:18.063894 10896 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.089087  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.094627 11885 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:18.095111 11885 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:18.095474 11885 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:18.069763 11859 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260501 14:00:18.067236  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2727) took 1561 ms. Trace:
I20260501 14:00:18.096719  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:18.097470  7672 rpcz_store.cc:276] 0501 14:00:16.505785 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.546669 (+ 40884us) service_pool.cc:224] Handling call
0501 14:00:16.555788 (+  9119us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:16.713612 (+157824us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.066866 (+1353254us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540019c154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.067145 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361161984}
I20260501 14:00:18.100029  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.100776  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.092391  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.105247  7747 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:18.105513  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.100070  7672 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:18.102157  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.112582  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.114218  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.032673 11874 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.117321  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.118306  8375 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:18.121456  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.138772  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:18.139703  8380 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
W20260501 14:00:18.095353 11867 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
I20260501 14:00:18.089128  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.075583 11829 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.143334  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.144336  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.047412 11686 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.150990  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.153144  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.089380 11881 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:18.081609 11799 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:18.101202 11876 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260501 14:00:18.153482  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2064) took 1809 ms. Trace:
I20260501 14:00:18.159375  7754 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260501 14:00:18.153051  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:18.197822 11806 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:18.197789 11888 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260501 14:00:18.194772  7822 rpcz_store.cc:276] 0501 14:00:16.343957 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.344085 (+   128us) service_pool.cc:224] Handling call
0501 14:00:16.344493 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:16.406982 (+ 62489us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.153213 (+1746231us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b540025f654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.153413 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141815680}
W20260501 14:00:18.202448  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:18.154558  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 83106.3us
I20260501 14:00:18.091975 11488 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.197194  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:18.183980  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.188114 11879 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:18.190238  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.191162  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.095568 11827 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.223456  8379 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260501 14:00:18.224196  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 571) took 1560 ms. Trace:
I20260501 14:00:18.224507  8379 rpcz_store.cc:276] 0501 14:00:16.664052 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.665825 (+  1773us) service_pool.cc:224] Handling call
0501 14:00:16.706942 (+ 41117us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:18.223208 (+1516266us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b5400658c20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6591a0 00007fb2fa6e35a0 00007fb2fa6e4611 00007fb2fa6e116f 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c
0501 14:00:18.223932 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.224139 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212356992}
I20260501 14:00:18.194216 11458 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:18.209894  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:18.228202  7822 raft_consensus.cc:2410] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260501 14:00:18.156625 11779 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:18.066977 11794 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.090355 11771 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260501 14:00:18.179168  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.238698  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1771) took 1480 ms. Trace:
I20260501 14:00:18.190090 11870 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.192808  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.204223 11873 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.239113  7674 rpcz_store.cc:276] 0501 14:00:16.758675 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:17.199894 (+441219us) service_pool.cc:224] Handling call
0501 14:00:17.200654 (+   760us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:17.201116 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:17.201156 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:17.202501 (+  1345us) log.cc:844] Serialized 499 byte log entry
0501 14:00:17.406693 (+204192us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:17.406738 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:17.406821 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:18.092845 (+686024us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:18.233658 (+140813us) raft_consensus.cc:1685] finished
0501 14:00:18.233683 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.238625 (+  4942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73722240,"thread_start_us":203806,"threads_started":1,"wal-append.queue_time_us":366064}
I20260501 14:00:18.225392  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.232317  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:18.233235  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:18.092710 11847 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.063519 11861 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.245873  7747 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:18.239841  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:18.211059 11384 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:18.250072  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.216250 11888 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:18.256665  7747 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:18.241497  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:18.198125 11561 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index -1 to 10, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:18.215525 11488 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:18.264302  8380 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:18.265280  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:18.267500  7823 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:18.272094 11872 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:18.272594  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1775) took 1189 ms. Trace:
I20260501 14:00:18.273058  7678 rpcz_store.cc:276] 0501 14:00:17.083285 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:17.559259 (+475974us) service_pool.cc:224] Handling call
0501 14:00:17.575852 (+ 16593us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:17.580876 (+  5024us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:17.580910 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:17.580985 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:17.581025 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.272331 (+691306us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b540005b4d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.272392 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.272533 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11032960}
I20260501 14:00:18.056291 11877 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.279902  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.288154  7670 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:18.198741 11806 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.308121  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:18.240000 11779 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.269930 11888 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.256376 11880 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:18.324473  7753 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:18.247000 11505 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260501 14:00:18.237533 11458 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.325181  7753 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:18.326329  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.746s (SENT) [suppressed 10 similar messages]
W20260501 14:00:18.330642  7825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2062) took 1974 ms (client timeout 2073 ms). Trace:
W20260501 14:00:18.345573  7825 rpcz_store.cc:269] 0501 14:00:16.343218 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.438254 (+ 95036us) service_pool.cc:224] Handling call
0501 14:00:18.316949 (+1878695us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002607d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:18.317157 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394477824}
I20260501 14:00:18.274235 11864 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.347736  7753 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.272596 11872 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:18.376984  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:18.380319  7753 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:18.374213  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:18.384747  7749 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:18.389580 11458 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.313124 11779 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.261862 11384 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.398545 11384 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.404477 11881 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.404855 11829 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.405751 11686 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.406023  7828 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:18.407429 11794 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:18.412070 11873 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:18.412689 11873 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:18.414163  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:18.414526 11873 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.416551  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2735) took 1839 ms. Trace:
I20260501 14:00:18.417044  7675 rpcz_store.cc:276] 0501 14:00:16.576816 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.971917 (+395101us) service_pool.cc:224] Handling call
0501 14:00:16.972370 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:16.974426 (+  2056us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:16.974475 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:16.974538 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:16.974583 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.416171 (+1441588us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b540042e0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.416257 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.416468 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4012416}
I20260501 14:00:18.420754  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1765) took 1954 ms. Trace:
I20260501 14:00:18.421290  7679 rpcz_store.cc:276] 0501 14:00:16.466419 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.469295 (+  2876us) service_pool.cc:224] Handling call
0501 14:00:16.498898 (+ 29603us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:16.615015 (+116117us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.420481 (+1805466us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540037f5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.420681 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265110912}
I20260501 14:00:18.162222 11869 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.419270  7675 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:18.331995 11817 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:18.303320 11862 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.430528 11877 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.446051 11884 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:18.443521  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 658) took 1005 ms. Trace:
I20260501 14:00:18.464529  7675 rpcz_store.cc:276] 0501 14:00:17.438408 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.418437 (+980029us) service_pool.cc:224] Handling call
0501 14:00:18.418870 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.443082 (+ 24212us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.443436 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 14:00:18.473112 11783 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.439898 11872 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:18.276628 11488 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.496570  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2744) took 1065 ms. Trace:
I20260501 14:00:18.497143  7671 rpcz_store.cc:276] 0501 14:00:17.430785 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.071470 (+640685us) service_pool.cc:224] Handling call
0501 14:00:18.071868 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.211102 (+139234us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:18.211144 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:18.211189 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:18.211226 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.496029 (+284803us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001ec654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.496110 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.496463 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319652608}
I20260501 14:00:18.459260 11806 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.512324  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2739) took 1898 ms. Trace:
I20260501 14:00:18.512825  7676 rpcz_store.cc:276] 0501 14:00:16.613645 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.948923 (+335278us) service_pool.cc:224] Handling call
0501 14:00:16.949203 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:17.878519 (+929316us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.511954 (+633435us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54003601d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.512238 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940506496}
I20260501 14:00:18.495383 11874 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.508437 11783 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:18.544001  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 898) took 1082 ms. Trace:
I20260501 14:00:18.544682  7819 rpcz_store.cc:276] 0501 14:00:17.462065 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.531705 (+1069640us) service_pool.cc:224] Handling call
0501 14:00:18.543306 (+ 11601us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.543520 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:18.543543 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:18.543602 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:18.543636 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.543723 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.543922 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 14:00:18.563265 11865 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:18.569494  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2066) took 1777 ms. Trace:
I20260501 14:00:18.570060  7826 rpcz_store.cc:276] 0501 14:00:16.792383 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.812695 (+ 20312us) service_pool.cc:224] Handling call
0501 14:00:16.889547 (+ 76852us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:17.942831 (+1053284us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.569154 (+626323us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002eac54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.569408 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420652416}
I20260501 14:00:18.572774  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2732) took 2011 ms. Trace:
I20260501 14:00:18.573498 11834 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:18.573954 11834 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:18.573305  7677 rpcz_store.cc:276] 0501 14:00:16.561809 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.737632 (+175823us) service_pool.cc:224] Handling call
0501 14:00:18.571733 (+1834101us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 14:00:18.572039 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.572321 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:18.572359 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:18.572439 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0501 14:00:18.572498 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.572577 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.572701 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326415616}
I20260501 14:00:18.502521 11884 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.564082 11865 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.597298 11488 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.606125  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2746) took 1174 ms. Trace:
I20260501 14:00:18.606642  7672 rpcz_store.cc:276] 0501 14:00:17.431359 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.106729 (+675370us) service_pool.cc:224] Handling call
0501 14:00:18.150870 (+ 44141us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.277038 (+126168us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:18.277086 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:18.277146 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:18.277190 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.605792 (+328602us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003f3c54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.605856 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.606045 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289578368}
I20260501 14:00:18.611225 11888 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.502941 11817 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.612444 11847 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.616468  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 897) took 1158 ms. Trace:
I20260501 14:00:18.624825  7824 rpcz_store.cc:276] 0501 14:00:17.457883 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:17.533077 (+ 75194us) service_pool.cc:224] Handling call
0501 14:00:17.533494 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:17.668807 (+135313us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:17.668841 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:17.668894 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:17.668925 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.616196 (+947271us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540021fcd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.616248 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.616392 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310683392}
I20260501 14:00:18.626546 11408 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:18.628907 11834 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.630388 11834 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:18.643224 11865 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:18.650614 11828 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.652164 11878 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:18.652657 11878 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:18.653501 11878 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.659596 11878 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:18.696616 11860 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:18.699870 11818 consensus_meta.cc:287] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.004s
W20260501 14:00:18.702642 11723 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.026s	sys 0.030s
W20260501 14:00:18.703410  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:18.703285 11723 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.026s	sys 0.030s
I20260501 14:00:18.714462 11869 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:18.736701 11730 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.854s	user 0.008s	sys 0.008s
I20260501 14:00:18.700441 11818 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.738541 11884 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:18.770762  7673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.225s	user 0.034s	sys 0.097s
W20260501 14:00:18.772462 11887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.004s	sys 0.011s
W20260501 14:00:18.788861 11887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.004s	sys 0.011s
W20260501 14:00:18.784534  7717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.016s	sys 0.015s
W20260501 14:00:18.793077  7717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.017s	sys 0.015s
W20260501 14:00:18.796116  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:18.795864  7673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.035s	sys 0.098s
I20260501 14:00:18.814589 11886 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:18.815611 11886 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.759404 11730 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:18.818722 11886 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.824523  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2733) took 2259 ms. Trace:
W20260501 14:00:18.832937 11504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.024s	sys 0.008s
W20260501 14:00:18.836018 11504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.025s	sys 0.008s
W20260501 14:00:18.837809  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.012s	sys 0.036s
W20260501 14:00:18.838688  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.013s	sys 0.037s
W20260501 14:00:18.840232  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 700004us
W20260501 14:00:18.838924  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:18.758723 11885 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.005s
I20260501 14:00:18.739054 11817 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:18.855022  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.001s	sys 0.010s
I20260501 14:00:18.855299  8377 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:18.826114  7673 rpcz_store.cc:276] 0501 14:00:16.565201 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.751965 (+186764us) service_pool.cc:224] Handling call
0501 14:00:17.341722 (+589757us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5800002498. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 14:00:17.341974 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:17.342215 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 7
0501 14:00:17.545188 (+202973us) log.cc:844] Serialized 14 byte log entry
0501 14:00:18.799115 (+1253927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:18.823329 (+ 24214us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:18.823556 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.823862 (+   306us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:18.824298 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":186,"spinlock_wait_cycles":283543808,"thread_start_us":1252131,"threads_started":1}
W20260501 14:00:18.855931  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.002s	sys 0.010s
I20260501 14:00:18.858300  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1774) took 1775 ms. Trace:
I20260501 14:00:18.858711  7670 rpcz_store.cc:276] 0501 14:00:17.083012 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:17.554059 (+471047us) service_pool.cc:224] Handling call
0501 14:00:17.565849 (+ 11790us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.301650 (+735801us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:18.858013 (+556363us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b540004d3d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:18.858234 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660362624}
W20260501 14:00:18.895155  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:16.487001  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 14:00:18.916389  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.019s	sys 0.015s
W20260501 14:00:18.924221  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.020s	sys 0.015s
W20260501 14:00:18.934566  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:18.854477 11885 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:18.958447  8344 leader_election.cc:400] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:18.960417  8344 leader_election.cc:403] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260501 14:00:18.963629  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:18.952670  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.027s	sys 0.030s
W20260501 14:00:18.966585  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.027s	sys 0.031s
W20260501 14:00:18.964555  7644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.016s	sys 0.025s
W20260501 14:00:18.981061  7644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.016s	sys 0.025s
I20260501 14:00:18.989807  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:18.958928 11897 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260501 14:00:18.961055 11730 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:18.993213 11726 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:18.992847  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:18.993170 11886 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:19.008354 11887 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:18.980758 11735 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10.
I20260501 14:00:19.000874 11504 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:19.028178 11897 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
W20260501 14:00:19.064544  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.004s	sys 0.030s
I20260501 14:00:19.064558  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:19.068188  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.004s	sys 0.031s
I20260501 14:00:19.040504 11182 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:19.071206  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.040294 11874 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:19.061012 11783 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260501 14:00:19.048815 11808 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:19.073729  7674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.022s	sys 0.022s
W20260501 14:00:19.067417  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.000s	sys 0.036s
I20260501 14:00:19.013738 11726 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.078250  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.081604  8375 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: [4.7-6.8]
W20260501 14:00:19.070020 11561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.029s
W20260501 14:00:19.079460  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.000s	sys 0.036s
I20260501 14:00:19.060895 11730 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:19.081847  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.070112 11573 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:19.085999  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.086071  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.089996  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:19.090438  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:19.095063  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:19.095351  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:19.071945 11818 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.062402 11548 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260501 14:00:19.060221 11504 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:19.079761  7674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.023s	sys 0.022s
I20260501 14:00:19.129611  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:19.108217  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:19.128872  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:19.180649  7746 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:19.145639  7748 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:19.143965  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:19.176760  7678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.013s
W20260501 14:00:19.183285  7678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.009s	sys 0.013s
I20260501 14:00:19.104017  7672 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260501 14:00:19.137555  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.183105  7670 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:19.105672  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.191272  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:19.180546  7676 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 14:00:19.100831 11561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.004s	sys 0.029s
I20260501 14:00:19.076023 11656 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:19.098531  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:19.114077 11835 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:19.074326 11897 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:19.096064  8376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.010s	sys 0.035s
I20260501 14:00:19.076297 11182 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.086971 11808 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.216301  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:19.535976  7676 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
W20260501 14:00:19.400964  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:19.283208  7751 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.010s	sys 0.038s
W20260501 14:00:19.538959  7751 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.017s	sys 0.038s
W20260501 14:00:19.226873  7747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.006s	sys 0.029s
W20260501 14:00:19.540571  7747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.011s	sys 0.034s
W20260501 14:00:19.541326  8376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.012s	sys 0.040s
W20260501 14:00:19.387248 11597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.006s	sys 0.018s
W20260501 14:00:19.543138 11597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.007s	sys 0.018s
I20260501 14:00:19.469797 11895 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:19.544888 11895 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:19.546203  7566 maintenance_manager.cc:419] P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033389
I20260501 14:00:19.102926 11691 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:19.079594 11874 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.548549 11691 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.550333 11874 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:19.276134 11882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.016s	sys 0.020s
W20260501 14:00:19.551247 11882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.019s	sys 0.024s
I20260501 14:00:19.082741 11828 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:19.552865 11828 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:19.303072 11836 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:19.554252  7670 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:19.554591 11836 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:19.262151  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:19.248822  7793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.016s	sys 0.020s
I20260501 14:00:19.547699  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.086421 11870 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:19.220043  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.302328  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:19.534093  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 427972us
I20260501 14:00:19.231187  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:19.840131  7793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.637s	user 0.034s	sys 0.023s
I20260501 14:00:19.534595  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.845882  7823 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:19.560226  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.847146  7828 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:19.848397  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.845882  7820 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:19.850525  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.853675  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.854364  8379 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:19.852696  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:19.138195 11408 consensus_meta.cc:287] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.006s
W20260501 14:00:19.196458 11861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.011s	sys 0.039s
W20260501 14:00:19.302191 11863 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.011s	sys 0.014s
W20260501 14:00:19.312502 11854 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.010s	sys 0.012s
I20260501 14:00:19.847379  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:19.528318 11723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.011s	sys 0.015s
W20260501 14:00:19.809212 11904 log.cc:927] Time spent T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260501 14:00:19.834461 11834 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.204s	user 0.010s	sys 0.005s
W20260501 14:00:19.678941 11911 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260501 14:00:19.282081 11889 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
W20260501 14:00:19.683597 11878 consensus_meta.cc:287] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.023s	user 0.008s	sys 0.005s
W20260501 14:00:19.682164 11869 consensus_meta.cc:287] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.967s	user 0.004s	sys 0.010s
I20260501 14:00:19.113819 11730 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:19.526008 11814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.114s	user 0.021s	sys 0.018s
I20260501 14:00:19.849239  7828 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:19.267506 11561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42706 (request call id 10) took 4652 ms. Trace:
I20260501 14:00:19.386528 11866 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:19.851410  7827 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:19.878563  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:19.137406 11726 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:19.866405 11799 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:19.835676 11691 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.245869 11714 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:19.851596 11873 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:19.245368 11886 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:19.302580 11778 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:19.261003 11885 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.643551 11836 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.592247 11895 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.647267 11874 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:19.682590 11504 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:19.856218 11835 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:19.871709 11723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.015s	sys 0.023s
W20260501 14:00:19.873144 11854 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.013s	sys 0.020s
I20260501 14:00:19.861255 11870 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:19.864044 11861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.590s	user 0.014s	sys 0.057s
I20260501 14:00:19.908072  7825 raft_consensus.cc:2410] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260501 14:00:19.270188 11656 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:19.865919 11863 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.019s	sys 0.020s
I20260501 14:00:19.211544 11573 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.907917 11828 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:19.912842 11814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.503s	user 0.027s	sys 0.023s
I20260501 14:00:19.922396 11799 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.932405  7824 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:19.932590  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1169) took 1795 ms. Trace:
I20260501 14:00:19.931780 11886 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.967686  8376 rpcz_store.cc:276] 0501 14:00:18.136924 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.137124 (+   200us) service_pool.cc:224] Handling call
0501 14:00:18.137659 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:18.335056 (+197397us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:18.335088 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:18.335688 (+   600us) log.cc:844] Serialized 26 byte log entry
0501 14:00:19.541928 (+1206240us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:19.541990 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:19.543961 (+  1971us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54004e0cd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:19.544030 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:19.929145 (+385115us) raft_consensus.cc:1685] finished
0501 14:00:19.929177 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:19.932498 (+  3321us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5587,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12747,"spinlock_wait_cycles":452980992,"thread_start_us":1174666,"threads_started":1,"wal-append.queue_time_us":1269691}
I20260501 14:00:19.914122 11561 rpcz_store.cc:276] 0501 14:00:14.619423 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:14.619696 (+   273us) service_pool.cc:224] Handling call
0501 14:00:14.690586 (+ 70890us) log.cc:844] Serialized 499 byte log entry
0501 14:00:15.115862 (+425276us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b1800273b20. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2f74761f0 00007fb2f7640b24 00007fb2f7640a95 00007fb2fa63aeeb 00007fb2fa6bff43 00007fb2fa6e7b32 00007fb2ff6b63e9
0501 14:00:19.258756 (+4142894us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135485,"raft.queue_time_us":235752,"raft.run_cpu_time_us":10642,"raft.run_wall_time_us":90494,"spinlock_wait_cycles":5614464,"thread_start_us":194414,"threads_started":1,"wal-append.queue_time_us":225413,"wal-append.run_cpu_time_us":1640,"wal-append.run_wall_time_us":1006341}
I20260501 14:00:19.974679 11886 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:19.643919 11872 consensus_meta.cc:287] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.137s	user 0.009s	sys 0.007s
I20260501 14:00:19.920007 11866 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.926458 11714 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.933720 11778 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:19.952147 11730 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.923318 11897 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:19.942970 11874 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.953101 11182 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.967155 11808 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:19.985216 11656 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:19.989810 11872 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:19.999807 11835 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.002318 11573 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.026573 11870 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.040210 11714 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.042917 11778 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:20.126899  7751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.002s	sys 0.000s
W20260501 14:00:20.127641  7751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.002s	sys 0.000s
I20260501 14:00:20.046123 11866 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:20.106134  7674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.011s	sys 0.001s
I20260501 14:00:19.566646  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 197) took 9441 ms. Trace:
W20260501 14:00:20.051991 11920 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260501 14:00:20.140604  8374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.018s	sys 0.012s
W20260501 14:00:20.141312  8374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.019s	sys 0.012s
I20260501 14:00:19.576184  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.114117  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 655) took 2676 ms. Trace:
I20260501 14:00:19.556924  7752 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:19.422467  7822 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index -1 to 10, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:20.064790 11872 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.073261 11874 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.173393  7827 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 14:00:20.173942  7676 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:20.112897  7673 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 14:00:20.129547  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3130) took 1808 ms. Trace:
I20260501 14:00:19.567058  7573 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:00:20.146492  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.003s	sys 0.002s
W20260501 14:00:20.143610  7674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.012s	sys 0.002s
W20260501 14:00:20.148120  7747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.006s
W20260501 14:00:20.159955  7720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.000s	sys 0.007s
I20260501 14:00:20.160236  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:20.161964  7792 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.777s	user 0.013s	sys 0.028s
W20260501 14:00:20.176733  7792 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.805s	user 0.013s	sys 0.028s
W20260501 14:00:20.177315  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:20.177420  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 1.85095e+06us
I20260501 14:00:20.178215 11921 ts_tablet_manager.cc:933] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:20.179797  7821 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
W20260501 14:00:19.243091  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.182292  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 593) took 1077 ms. Trace:
W20260501 14:00:20.182726  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:20.180896  7819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.011s
W20260501 14:00:20.183477  7819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.012s
I20260501 14:00:19.576187  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:20.148617  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.176457  7750 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
W20260501 14:00:20.163030  8380 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.000s	sys 0.003s
W20260501 14:00:20.193017  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.003s	sys 0.002s
W20260501 14:00:20.194541  8380 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.001s	sys 0.003s
I20260501 14:00:20.182783  8379 rpcz_store.cc:276] 0501 14:00:19.105069 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.213244 (+108175us) service_pool.cc:224] Handling call
0501 14:00:19.335732 (+122488us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:19.855277 (+519545us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.181643 (+326366us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b540051e5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:20.181983 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191785728}
W20260501 14:00:20.196295  7720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.001s	sys 0.007s
W20260501 14:00:20.196681  7747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.000s	sys 0.007s
I20260501 14:00:20.174803  7751 rpcz_store.cc:276] 0501 14:00:18.320988 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.321174 (+   186us) service_pool.cc:224] Handling call
0501 14:00:18.321549 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.321798 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:19.539488 (+1217690us) log.cc:844] Serialized 14 byte log entry
0501 14:00:20.128608 (+589120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:20.128746 (+   138us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:20.128908 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.129071 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:20.129352 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1607004,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":1134,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":3254,"thread_start_us":1760070,"threads_started":2,"wal-append.queue_time_us":587565}
I20260501 14:00:20.202728 11847 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:20.200453  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.217500  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 657) took 2779 ms. Trace:
I20260501 14:00:20.218029  7674 rpcz_store.cc:276] 0501 14:00:17.438109 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.366087 (+927978us) service_pool.cc:224] Handling call
0501 14:00:18.370209 (+  4122us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.370505 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:19.179628 (+809123us) log.cc:844] Serialized 14 byte log entry
0501 14:00:20.216790 (+1037162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:20.216907 (+   117us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:20.217032 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.217173 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:20.217422 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27247,"prepare.queue_time_us":1105033,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"thread_start_us":1812766,"threads_started":2,"wal-append.queue_time_us":866859}
I20260501 14:00:20.203877 11847 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.223377 11898 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.224967  7573 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.228868 11879 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:20.229094 11900 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:20.244850 11900 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 14:00:20.248383  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 55543.7us
I20260501 14:00:20.251287 11929 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.252518 11929 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.256145 11898 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.259191 11898 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:20.229028  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 108978us
W20260501 14:00:20.229977  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.230983 11866 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:20.264940  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1171) took 1165 ms. Trace:
I20260501 14:00:20.143725  7678 rpcz_store.cc:276] 0501 14:00:17.437597 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.275478 (+837881us) service_pool.cc:224] Handling call
0501 14:00:18.322751 (+ 47273us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:18.333200 (+ 10449us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:18.333240 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:18.366900 (+ 33660us) log.cc:844] Serialized 52 byte log entry
0501 14:00:18.597999 (+231099us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b180035bb40. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:19.192033 (+594034us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:19.192101 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:19.192208 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:20.113078 (+920870us) raft_consensus.cc:1685] finished
0501 14:00:20.113124 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:20.113764 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10444,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":9321,"spinlock_wait_cycles":5618048,"thread_start_us":585641,"threads_started":1,"wal-append.queue_time_us":1547354}
I20260501 14:00:20.265219 11808 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:20.265707 11866 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.266592 11808 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.267202  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2067) took 3473 ms. Trace:
I20260501 14:00:20.265548  8374 rpcz_store.cc:276] 0501 14:00:19.099436 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.099591 (+   155us) service_pool.cc:224] Handling call
0501 14:00:19.099962 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:19.103047 (+  3085us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:20.142254 (+1039207us) log.cc:844] Serialized 14 byte log entry
0501 14:00:20.216421 (+ 74167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:20.217457 (+  1036us) log.cc:844] Serialized 26 byte log entry
0501 14:00:20.217640 (+   183us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:20.217673 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.217804 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:20.264336 (+ 46532us) raft_consensus.cc:1685] finished
0501 14:00:20.264357 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:20.264823 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12647,"prepare.queue_time_us":954944,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":341,"raft.queue_time_us":14362,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":32239,"thread_start_us":1071708,"threads_started":2,"wal-append.queue_time_us":111288}
I20260501 14:00:20.231303 11854 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.227161 11921 tablet_copy_client.cc:323] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:00:20.233454 11670 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:20.236402 11835 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:20.279942  7671 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:20.237244 11886 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:20.237977 11925 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.286702 11670 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.286999 11925 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.240526 11778 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:20.240854  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3129) took 1929 ms. Trace:
I20260501 14:00:20.289462 11670 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.289974 11778 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.290846 11866 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.289745  7747 rpcz_store.cc:276] 0501 14:00:18.312004 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.312198 (+   194us) service_pool.cc:224] Handling call
0501 14:00:18.312612 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:18.312885 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 7
0501 14:00:19.564414 (+1251529us) log.cc:844] Serialized 14 byte log entry
0501 14:00:20.240119 (+675705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:20.240253 (+   134us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:20.240418 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.240573 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:20.240791 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28650,"prepare.queue_time_us":1599572,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1987,"raft.queue_time_us":25942,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":193,"spinlock_wait_cycles":3694848,"thread_start_us":1863551,"threads_started":2,"wal-append.queue_time_us":637787}
I20260501 14:00:20.241926 11870 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:20.292713 11778 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.292526 11870 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.289462 11925 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.243731  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:20.263449  7752 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
W20260501 14:00:20.264863  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.271044  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2750) took 1181 ms. Trace:
I20260501 14:00:20.164361  7576 rpcz_store.cc:276] 0501 14:00:10.124905 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:10.135041 (+ 10136us) service_pool.cc:224] Handling call
0501 14:00:10.262769 (+127728us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:19.566549 (+9303780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:14.819694 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:14.856438 (+ 36744us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:14.856478 (+    40us) write_op.cc:435] Acquired schema lock
0501 14:00:14.856499 (+    21us) tablet.cc:662] Decoding operations
0501 14:00:14.857234 (+   735us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:14.857317 (+    83us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:14.857351 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0501 14:00:14.921163 (+ 63812us) tablet.cc:701] Row locks acquired
0501 14:00:14.925135 (+  3972us) write_op.cc:260] PREPARE: finished
0501 14:00:14.938043 (+ 12908us) write_op.cc:270] Start()
0501 14:00:14.977681 (+ 39638us) write_op.cc:276] Timestamp: P: 1777644014934964 usec, L: 0
0501 14:00:14.981020 (+  3339us) op_driver.cc:348] REPLICATION: starting
0501 14:00:14.996508 (+ 15488us) log.cc:844] Serialized 2054 byte log entry
0501 14:00:15.429395 (+432887us) op_driver.cc:464] REPLICATION: finished
0501 14:00:15.581507 (+152112us) write_op.cc:301] APPLY: starting
0501 14:00:15.586056 (+  4549us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:15.607573 (+ 21517us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:15.634917 (+ 27344us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:15.672379 (+ 37462us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:15.672624 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0501 14:00:15.672685 (+    61us) write_op.cc:312] APPLY: finished
0501 14:00:15.672911 (+   226us) log.cc:844] Serialized 47 byte log entry
0501 14:00:15.673078 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:15.673198 (+   120us) write_op.cc:454] Released schema lock
0501 14:00:15.673290 (+    92us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:15.673715 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:15.673740 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17412,"reported_tablets":12,"spinlock_wait_cycles":190232320,"child_traces":[["op",{"apply.queue_time_us":133236,"apply.run_cpu_time_us":3303,"apply.run_wall_time_us":103119,"num_ops":5,"prepare.queue_time_us":235782,"prepare.run_cpu_time_us":44260,"prepare.run_wall_time_us":341205,"raft.queue_time_us":172811,"raft.run_cpu_time_us":18396,"raft.run_wall_time_us":109036,"replication_time_us":435802,"thread_start_us":411429,"threads_started":4,"wal-append.queue_time_us":185630,"wal-append.run_cpu_time_us":13495,"wal-append.run_wall_time_us":1480814}]]}
W20260501 14:00:20.231531  7677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.002s	sys 0.011s
I20260501 14:00:20.267621  7821 rpcz_store.cc:276] 0501 14:00:16.793330 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:16.795908 (+  2578us) service_pool.cc:224] Handling call
0501 14:00:16.796197 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:20.180421 (+3384224us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.266838 (+ 86417us) spinlock_profiling.cc:243] Waited 3.34 s on lock 0x7b54002cbfd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:20.267122 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7681935744}
I20260501 14:00:20.280290 11835 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.285094 11854 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.285692 11886 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:20.242928  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.263957 11929 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.298014  7673 rpcz_store.cc:276] 0501 14:00:19.089663 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.089757 (+    94us) service_pool.cc:224] Handling call
0501 14:00:20.270695 (+1180938us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540024c554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:20.270936 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142375680}
I20260501 14:00:20.306005 11835 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.306005 11854 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.312188  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 951) took 1213 ms. Trace:
I20260501 14:00:20.312853  7752 rpcz_store.cc:276] 0501 14:00:19.098117 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.098262 (+   145us) service_pool.cc:224] Handling call
0501 14:00:20.303855 (+1205593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 14:00:20.318414  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 74879.3us
W20260501 14:00:20.302774  7677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.003s	sys 0.011s
I20260501 14:00:20.323849  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2758) took 1064 ms. Trace:
I20260501 14:00:20.273578 11847 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:20.327730  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.328280 11835 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:20.328703  7750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 945) took 2136 ms (client timeout 2154 ms). Trace:
W20260501 14:00:20.358776  7750 rpcz_store.cc:269] 0501 14:00:18.192414 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:18.192567 (+   153us) service_pool.cc:224] Handling call
0501 14:00:20.328442 (+2135875us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54001077d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:20.328619 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4350777600}
I20260501 14:00:20.329702  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.360868  7675 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:20.324265  7677 rpcz_store.cc:276] 0501 14:00:19.259460 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.259621 (+   161us) service_pool.cc:224] Handling call
0501 14:00:19.260128 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:19.260691 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:19.260732 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:19.261646 (+   914us) log.cc:844] Serialized 26 byte log entry
0501 14:00:20.323145 (+1061499us) raft_consensus.cc:1645] Marking committed up to 4
0501 14:00:20.323262 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:20.323415 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:20.323504 (+    89us) raft_consensus.cc:1685] finished
0501 14:00:20.323522 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:20.323751 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":197,"thread_start_us":900304,"threads_started":1,"wal-append.queue_time_us":886519}
I20260501 14:00:20.362640 11835 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.365082 11835 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:20.365868  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.368219 11863 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:20.370862  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.371763 11929 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:20.372470 11929 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.374711 11929 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.375223 11929 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:20.337750 11886 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.340960 11799 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.380384  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.380321  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.384460  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.406016  7671 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260501 14:00:20.324594  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 89327.6us
I20260501 14:00:20.352159  7573 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.319604  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:20.404642  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.269246 11808 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:20.349507 11870 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.391180  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.398277  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.398778  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.380838  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.399712  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.379232  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:20.396823  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 93b661856a9e45bf823981177d99ae0c from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:00:20.388327  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.395301  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.375808 11929 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.460566 11900 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:20.480912 11931 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260501 14:00:20.510408 11929 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:20.484097  7573 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 12, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.513127  7573 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 8, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), now has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:20.490532  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2759) took 1143 ms. Trace:
I20260501 14:00:20.490708  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 93b661856a9e45bf823981177d99ae0c from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-93b661856a9e45bf823981177d99ae0c
I20260501 14:00:20.490568 11872 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:20.516041  7671 rpcz_store.cc:276] 0501 14:00:19.347304 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.347568 (+   264us) service_pool.cc:224] Handling call
0501 14:00:20.484182 (+1136614us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54001ecb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:20.490458 (+  6276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159265152}
W20260501 14:00:20.491742  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 172377us
I20260501 14:00:20.518707  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:20.439934 11863 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.519918 11863 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.492174  7820 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:20.522487 11863 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:20.496351  7825 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:20.486104  7827 raft_consensus.cc:2410] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260501 14:00:20.500710  7746 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:20.501277  7748 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
W20260501 14:00:20.502008  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.442946 11847 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260501 14:00:20.496187  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:20.527487  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 153719us
I20260501 14:00:20.529109 11872 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:20.515692  7573 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:20.535440  7751 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
W20260501 14:00:20.540493  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.541621  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:20.542706 11847 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:20.543128 11847 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:20.543466 11847 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:20.548713  7573 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:20.566833 11929 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:20.568368 11897 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:20.568816 11897 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:20.569934 11897 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.572754 11847 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.575690  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.576754 11900 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:20.576866 11897 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:20.577498  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.578367 11900 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:20.579241 11854 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 14:00:20.580560 11847 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.579502  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.582429 11900 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:20.562740  7573 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:20.584038  7573 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.584846  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:20.585935 11670 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:20.586414 11670 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:20.586880 11670 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:20.588055 11872 raft_consensus.cc:1064] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:00:20.591086 11872 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.596252  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:20.597203  7752 raft_consensus.cc:606] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:20.597591  7752 raft_consensus.cc:614] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:20.604517  7573 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:20.606690  7573 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:20.611243  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:20.612113  7752 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:20.612210  7764 tablet_copy_source_session.cc:215] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:00:20.612577  7752 raft_consensus.cc:614] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:20.617236 11929 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260501 14:00:20.622944 11670 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.623415 11878 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:20.628144  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:20.630410 11670 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:20.632390  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 46060.9us
I20260501 14:00:20.634379  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.635303  7671 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:20.637992  7671 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:20.640796  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.617352  7573 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:00:20.642516  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 79701.5us
I20260501 14:00:20.643939  7752 raft_consensus.cc:606] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:20.648931  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.649145  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:20.660506  7819 raft_consensus.cc:606] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:20.658512  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.649623  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.652539  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.654335  7677 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260501 14:00:20.656271  7748 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:20.657325 11808 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:20.661974  7819 raft_consensus.cc:614] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:20.666909  7671 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:20.667563  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.668148  7751 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:20.665499  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.662703  7573 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10, now has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:20.670830  7752 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:20.669672  7675 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:20.671617 11929 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:20.673851  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.674727  7677 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:20.675390 11944 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:20.673002  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:20.676577  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.676947  7748 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:20.677834  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.678530  7673 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:20.679490  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.680207  7671 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:20.681872  7675 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260501 14:00:20.683178  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:20.683663 11929 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.685887  7752 raft_consensus.cc:606] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.687531  7752 raft_consensus.cc:614] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:20.685112  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.688977  7679 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
W20260501 14:00:20.696290  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.698629  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.690656  7573 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 9, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.702121  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:20.699510  7675 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:20.702828  7752 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:20.702028 11929 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.707649 11929 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.709771  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.710716  7679 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
W20260501 14:00:20.711844  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.720964  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.721328  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.722509  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.722945  7673 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260501 14:00:20.723389  7670 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:20.724545  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.725131  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.726024  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.717350  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.731470  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260501 14:00:20.732985  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:20.733572  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.737361  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:20.743594  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:20.745920  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:20.746181  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.748322  7674 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:20.752074  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 93746.7us
I20260501 14:00:20.747736  7573 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:20.753957  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.749142 11872 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:20.758019 11929 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:20.762009 11929 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:20.762440 11929 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:20.766342  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:20.760747  7573 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.770954  7573 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.771605  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.772339  7675 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:20.774263  7670 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260501 14:00:20.775568  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.776408  7679 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
W20260501 14:00:20.761142  7792 connection.cc:254] RPC call timeout handler was delayed by -1.3427650349999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260501 14:00:20.777735  7792 connection.cc:254] RPC call timeout handler was delayed by -1.3283010219998914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260501 14:00:20.777984  7792 connection.cc:254] RPC call timeout handler was delayed by -1.2833650349999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260501 14:00:20.778209  7792 connection.cc:254] RPC call timeout handler was delayed by -1.0286650350000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260501 14:00:20.778578  7792 connection.cc:254] RPC call timeout handler was delayed by -1.0249071229999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260501 14:00:20.781581  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.782972  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:20.782980 11870 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260501 14:00:20.785032  7679 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:20.786851  7670 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:20.788166  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:20.791520 11714 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:20.792382 11714 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.792734  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.784123  7573 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.794860 11714 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:20.795948  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.797375  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.796800  7573 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 11, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:20.798053  7752 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:20.800830  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.803797  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.807341  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.809311  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.811460 11870 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:20.811959 11870 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:20.812381 11870 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:20.815182  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.826540  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:20.826604  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 43741.1us
I20260501 14:00:20.816020 11835 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:20.833176 11835 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:20.834460 11835 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.836359  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.836463 11808 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:20.837476  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.838229  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.838644  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.838932 11835 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:20.840711  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.841389  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.842060  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:20.842779  7828 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:00:20.842841  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.844882  7752 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260501 14:00:20.845368  7752 pending_rounds.cc:85] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 5
I20260501 14:00:20.845623  7752 pending_rounds.cc:107] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260501 14:00:20.845883  7752 raft_consensus.cc:2889] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:20.838239  8374 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:20.839154  8379 raft_consensus.cc:2410] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260501 14:00:20.853363  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.854115  7748 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:20.854928  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:20.857518  7823 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 14:00:20.857928  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:20.858781 11799 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:20.859275  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:20.855676  8374 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:20.862869  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 80470.1us
I20260501 14:00:20.864619  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.865424  8379 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:20.781147 11872 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:20.877948  7828 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:20.877874  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:20.882469  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 43928.9us
I20260501 14:00:20.816862 11929 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.876401 11808 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:20.882181 11897 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:20.885878 11897 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:20.891973 11897 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:20.894002 11872 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:20.895136 11949 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.144s	user 0.000s	sys 0.003s
I20260501 14:00:20.901293  8374 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:20.910211  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.910974  7823 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:20.911986  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.912247  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.912985  7748 raft_consensus.cc:2410] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260501 14:00:20.913240  7752 raft_consensus.cc:2410] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:20.915189  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.917989  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.918716  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.918920  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.919440  7825 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:20.920511  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:20.920724  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.922647  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:20.925768  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:20.920539  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:20.929832  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.934007  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.934155  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.936290  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.940752  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.941154  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.936008 11808 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:20.942003  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.942895  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.944561 11808 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:20.946211  7625 auto_rebalancer.cc:285] failed to send replica move request: Illegal state: Replica ca8dd10afb304b4c96cfcec7e2309947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 14:00:20.950465  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45566.2us
I20260501 14:00:20.957710  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:20.960556  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.965974  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.972505  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.974239  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.975495  7822 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:20.976527  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:20.978163  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.979382  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.983596 11714 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:20.984138 11714 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:20.984561 11714 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:20.984807  7820 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:20.981566  7826 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:20.988688  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:20.989840  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.991132  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:20.991421  7718 connection.cc:254] RPC call timeout handler was delayed by -1.1885974109999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260501 14:00:20.991657  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:20.992353  7747 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:20.992652  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:20.993788 11944 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:20.994304 11944 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:20.995498  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:20.996527 11944 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:20.992756  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:20.970404 11863 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:20.997843 11863 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:20.998235 11863 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:20.998854  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:20.999737  8374 raft_consensus.cc:2410] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260501 14:00:20.990147  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:21.008769  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.009583  7752 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
W20260501 14:00:21.010070 11954 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260501 14:00:21.010161  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:21.011107  7827 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:21.014024  7824 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260501 14:00:21.014449  7824 pending_rounds.cc:85] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 11
I20260501 14:00:21.014673  7824 pending_rounds.cc:107] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260501 14:00:21.014912  7824 raft_consensus.cc:2889] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:21.016193  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.017062 11929 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.022449  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:21.022660  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:21.023342  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 55037.5us
I20260501 14:00:21.026687  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:21.027586  7643 connection.cc:254] RPC call timeout handler was delayed by -1.6837543609999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260501 14:00:21.027612  7820 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
W20260501 14:00:21.028195  7643 connection.cc:254] RPC call timeout handler was delayed by -1.247756519999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260501 14:00:21.026610  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:21.028544  7643 connection.cc:254] RPC call timeout handler was delayed by -1.247756519999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260501 14:00:21.028893  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1703565200000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260501 14:00:21.029217  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1550565200000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260501 14:00:21.029495  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1181565199999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260501 14:00:21.029776  7643 connection.cc:254] RPC call timeout handler was delayed by -1.0335565199999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260501 14:00:21.030417  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.031286 11723 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:21.031719 11723 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:21.033753 11723 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:21.049912 11897 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.052102  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.042906  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.054167 11944 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:21.055434  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.056106  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.056483 11670 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:21.056984 11670 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.057361 11670 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:21.058591 11897 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.059443  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.060006 11854 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:21.060456 11854 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.060885 11854 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.062135  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.063732 11958 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:21.065212 11958 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.065591 11958 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:21.064038 11900 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:21.070079  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.075757  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.085120  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.085179 11900 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:21.086166 11900 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.086580 11900 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:21.087018  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:21.089709 11958 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.087412  7751 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:21.085363  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.093262 11847 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:21.109977  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.025501 11870 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.111806  7747 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:21.135501 11958 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.109575 11959 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:21.134224 11799 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:21.135138 11961 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:21.112095 11723 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.155205 11799 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.144248 11959 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.162007 11921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b661856a9e45bf823981177d99ae0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:00:21.162364 11959 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:21.165946  7826 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:21.170437  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.151297 11835 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.182030  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.182871  7747 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:21.183533  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.154775 11961 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 14:00:21.185571  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 88867.8us
I20260501 14:00:21.164150 11799 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.184263  7751 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:21.162079 11723 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.189039  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:21.189474  7752 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260501 14:00:21.150434 11863 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:21.191047  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.192606  7747 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:21.197501  7820 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:21.199453  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:21.201653  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49691.9us
I20260501 14:00:21.187476 11961 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:21.218961  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.226302  7822 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:21.227043  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.235037 11847 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:21.243613 11670 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:21.249660 11966 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260501 14:00:21.249913 11929 raft_consensus.cc:993] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:21.250412 11929 raft_consensus.cc:1081] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
W20260501 14:00:21.254840  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.225216 11723 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260501 14:00:21.256338 11670 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.184060 11835 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.274416 11847 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:21.275972 11847 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:21.277009 11847 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:21.282544  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica ca8dd10afb304b4c96cfcec7e2309947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 14:00:21.285897  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 120851us
W20260501 14:00:21.285048  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet f9b540df5a794f06ab617858163d4297, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:21.287580  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet f9b540df5a794f06ab617858163d4297, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.275146 11870 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.268925 11714 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.296761 11835 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.289364  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.304030 11723 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:21.304522 11723 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:21.304934 11723 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:21.307075  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.307976 11670 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:21.308406 11670 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.308784 11670 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.309140  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:21.309959  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.310540  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:21.313560 11961 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.315585  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.317025 11961 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:21.321573 11975 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:21.322726 11975 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:21.328087  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:21.330077  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.330960 11870 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:21.331683 11974 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:21.332182 11974 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.332562 11974 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:21.335314 11863 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:21.341449 11900 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.344902 11900 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.354055  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.354866  8376 raft_consensus.cc:1813] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Handling vote request from an unknown peer 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.355556  8376 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:21.347035 11714 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:21.364382 11959 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.367197 11959 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.367231 11714 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.364562 11854 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.368489 11714 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.370366 11854 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.370507 11921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:51762 (request call id 579) took 2316 ms. Trace:
I20260501 14:00:21.370874 11714 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:21.373332 11921 rpcz_store.cc:276] 0501 14:00:19.053980 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:19.054799 (+   819us) service_pool.cc:224] Handling call
0501 14:00:20.178879 (+1124080us) ts_tablet_manager.cc:934] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
0501 14:00:21.153944 (+975065us) tablet_copy_client.cc:368] Tablet copy session begun
0501 14:00:21.277953 (+124009us) tablet_metadata.cc:665] Metadata flushed
0501 14:00:21.278085 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0501 14:00:21.369532 (+ 91447us) tablet_copy_client.cc:418] Wrote new consensus metadata
0501 14:00:21.369922 (+   390us) tablet_replica.cc:206] Creating consensus instance
0501 14:00:21.370320 (+   398us) ts_tablet_manager.cc:989] Replica registered.
0501 14:00:21.370389 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":17168,"tablet-copy.queue_time_us":1122132,"thread_start_us":1171016,"threads_started":2}
I20260501 14:00:21.377483 11921 tablet_copy_client.cc:806] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:00:21.378222 11921 tablet_copy_client.cc:670] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:00:21.379245  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:21.383494  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 73057.4us
W20260501 14:00:21.386042  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.388675  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:21.389899 11979 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:21.390271  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.390884  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.391732 11870 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:21.393173  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:21.393924 11870 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:21.394457  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.395471  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.395741  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.396178  8374 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:21.396540 11847 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:21.397117  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.398083  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.398384 11975 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:21.398754  8380 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:21.399202 11975 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:21.397173  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.400847  8371 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:21.397135 11847 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:21.407259 11847 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.397149  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:21.409771  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.410046 11975 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:21.410454 11975 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:21.410996 11975 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.411294 11723 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.410445  8376 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:21.381352 11670 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:21.419612 11670 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.421142 11182 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:21.421932 11979 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:21.423103 11974 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.431768  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:21.423106 11975 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.429955 11723 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.441220 11974 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.443854 11714 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.005s
I20260501 14:00:21.444993 11182 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260501 14:00:21.442234 11835 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:21.448640 11959 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:21.449759  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:21.449864 11959 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:21.450779 11835 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:21.451237 11835 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:21.452498 11981 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260501 14:00:21.464215 11835 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:21.452304  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.449148  7819 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.451303 11959 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.468418 11959 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:21.445204  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.454521  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.471159 11863 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:21.472321  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.473161 11723 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:21.473595  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.474448 11670 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:21.475090  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.475929 11854 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:21.476925  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:21.475129 11670 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:21.480463  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.482336  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:21.484997 11182 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:21.486991 11944 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:21.487385 11944 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:21.488636 11944 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.489825 11944 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.490747 11714 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:21.487308  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.493070  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:21.490125  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:21.494380 11182 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:21.495245  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.496217  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.497800  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.500150  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.500269  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.499519  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.501382  7675 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:21.502308  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.503368  7673 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:21.504776  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.501421 11799 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:21.506651  7671 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:21.506843 11799 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:21.507206  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.508097  7678 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:21.508600  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.509871 11182 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:21.510068 11870 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:21.510360 11182 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.510581  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.511026 11182 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:21.507316 11799 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.513890 11870 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:21.517371  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.518431 11870 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:21.518883 11870 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:21.519317 11870 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:21.531651  7750 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260501 14:00:21.528687  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.536264  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.533938  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.542351  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.544090  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.549872  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:21.550283  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.550464 11973 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:00:21.552088  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.551195  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.551476  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.551808  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.561126  7678 raft_consensus.cc:1813] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Handling vote request from an unknown peer 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:21.556384  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 47867.9us
I20260501 14:00:21.552120  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.552358  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.562402  7678 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:21.562754  7828 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:21.565873  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.568274  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:21.566156  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.570708  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.571478  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.541347 11714 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:21.541584 11897 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:21.587932  7828 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:21.578956  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.588194 11714 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.588188 11897 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:21.579352  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.589510 11897 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:21.579758  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.580772 11975 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.585577 11799 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.579249  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.576563  7672 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:21.591221 11714 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:21.605125  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.606050 11799 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.608177  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.618152 11870 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.620424 11870 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.626192  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.627564  7821 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.633291  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.632665 11182 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.671165  7672 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:21.676007  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.676846  7674 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:21.677390  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.677917 11973 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:21.678050 11835 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.679283 11973 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:21.679682 11973 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:21.679926  7825 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:21.672142  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.682240  7819 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:21.678148  7672 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
W20260501 14:00:21.685344  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77253.8us
I20260501 14:00:21.680624 11973 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.688256  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.688917  7674 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:21.689373 11973 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.692095 11897 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.694272 11897 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.683436 11961 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:21.697978 11974 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:21.709055  7674 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:21.704273 11961 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.714421 11897 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:21.715236  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.715463 11874 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:21.717388  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.717708  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.718077  7679 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:21.718994  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.714790 11961 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:21.720791  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.722355  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.723805  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:21.724443  7819 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:21.711344 11182 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.725679  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.720520 11897 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260501 14:00:21.724951 11958 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:21.727738 11958 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.729872 11958 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:21.730451  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.719724 11976 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260501 14:00:21.734804  7676 raft_consensus.cc:2410] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:21.735450  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:21.734803  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.733399  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.741866  7821 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:21.735427 11897 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:21.743636  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.744378  7672 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:21.745741 11897 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:21.746178  7679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:21.747114  7672 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:21.746762 11897 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.747638  7679 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:21.748031  7679 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:21.748368 11897 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:21.749186  7670 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:21.749778  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:21.750221  7678 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:21.750293  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:21.750478  7676 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:21.751215  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:21.751381  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:21.751806  7674 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:21.751951  7673 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:21.744040  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.749866  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.765671 11974 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:21.766317 11974 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:21.767364 11974 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.762912 11835 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.776578  7674 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:21.778568 11961 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.784897  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:21.785751  7753 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 14:00:21.785851  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54372.9us
I20260501 14:00:21.786922  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.781284 11959 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:21.788087 11976 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:21.788305 11959 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.788744 11976 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:21.788861 11959 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:21.789261 11976 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:21.796370  7753 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260501 14:00:21.804176  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54404.1us
I20260501 14:00:21.805895  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:21.805027  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.824735  7673 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:21.800817 11847 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:21.814803 11989 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:21.829200  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.833076 11847 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:21.833217 11972 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:21.833742  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.834671 11847 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:21.835170  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:21.838914  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:21.842695  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55914.4us
I20260501 14:00:21.833784 11972 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:21.844286  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 43482.8us
I20260501 14:00:21.844997  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.846149  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:21.846349  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.846433  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.846869  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.849620  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.850319 11874 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:21.850829 11874 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:21.851437 11874 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:21.843714 11972 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:21.850883 11973 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:21.856612 11973 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.859050 11973 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:21.860098 11961 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.859880 11958 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.864502 11958 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:21.866094 11975 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:21.861213  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.871112  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.832046  7679 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:21.876698  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.880954  7679 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.866837 11975 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260501 14:00:21.886374  7819 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:21.889773  7750 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:21.890743  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:21.876410 11959 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.895955  8376 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:21.896481  8379 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:21.897888  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.898468  8376 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:21.898978  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:21.899907  8380 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:21.900017 11670 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:21.900847 11670 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:21.901734  8372 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260501 14:00:21.905452  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.899052  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:21.908656  7750 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:21.903419 11670 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:21.909904  7819 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:21.916213  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.918948  8377 raft_consensus.cc:2368] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11.
I20260501 14:00:21.882454 11872 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:21.921866  7746 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:21.855592 11976 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:21.887436 11847 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:21.926815  8374 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:21.904923 11799 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:21.946350  7750 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 14:00:21.928874  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:21.939159  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 283) took 6792 ms. Trace:
I20260501 14:00:21.924371 11872 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:21.893080 11989 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260501 14:00:21.988140  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 82769.7us
I20260501 14:00:21.989399  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.996291  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:21.997787  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 68155.3us
I20260501 14:00:21.929502 11670 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.007998  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:22.008539  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:21.953953  7573 rpcz_store.cc:276] 0501 14:00:15.146592 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:15.157404 (+ 10812us) service_pool.cc:224] Handling call
0501 14:00:21.939035 (+6781631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:21.165877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:21.275679 (+109802us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:21.275737 (+    58us) write_op.cc:435] Acquired schema lock
0501 14:00:21.275755 (+    18us) tablet.cc:662] Decoding operations
0501 14:00:21.277406 (+  1651us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:21.277512 (+   106us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:21.277539 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0501 14:00:21.279005 (+  1466us) tablet.cc:701] Row locks acquired
0501 14:00:21.279020 (+    15us) write_op.cc:260] PREPARE: finished
0501 14:00:21.279195 (+   175us) write_op.cc:270] Start()
0501 14:00:21.279340 (+   145us) write_op.cc:276] Timestamp: P: 1777644021279129 usec, L: 0
0501 14:00:21.279407 (+    67us) op_driver.cc:348] REPLICATION: starting
0501 14:00:21.348884 (+ 69477us) log.cc:844] Serialized 7981 byte log entry
0501 14:00:21.672912 (+324028us) op_driver.cc:464] REPLICATION: finished
0501 14:00:21.757004 (+ 84092us) write_op.cc:301] APPLY: starting
0501 14:00:21.757110 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:21.758697 (+  1587us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:21.758841 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:21.766858 (+  8017us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:21.767294 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=38
0501 14:00:21.767345 (+    51us) write_op.cc:312] APPLY: finished
0501 14:00:21.768233 (+   888us) log.cc:844] Serialized 132 byte log entry
0501 14:00:21.769180 (+   947us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:21.769390 (+   210us) write_op.cc:454] Released schema lock
0501 14:00:21.769471 (+    81us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:21.769920 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:21.769949 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91773,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":83691,"apply.run_cpu_time_us":6153,"apply.run_wall_time_us":12933,"num_ops":19,"prepare.queue_time_us":193127,"prepare.run_cpu_time_us":11778,"prepare.run_wall_time_us":238116,"raft.queue_time_us":145782,"raft.run_cpu_time_us":23978,"raft.run_wall_time_us":97882,"replication_time_us":374011,"thread_start_us":165487,"threads_started":4,"wal-append.queue_time_us":31531}]]}
I20260501 14:00:21.963461 11799 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:21.987666 11872 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.019508 11929 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:22.017966 11975 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.023181 11976 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:22.024614 11959 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.023888  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 12 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:22.015235 11972 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:22.027114 11972 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.010145 11863 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260501 14:00:22.032079 11914 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:22.032536 11914 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:22.033485 11914 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.041158  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:22.042335 11972 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:22.043349  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.056423 11972 raft_consensus.cc:2764] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260501 14:00:22.056762  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:22.059324  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:22.059651 11799 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.060443 11975 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:22.061023 11975 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:22.062094 11975 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:22.043582 11997 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260501 14:00:22.015522 11847 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.025746  7577 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:22.066313  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.071535  7746 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:22.074520  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:22.088411  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:22.074383  7577 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 6, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260501 14:00:22.079177 11973 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:22.087519 11897 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.097687 11974 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:22.113988  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:22.114487 11974 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:22.100739  7577 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 4 to 8, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:22.087616 11979 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260501 14:00:22.117801  7577 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 9, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:22.120982  7577 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:22.124810  7577 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:22.110275 11973 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:22.119081 11974 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:22.142333  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:22.145140  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 230328us
I20260501 14:00:22.146278  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.146530  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.222590  8374 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:22.158119 11914 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.153470 11944 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:22.168391 11872 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.223881 11944 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:22.224345 11944 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:22.169024 11874 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:22.225850  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.226370 11872 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:22.228849 11874 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:22.226490  7825 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:22.184396 11998 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260501 14:00:22.207463  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:22.231163  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 140135us
I20260501 14:00:22.238355 11944 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.213035  7577 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 11, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 11 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:22.250921  7828 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260501 14:00:22.251605  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.252975  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.252918  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.254113  7819 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:22.255473  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 113267us
W20260501 14:00:22.257170  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.253916  7577 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 8, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:22.258719  7824 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:22.220918 11973 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:22.259316  8377 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:22.262594  7748 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260501 14:00:22.263056  8374 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:22.263247  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:22.264750  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.265590 11965 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:22.266469  7819 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:22.277093  7821 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260501 14:00:22.267072  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.268096  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.278302  7822 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.269358  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.270991  7749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:22.278548  7746 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:22.279246  7746 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:22.281065  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.283314 11944 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:22.283679  7746 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:22.258839 11914 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:22.285368  7746 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.268780  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.268198  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:22.285111 11914 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.278497  7577 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:22.257428 12003 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:22.288816  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.289561  7577 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 9, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:22.290843  7822 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:22.330245  7824 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 12. Ops: []
I20260501 14:00:22.293947 12003 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:22.340104 11914 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.341185 11897 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:22.293040 11944 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260501 14:00:22.342258  7747 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:22.289420 11975 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:22.344014 12014 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:22.344202 11975 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.344803 12017 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:22.345397  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.346524 11975 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.347476 12006 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:22.295682 11959 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:22.350181  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:22.353544  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 72567.4us
I20260501 14:00:22.354466  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.361831 11847 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:22.289913 12004 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260501 14:00:22.332760 11961 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260501 14:00:22.365123 11961 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:22.365576 11961 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.288302 11965 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.366510 11961 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.340273 12003 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:22.299525 11670 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:22.368316 11670 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:22.340724 12012 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260501 14:00:22.367280 11975 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:22.366358  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:22.379643  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 49900.7us
I20260501 14:00:22.380930 12022 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:22.381222  7746 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:22.382081 12022 consensus_queue.cc:1243] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260501 14:00:22.382609 11958 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:22.382973 11958 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.383967 11958 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.385082 12022 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:22.387358 11958 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:22.387548  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:22.387961 11921 tablet_copy_client.cc:538] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:00:22.390630 12022 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:22.391319 12022 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.392602 12022 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.397382  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.399633  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:22.400767  8374 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:22.402340  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.378116 11961 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:22.411201  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:22.411458  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.411998  8371 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:22.422582  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.410296 11799 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:22.423571 11799 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.424067 11799 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.415875  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.408064 12004 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.409508 11972 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260501 14:00:22.435353  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 69105.5us
I20260501 14:00:22.438283  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.438848 11965 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.440351  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.441300 11959 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:22.441365 11975 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:22.441902 11959 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.442494 11975 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:22.431744 11974 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.442924 11959 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:22.433511  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 79148us
W20260501 14:00:22.447355  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 97284.7us
I20260501 14:00:22.447870  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.448366  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.445618 11974 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.446058  7749 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.451668  7749 raft_consensus.cc:614] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:22.437244 11670 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.452490 11914 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:22.456315  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.457384  7746 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:22.460103  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.462898  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:22.464166  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.465269  7746 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:22.459729 11921 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 14:00:22.468138 12007 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:22.468987 11847 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:22.469532 11847 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:22.470983 11182 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:22.474565  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.470753 11847 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.473656  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.477137  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.478240 12007 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.478852  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.478097 11944 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:22.479663 12007 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:22.480367 12007 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:22.481104 11874 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:22.481992 11874 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:22.482336 11874 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:22.482474 12007 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:22.482848 12007 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:22.480759  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:22.486234  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:22.487788  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.456106 12006 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:22.490252 12001 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:22.490839 11872 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:22.487687 11863 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.500957 11944 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:22.506970 12023 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:22.507395 12023 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.508327 12023 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.509692 12023 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:22.466282 11914 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.512671 11914 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.483693 12007 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.514843 12007 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.461321 11965 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.520536  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:22.521281  7747 raft_consensus.cc:606] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.523919 11973 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.524379  7828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:22.525285  7753 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:22.525265  7828 raft_consensus.cc:606] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.525938  7828 raft_consensus.cc:614] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:22.526204 11973 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.483256 11874 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.527503 11874 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.536032 11974 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:22.536319 11847 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:22.536691 11974 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.537158 11974 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.540103 11959 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:22.545538  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.546857 11965 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:22.547276 11965 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.547654 11965 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:22.549876 12003 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.551278  8377 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.556876 11799 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.559571 11799 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.560777  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.561858 11799 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:22.562506 11835 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:22.563587  8377 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:22.564646 11799 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.565207 11799 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:22.566435  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.562680  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.569316  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.570814  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.572285 11835 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:22.572383  7753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "962840f0434049bbb395d330e010962d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:22.572715 11835 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.572921 11872 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:22.573132  7753 raft_consensus.cc:606] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.573151 11835 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:22.576122  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:22.571743  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 85589.9us
I20260501 14:00:22.585893  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.591213  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.592680  7792 leader_election.cc:400] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11.
I20260501 14:00:22.573349 11872 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:22.592973  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:22.593019  7792 leader_election.cc:403] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:22.570179 11973 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.597646  7753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:22.582002 11897 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:22.598155  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:22.603293  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.597942 12002 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
W20260501 14:00:22.648959  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.610466 12003 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.612416  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.618901 11799 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.624810 11872 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.585476 11929 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.633102  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.639917 11854 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:22.655220 11854 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:22.596271 12015 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:22.655380 11872 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:22.597772 11847 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:00:22.644793  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 59141.6us
I20260501 14:00:22.657892 11799 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:22.658494 11854 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:22.659948  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:22.644794  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46753.9us
I20260501 14:00:22.654134  7828 raft_consensus.cc:2368] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12.
I20260501 14:00:22.650121 11670 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.655472 11863 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:22.658829 12002 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:22.649495  8380 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
W20260501 14:00:22.650749  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 64949.8us
I20260501 14:00:22.665546  8344 leader_election.cc:400] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12.
I20260501 14:00:22.667856  8344 leader_election.cc:403] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260501 14:00:22.648803 11914 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11.
I20260501 14:00:22.670365  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.675542  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.677798  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:22.666368 11863 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:22.678618 11972 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260501 14:00:22.689216  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.672210 12003 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12.
I20260501 14:00:22.666227 11847 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260501 14:00:22.682467 11929 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:22.702131  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:22.688688 11979 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:22.688978 12015 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:22.675127 11670 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260501 14:00:22.711795  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.712651  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.713702  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.715365  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.715663  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.716518  7674 raft_consensus.cc:2410] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260501 14:00:22.721511  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.721220 11973 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:22.722649  7677 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:22.720398 11929 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260501 14:00:22.721065  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.724817  7672 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260501 14:00:22.726737  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.727046  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.727589  7678 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:22.727665  7672 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 4.
I20260501 14:00:22.706322 11799 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:22.729350  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.729967  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:22.730309  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.730516  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:22.731088  7674 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:22.731283  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:22.709182 11874 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:22.729434 11799 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:22.732076  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.732363 11799 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.731626 11914 raft_consensus.cc:2955] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Committing config change with OpId 10.6: config changed from index -1 to 6. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:22.732914  7679 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:22.734462  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.732110 11874 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:22.736771 11874 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.730022  7747 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.741722  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:22.743607  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:22.736138 11863 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.745057  7751 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:22.744416  7750 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:22.747500  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.709797 12004 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:22.719266 12001 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:22.738127 11874 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:22.719317 12017 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:22.749439  7750 raft_consensus.cc:2955] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Committing config change with OpId 10.6: config changed from index -1 to 6. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:22.756443  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.758401  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.759208  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:22.759894  7676 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:22.760674 11863 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:22.762914 12006 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:22.763473 12015 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:22.763988 12015 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:22.764236  7824 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:22.765113 12015 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.720134 11965 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.767616 11959 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:22.768775 11959 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:22.768923 11965 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.769150 11959 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.764042  7825 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:22.770066 11959 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.771325 11959 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.737476 11835 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.749588 11854 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.755489 11929 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:22.755558 11972 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:22.754876 11973 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:22.782446  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:22.783068  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:22.788067  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:22.788516  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.788829  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.757743 11979 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:22.780249 12017 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:22.789695  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.790079  7825 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260501 14:00:22.790689  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.795284  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:22.796970  8372 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:22.799458  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.799789  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.800616  7819 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:22.802763  7752 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:22.803254  8376 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:22.803387  7753 raft_consensus.cc:606] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.800390  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:22.803967  7753 raft_consensus.cc:614] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:22.804538  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:22.804171 12014 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:22.808825  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:22.796072 11965 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260501 14:00:22.810114  8371 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:22.778297 12003 consensus_queue.cc:1059] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260501 14:00:22.785894 11929 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:22.791081 11972 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:22.792544 11973 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:22.826474 12014 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:22.791956 11854 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:22.873320  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 73004.2us
I20260501 14:00:22.877184  7747 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:22.877331 11182 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Stepping down as leader of term 6
I20260501 14:00:22.877926 11182 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:22.840669 11965 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:22.860015 11973 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:22.880451  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:22.883589 11182 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:22.886858  7672 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:22.893204  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.895642  7675 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:22.897171  7670 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:22.899948  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.901921  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.902606  7672 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.904636  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.905068 11182 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:22.881731 11965 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:22.916451  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.916673  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.917347  7671 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:22.921797  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.921977  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.922823  7675 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:22.922951  7670 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:22.936270  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:22.937139  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 57907us
I20260501 14:00:22.938207  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:22.939186  7747 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:22.939527  7747 raft_consensus.cc:614] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:22.939551  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:22.881673 12014 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.977447 12014 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:22.978225 12014 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:22.943312  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:22.944283 12042 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:22.901492 12017 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:22.913869 11929 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.984688 11929 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:22.915028 11965 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:22.996253 12041 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:22.997002 12041 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:22.998169 12041 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:22.953318 11835 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:23.018446  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:22.950385 11799 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:22.953455  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.923795 12034 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
W20260501 14:00:22.937107 12028 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260501 14:00:23.041324  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:22.971423 12036 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260501 14:00:22.972687  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:22.975003  7821 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:22.978925  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:23.065709  7677 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:23.019784  7674 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
W20260501 14:00:23.027449 12023 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.004s
I20260501 14:00:23.024966  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 14:00:22.969099 12029 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260501 14:00:23.032727  7671 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:23.082743  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:23.023406  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:23.046325 11958 consensus_meta.cc:287] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.001s
I20260501 14:00:23.067540 11182 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:23.088541 11182 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.027962 11897 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:00:23.070866  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 328739us
I20260501 14:00:23.081595  7747 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260501 14:00:23.066901  7753 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260501 14:00:23.066960  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.090412  7671 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260501 14:00:23.093014  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:23.100783  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:23.033111 12034 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:22.896015 11972 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:23.103631  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 151872us
I20260501 14:00:23.065135 12041 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:23.106642  7670 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:23.107237  8371 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260501 14:00:23.107745  7671 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: []
I20260501 14:00:23.102963  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:23.110457 11182 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:23.113112  7670 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260501 14:00:23.114583  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:23.026032 12014 consensus_queue.cc:1175] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca8dd10afb304b4c96cfcec7e2309947" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260501 14:00:23.121023  8379 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260501 14:00:23.121512  8379 pending_rounds.cc:85] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 8
I20260501 14:00:23.121733  8379 pending_rounds.cc:107] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260501 14:00:23.121985  8379 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:23.120525  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.103890 11835 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:23.125370  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.126101  7671 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:23.126173  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.126911  7676 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:23.128952  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:23.130249 11847 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.132481  7751 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:23.134222 12034 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.136896  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:23.137125  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:23.117725 11670 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:23.152882  7747 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
W20260501 14:00:23.125698 11974 consensus_meta.cc:287] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.005s
I20260501 14:00:22.983531 12017 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.160606  8374 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:23.107484 12023 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260501 14:00:23.162477  7672 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:23.147449 12039 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260501 14:00:22.907286 11979 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:23.168491  7676 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260501 14:00:23.165884  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:23.136504 11975 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:23.157891  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:23.177865  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:23.156391 12004 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:23.121201 12037 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260501 14:00:23.164243 11914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45434 (request call id 28) took 1719 ms. Trace:
I20260501 14:00:23.188422 11872 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:23.188827  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.189990  7746 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:23.190968  7751 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:23.191736 12033 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:00:23.196755  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.192422 12051 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:23.197410  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.197413 12051 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.198278 11863 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:23.200007  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.192646 12037 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:23.200860 11863 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.201040 12037 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:23.202385  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.203135 12051 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.203191 11863 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:23.164851 11874 consensus_queue.cc:1059] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260501 14:00:23.136013 11835 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.170073 11854 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:23.210282  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.147850 12001 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260501 14:00:23.211584  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:23.202015 12037 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.183276 12038 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:23.186887 12004 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:23.240271  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.241499 12030 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:23.170636 11974 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.166088 12049 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:23.176470 11670 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.206908 11897 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260501 14:00:23.264233  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52774.5us
W20260501 14:00:23.266888  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 157748us
W20260501 14:00:23.293746  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 136597us
I20260501 14:00:23.293218  7752 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:23.268548 12004 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:23.272469 11799 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.277128 12051 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:23.308728  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.308599  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.281072 12030 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:23.310348  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:23.292989 12037 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:23.311151  7746 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
W20260501 14:00:23.315299  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.317013  7826 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:23.316053  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.272174 12038 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.194845 11914 rpcz_store.cc:276] 0501 14:00:21.431786 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:21.431984 (+   198us) service_pool.cc:224] Handling call
0501 14:00:21.469019 (+ 37035us) log.cc:844] Serialized 437 byte log entry
0501 14:00:21.673695 (+204676us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b54003d02a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa661f06 00007fb2fa65b87a 00007fb2fa65aaf4 00007fb2fa63b28a 00007fb2fa642133 00007fb2fa6420b9 00007fb2fa642049 00007fb2fa642011 00007fb2fa6411dd 0000000000379254
0501 14:00:21.720766 (+ 47071us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b54003d02a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa65a522 00007fb2fa63b28a 00007fb2fa642133 00007fb2fa6420b9 00007fb2fa642049 00007fb2fa642011 00007fb2fa6411dd 0000000000379254 0000000000379099 00007fb2f7643ab5
0501 14:00:23.151208 (+1430442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20836,"raft.queue_time_us":245,"raft.run_cpu_time_us":8138,"raft.run_wall_time_us":229016,"spinlock_wait_cycles":26230016,"thread_start_us":122571,"threads_started":1,"wal-append.queue_time_us":143197,"wal-append.run_cpu_time_us":4469,"wal-append.run_wall_time_us":1066456}
I20260501 14:00:23.344265  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:23.307780 12051 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:23.361410  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.440676  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.341040 11974 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:23.348964 12046 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260501 14:00:23.350757 11799 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:23.319275  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:23.448905  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 291103us
W20260501 14:00:23.447676  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:23.451514  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 135556us
W20260501 14:00:23.329102 12048 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260501 14:00:23.455658  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.456123  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.457479  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.342335 11670 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.461534  7819 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:23.470661  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 607) took 1066 ms. Trace:
I20260501 14:00:23.471112  8374 rpcz_store.cc:276] 0501 14:00:22.403900 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:22.404009 (+   109us) service_pool.cc:224] Handling call
0501 14:00:23.470449 (+1066440us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400295754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:23.470557 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595709184}
I20260501 14:00:23.311480 12049 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.162s
I20260501 14:00:23.476372 11872 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:23.476984 11872 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:23.478132 11872 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.479790 11872 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:23.350927 12030 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:23.490212  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.343864 11835 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:23.452941 12051 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:23.495932  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.452590 11959 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:23.460981 11958 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260501 14:00:23.499922 11974 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.377743 11973 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.384184 11965 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.331946 12060 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:23.509589  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69016.1us
W20260501 14:00:23.509905  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45631.8us
I20260501 14:00:23.459426 11944 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:23.511595  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:23.532060  7822 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:23.459776 11961 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:23.535075  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:23.503149 12038 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:23.513865  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54987.7us
I20260501 14:00:23.513137  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:23.518321  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:23.528749 12058 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:23.514803 12032 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260501 14:00:23.504419 12001 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:23.537722  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.539044  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:23.540735  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:23.541330  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:23.542093  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:23.514250 12017 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:23.543007  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:23.543722  7747 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:23.592608  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:23.544289  7753 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:23.545446  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 5cde3c3e4a3b462b8f274fec8e2adbe3, TS 109c9ba263c34ff8aee17bc446cf258e -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.546114  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:23.594197  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 5cde3c3e4a3b462b8f274fec8e2adbe3, TS 109c9ba263c34ff8aee17bc446cf258e -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:23.594759  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48729.9us
I20260501 14:00:23.547642  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.550138  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:23.550467  7824 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:23.550848  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:23.554620  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:23.564632 12063 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:23.571998 12038 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:23.573455 11874 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:23.574290  7676 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:23.531690 12060 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.577107  7825 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260501 14:00:23.581246 11973 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:23.545895  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:23.619763  7679 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:23.517400 11835 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260501 14:00:23.619024 12060 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:23.584122  7671 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
W20260501 14:00:23.596052  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54047.2us
I20260501 14:00:23.610806 12004 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.626276 12038 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:23.627585  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.611048 12041 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.606586 12063 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:23.635802 12070 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:23.636129 12063 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:23.636456 12070 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:23.637888  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:23.637629 12070 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.638466  8374 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:23.638923 12070 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:23.639703  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:23.640188  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 102560us
I20260501 14:00:23.640513  8377 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:23.640977  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:23.515496 11979 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260501 14:00:23.641888  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:23.611570  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.592770  7678 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:23.610525  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:23.618992 11965 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.632200  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:23.634349  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:23.626036  7827 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260501 14:00:23.607972 11961 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:23.647324  8374 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:23.647938  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:23.608198  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 60598.3us
I20260501 14:00:23.654106  7749 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:23.657667  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:23.659432  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.669631  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.642158 12030 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:23.612596 11874 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:23.673062  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.675254  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:23.652045 11914 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260501 14:00:23.652563 11944 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election won for term 11
W20260501 14:00:23.745314  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 68082.9us
I20260501 14:00:23.651495 11670 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:23.750728  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:23.741943  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.658360 11961 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:23.742955  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.664731 12037 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:23.668875 12060 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:23.675706 11959 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.652819 12032 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
W20260501 14:00:23.770422  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 112127us
I20260501 14:00:23.678689 12041 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:23.775537  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.768925  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:23.776268  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 103284us
I20260501 14:00:23.782418  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.747844 12001 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:23.786479  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:23.678224 11835 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260501 14:00:23.765690 11961 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:23.770007 11872 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:23.765817 11944 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:23.748045 11914 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:23.814800 11914 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:23.790642 11799 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:23.772557 12037 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:23.771332 11974 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:23.778717 11979 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:23.788225 12007 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:23.779202 11897 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260501 14:00:23.789669 12041 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:23.825131  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49704.7us
I20260501 14:00:23.849478  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.813437 11965 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:23.831343 12038 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:23.813350 11975 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.832113 11944 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.869001 12041 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.813627 11872 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.813277 11874 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.835860 12004 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.840121  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:23.845623  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 2.021s (SENT) [suppressed 19 similar messages]
I20260501 14:00:23.850829  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.881043  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.882725 12004 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:23.883592 12004 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:23.890636  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.895994 12037 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.897532 12037 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:23.853137 12068 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260501 14:00:23.820760 11799 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:23.877179 11872 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.878103 11874 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:23.789333 11670 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260501 14:00:23.909868  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.860615 12002 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:23.891268 12063 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:23.905884 11799 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:00:23.945901  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 119440us
W20260501 14:00:23.947373  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 165063us
W20260501 14:00:23.947572  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 102016us
W20260501 14:00:23.952847  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.932731 12030 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.954938  7747 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:00:23.950184  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:23.960534  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.965432  7823 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:00:23.965927 12063 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:23.948272 12002 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:23.968240 12002 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:23.970295 12002 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:23.940609 12035 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:23.972608  7678 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:23.979852  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:23.989761 12007 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:23.991847 12063 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:23.997996 12041 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:23.998657 12041 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:23.999482 12015 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:23.999993 12015 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:23.999630 12041 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.000694 11944 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:00:24.000865 12015 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.001710 11944 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:24.002139 11944 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:24.003033 11944 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.003538  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.006691  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:24.008495 11944 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:24.008819  7827 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:24.008258  7823 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
W20260501 14:00:24.012877 12064 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.395s	user 0.004s	sys 0.000s
I20260501 14:00:24.021787 11914 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.023226  7824 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 4. Current term is 5. Ops: []
W20260501 14:00:24.029762  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:23.895664 11961 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.058995  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:24.056550  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:24.024448 12067 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.360s	user 0.001s	sys 0.002s
I20260501 14:00:24.061359 11897 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.061977 11897 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.066913 11897 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:24.073295 12074 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
W20260501 14:00:24.074406 12073 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.456s	user 0.002s	sys 0.000s
I20260501 14:00:24.075542  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1833) took 1008 ms. Trace:
W20260501 14:00:24.076704 12079 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260501 14:00:24.036506 12042 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.080269 12042 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.081050 12015 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:24.084061  8377 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:24.060729  8376 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:23.971735 12051 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.084262 11972 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:24.107652  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:24.108844  7576 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 9, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 9 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.107806  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:24.076237  7670 rpcz_store.cc:276] 0501 14:00:23.067634 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:23.149099 (+ 81465us) service_pool.cc:224] Handling call
0501 14:00:23.171396 (+ 22297us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:23.180500 (+  9104us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:23.180552 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:23.185314 (+  4762us) log.cc:844] Serialized 26 byte log entry
0501 14:00:23.530970 (+345656us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18000cdf60. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:23.660940 (+129970us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:23.740033 (+ 79093us) log.cc:844] Serialized 14 byte log entry
0501 14:00:23.938201 (+198168us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:23.938319 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:24.006655 (+ 68336us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b18000cdf60. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:24.072270 (+ 65615us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:24.075205 (+  2935us) raft_consensus.cc:1685] finished
0501 14:00:24.075261 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:24.075451 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43261,"prepare.queue_time_us":83912,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":97742,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":5193,"spinlock_wait_cycles":51196928,"thread_start_us":284187,"threads_started":2,"wal-append.queue_time_us":579931}
I20260501 14:00:24.110607  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.111261  7675 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:24.032331 12030 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:24.113652  7576 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.057708 12034 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:24.112969 12035 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260501 14:00:24.117394  7823 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:24.114514 12017 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:24.119489  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.132455  7821 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:24.119876 12088 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:24.120409  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.121243 12063 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:24.121708 11874 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.122602  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:24.123065  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:24.124825  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:24.125948  7828 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:24.124689  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:24.130414  7678 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260501 14:00:24.133090 11182 consensus_queue.cc:1059] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:24.134542  7827 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:24.137501  8374 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:24.144033  7676 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:24.113809 11914 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.141921  8377 raft_consensus.cc:2376] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11. Re-sending same reply.
I20260501 14:00:24.157001  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:24.163386 12092 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260501 14:00:24.142930 12035 consensus_queue.cc:1243] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260501 14:00:24.142644 11670 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260501 14:00:24.165442 12071 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.167599 12042 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.153496 12049 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.167762 12051 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:24.142800 12030 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.131572 12017 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:24.192045 12017 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.193261 12030 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.172317 12041 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:24.165493 11961 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:24.182649  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:24.197064  7748 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:24.197270 12066 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.573s	user 0.003s	sys 0.000s
I20260501 14:00:24.199060  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 656) took 1112 ms. Trace:
I20260501 14:00:24.190609 11897 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:24.190737 12049 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.199434  8372 rpcz_store.cc:276] 0501 14:00:23.086583 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:23.086952 (+   369us) service_pool.cc:224] Handling call
0501 14:00:23.106498 (+ 19546us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:23.119219 (+ 12721us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:23.119262 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:23.154559 (+ 35297us) log.cc:844] Serialized 52 byte log entry
0501 14:00:23.484507 (+329948us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b1800384220. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:23.511071 (+ 26564us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:23.530309 (+ 19238us) log.cc:844] Serialized 14 byte log entry
0501 14:00:23.562784 (+ 32475us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:23.562892 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:24.196416 (+633524us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:24.198829 (+  2413us) raft_consensus.cc:1685] finished
0501 14:00:24.198854 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:24.198998 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14417,"prepare.queue_time_us":12187,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":41043,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":257,"spinlock_wait_cycles":59108224,"thread_start_us":306084,"threads_started":1,"wal-append.queue_time_us":440280}
I20260501 14:00:24.201330  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:24.201841 12049 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.202284 11929 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:24.182181 12014 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:24.202847 11929 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:24.203091 12014 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:24.203572 12014 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:24.203945 11929 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.205216 12058 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:24.205642 12058 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:24.206480 12058 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:24.202977  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 322011us
I20260501 14:00:24.205238  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:24.156423 12061 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:24.216280 11182 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:24.216864  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:24.218705  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:24.221509 11182 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.155246 11874 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.227205 11874 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.207983 12071 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.230003 12071 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.233337 11799 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.234544  7746 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:24.236537 12084 raft_consensus.cc:3055] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Stepping down as leader of term 4
I20260501 14:00:24.236992 12084 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:24.237855 12084 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.238955 12084 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:24.241225 12062 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:24.241564  7643 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:00:24.242095  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 96743.4us
I20260501 14:00:24.246248  7676 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:24.247607  7576 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 4 to 7, VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) evicted. New cstate: current_term: 7 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:24.220474 12042 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:24.221963 12058 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:24.254752 12063 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.255321 12063 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.257314 12023 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.257712 12063 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.257874 12023 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.258965 11974 raft_consensus.cc:993] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:24.259407 11974 raft_consensus.cc:1081] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:24.260691 12038 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.261252 12038 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.267696  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:24.268599  7746 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:24.272059  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:24.263533 12038 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.292604 12062 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:24.293267 12062 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:24.293671 12062 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.276795  7576 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.301512 11182 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.300994  7576 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:24.303361 12062 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.306860 12062 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:24.307494 12001 consensus_meta.cc:287] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.003s
I20260501 14:00:24.308151 12001 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:24.310062  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:24.311115  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:24.235584 11799 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.330607  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:24.331322  7821 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.324013  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 314) took 4112 ms. Trace:
I20260501 14:00:24.303085  7576 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:24.331161  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.316506  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.334790  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:24.336196  7576 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.337502  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.339287  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:24.340732  7746 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:24.341066  7576 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.345434  8372 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:24.329437  7748 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:24.342664  7576 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.354652  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.342795 12038 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.357523  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.357538  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.356489  7576 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:24.359728  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:24.360029  7576 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:24.362352  7678 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:24.363121  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:24.284690 11974 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.363317  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.367945  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.363778  7679 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:24.360702  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:24.369998  7746 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.370532  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.369911  7670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:38240
I20260501 14:00:24.372488  7670 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:24.373019  7670 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.368336  7824 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:24.373329  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.332489  7577 rpcz_store.cc:276] 0501 14:00:20.166103 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:20.166416 (+   313us) service_pool.cc:224] Handling call
0501 14:00:24.278491 (+4112075us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:22.478249 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:22.478921 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:22.478962 (+    41us) write_op.cc:435] Acquired schema lock
0501 14:00:22.478981 (+    19us) tablet.cc:662] Decoding operations
0501 14:00:22.480477 (+  1496us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:22.480561 (+    84us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:22.480590 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0501 14:00:22.696393 (+215803us) tablet.cc:701] Row locks acquired
0501 14:00:22.697597 (+  1204us) write_op.cc:260] PREPARE: finished
0501 14:00:22.703486 (+  5889us) write_op.cc:270] Start()
0501 14:00:22.708691 (+  5205us) write_op.cc:276] Timestamp: P: 1777644022703421 usec, L: 0
0501 14:00:22.710032 (+  1341us) op_driver.cc:348] REPLICATION: starting
0501 14:00:22.738385 (+ 28353us) log.cc:844] Serialized 4483 byte log entry
0501 14:00:23.149938 (+411553us) op_driver.cc:464] REPLICATION: finished
0501 14:00:23.242613 (+ 92675us) write_op.cc:301] APPLY: starting
0501 14:00:23.242710 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:23.243601 (+   891us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:23.243703 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:23.324066 (+ 80363us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:23.324344 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0501 14:00:23.324390 (+    46us) write_op.cc:312] APPLY: finished
0501 14:00:23.324794 (+   404us) log.cc:844] Serialized 83 byte log entry
0501 14:00:23.325051 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:23.325233 (+   182us) write_op.cc:454] Released schema lock
0501 14:00:23.325294 (+    61us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:23.325909 (+   615us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:23.325947 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3618,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":83657,"apply.run_cpu_time_us":5259,"apply.run_wall_time_us":83252,"num_ops":11,"prepare.queue_time_us":72925,"prepare.run_cpu_time_us":5891,"prepare.run_wall_time_us":271284,"replication_time_us":409250,"thread_start_us":68760,"threads_started":2}]]}
I20260501 14:00:24.338336 12070 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.340375 12088 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.386080  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:24.372346  7576 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:24.386462  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:24.396605  7746 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:24.408435  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:24.411836  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.412308  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.412645  7673 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:24.413619  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:24.362421 12007 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:24.417999  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.357460 12049 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.363205 12023 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:24.374034 12003 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.373800 12058 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.374778 11799 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.362763 11854 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260501 14:00:24.444576 12087 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260501 14:00:24.383155 11972 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.383888 12062 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.367064 11979 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.353181 11914 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260501 14:00:24.423666 11921 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260501 14:00:24.476969  7821 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:24.333279 12061 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260501 14:00:24.362635 11973 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260501 14:00:24.556373  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 143054us
I20260501 14:00:24.415130 11959 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:24.447059 12060 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.432971  7670 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.384882 11974 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:24.509908  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 136824us
I20260501 14:00:24.372821 12038 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:24.529284  7679 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:24.527971  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:24.496219 12080 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260501 14:00:24.573302 11959 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:24.608199  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:24.608541  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:24.608191 12082 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.609649 12034 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:24.540952 12083 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.419s	user 0.005s	sys 0.000s
I20260501 14:00:24.437561 12002 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260501 14:00:24.408618 12070 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.482517 11975 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.397862 11835 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.552301 11670 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:24.461803 12049 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:24.541236 12095 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260501 14:00:24.528889 12037 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.528699 12035 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.482860 12058 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.480366 12003 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.537850 12062 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.609113 11959 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.540306 12091 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.487596 11799 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.610056  7745 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:24.408892 12088 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.652989  7670 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.654522  7753 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
W20260501 14:00:24.655356  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 127525us
I20260501 14:00:24.533046 11972 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.604068  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:24.660578  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:24.571514 11854 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.702209  7676 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:24.706552  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:24.649993 12034 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:24.716849  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:24.601258 12007 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:24.657112 11670 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:24.715947  7749 raft_consensus.cc:2368] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:24.718947 12110 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.719081 11972 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:24.721964 12104 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260501 14:00:24.723022 12017 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.005s
I20260501 14:00:24.724270 12062 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.659734 11975 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.556604 11979 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.744448  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:24.745436 12097 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260501 14:00:24.745993 11979 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.746879 12038 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.747694 11975 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.707907 12113 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.664430 12037 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.758529  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.759138  8374 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:24.611399 12060 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.733506  7748 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:24.734825  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.765934  8377 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:24.740294  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.767588  8372 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:24.715960 12085 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:24.609874 12082 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.745488  8371 raft_consensus.cc:2410] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260501 14:00:24.666412 12063 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.728513  7753 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:24.762318  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.756150 11979 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.763859  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:24.788785  7678 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260501 14:00:24.666766 11835 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.775367  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:24.776432  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:24.766820 12077 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260501 14:00:24.764837 12084 consensus_meta.cc:287] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.001s
I20260501 14:00:24.785329  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.790795  7821 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.791282  7679 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:24.791406  7670 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:24.785900  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:24.786134  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:24.790879  8380 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:24.786698  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.793937  7820 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:24.667311 12035 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.665495 11961 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:24.798745 11182 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:00:24.802366  7670 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:24.800132  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.803586  7827 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:24.800521  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:24.750557 12017 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.805243  7828 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:24.800793  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.809203  7672 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:24.810384  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:24.811276  7673 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:24.730448 11854 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.734643 12110 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.818645  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:24.797040 12014 consensus_meta.cc:287] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.002s
I20260501 14:00:24.821221  7749 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:24.714553 12091 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.782394 11972 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.788407 11975 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.825980 11799 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.837833  7821 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:24.838773  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:24.842001  7754 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:24.842391  7754 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:24.819613 11961 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:24.789610 12063 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.776670 11670 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.843250  7754 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.801344 11979 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.827522 12014 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.847306 12049 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.848430 12035 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:24.848945 12103 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260501 14:00:24.849184 12110 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.850005 12070 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.850530 12119 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:24.850756 11854 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.851302 12088 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:24.843927 12112 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260501 14:00:24.834530 11972 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.831022 11975 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.859896 12034 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.860596 11973 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.860750  8379 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 5.
I20260501 14:00:24.861378 12082 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.861820 11974 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.862476 12003 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.862623 11961 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.863638 12057 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:24.916620 12014 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.916877 12057 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.918646 11975 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.919165 12057 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.864091 12058 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.866005 12017 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.867091 12106 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:24.920367 12106 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.922487 12106 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.762185 12113 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:24.877854  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 90341.4us
I20260501 14:00:24.878089  7754 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:24.909919  7752 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:24.924693 11973 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:24.881211 11944 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.926273 11944 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.926801 11973 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:24.914565 12122 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260501 14:00:24.935860 11972 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.944358  7754 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:24.946587  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.946676  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:24.947503  8371 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:24.947865  8376 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:24.949991 12060 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.950332 11921 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:00:24.833624 12007 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:24.954316  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 160288us
W20260501 14:00:24.971951 12098 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.479s	user 0.000s	sys 0.002s
W20260501 14:00:24.975220 12102 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.439s	user 0.000s	sys 0.006s
I20260501 14:00:24.976392 12109 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.976982 12109 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.979193 12109 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.979971 11972 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:24.980541 11972 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.982633 11972 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.951776 11921 tablet_bootstrap.cc:492] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:00:24.984400 11944 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.984895 11921 ts_tablet_manager.cc:1403] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 2.525s	user 0.066s	sys 0.018s
W20260501 14:00:24.986208  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 379587us
I20260501 14:00:24.907719 12119 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:24.991947 12119 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.992058 11835 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:24.999751  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.001883  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.003011  7746 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:25.004869  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.005698  8371 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:24.937685 11959 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.011770  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.012740  7826 raft_consensus.cc:2410] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 14:00:25.013901  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.014660  7754 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:25.016111  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.019564  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.020594  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.021486  7754 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:25.019975  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.023396  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.022976  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.024785  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.024181  7821 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:25.025607  7752 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:25.026896  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.027671  7827 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:25.016832  7820 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:24.939399 11975 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.035516 12041 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:25.037086  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:24.970069 12037 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:24.979717 12109 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:25.039075  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.041225  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.049578  7753 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:25.049875  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.050738  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.051331  7750 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:25.051702  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.041991  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.044368  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.047282  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.039505  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.054280  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.054991  7752 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:25.013727 11670 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:25.056761  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:25.062165  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.059542  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:25.062330  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.059717  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.053665  7823 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:25.065608  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.067168  7752 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:25.022925 12004 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.068837  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.069008  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:25.072631  7748 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:25.070851  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.074548  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:25.066465  7826 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:25.075618  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.081403  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.082540  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.083384  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.044306 11975 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.090930 11854 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:25.095995 12126 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.096764 12091 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.096611 12126 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:25.084175 12030 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260501 14:00:25.099831 12070 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Committing config change with OpId 10.10: config changed from index -1 to 10, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:25.093359  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.077811 12058 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:25.086207  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.108227  7749 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:25.088178  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:25.092376 12088 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:25.072304 12106 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:25.030341 11959 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.140208 11959 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.045109 12001 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260501 14:00:25.044654 12041 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.058625 12109 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.142867 12041 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.143081 12109 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:25.145690 12085 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:25.085388 12113 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.084136 12127 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:25.146360 12115 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260501 14:00:25.148000  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 124373us
I20260501 14:00:25.148517  8380 raft_consensus.cc:2410] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260501 14:00:25.091032 12035 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 14:00:25.136817  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50725.6us
I20260501 14:00:25.182017 12035 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:25.181573 11921 raft_consensus.cc:359] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:25.182335  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.182461 12035 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:25.182633 11921 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:00:25.183223 12110 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:25.183609 12110 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:25.184031 12110 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:25.188046  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:25.190980  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:25.111361 12058 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:25.191911 12113 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:25.192137 12058 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:25.191496 12110 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.153393  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.091449 12034 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:25.193982 12034 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.194517 12034 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:25.084852 11972 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:25.196336 11972 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:25.196702 11854 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:25.196805 11972 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:25.104032 12120 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:25.197642 12120 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:25.198169 12120 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:25.201817 12051 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:25.203089 11874 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:25.203446 11874 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:25.110651 12088 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.204098 12088 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:25.204321 11874 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.205950 11874 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:25.192342  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:25.206900  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53650.5us
I20260501 14:00:25.207643  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.205868 12128 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:25.208871 11973 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:25.209647  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.210391  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.211192  8371 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:25.207976 12091 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260501 14:00:25.213313  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.214071  7749 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:25.214587  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.214715 11979 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.215334 11979 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:25.215775  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.216434  7752 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:25.058979 11961 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260501 14:00:25.217417  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.086920 12004 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.219648  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.220217  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.221268  7747 raft_consensus.cc:2410] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:25.221558  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.224825  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.225490  7671 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:25.133476 11976 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:25.228163  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.229458  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:25.232474 12129 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260501 14:00:25.222178  7820 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:25.228791  7677 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:25.220239  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:25.242323  7792 leader_election.cc:400] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:25.242774  7792 leader_election.cc:403] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:25.150926 12063 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.263698  7747 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:25.253254  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:25.269140  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.183444 11921 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:25.151417 12106 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:25.155655 12127 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.240450  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.178534 12115 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:25.297938  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45855.8us
I20260501 14:00:25.314776  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.323501  7823 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
W20260501 14:00:25.314743  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45712.7us
I20260501 14:00:25.240355 12108 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:25.233947 11976 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:25.321346  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 80972.5us
I20260501 14:00:25.249349 11979 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:25.334342  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.282837 12038 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:25.338660  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:25.341488  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.348723  7820 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:25.349108 12107 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260501 14:00:25.349680  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.350412  7820 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 6.
I20260501 14:00:25.346976 11976 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:25.337709 12023 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.319113 12017 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260501 14:00:25.345930  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.368925  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.294871 12128 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:25.319936 11854 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.348744  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.317770 12132 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:25.323758 12127 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:25.356971 11182 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.258358 12091 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260501 14:00:25.378944 11182 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.369426  7827 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:25.369585  7823 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:25.360112  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.351787 12133 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:25.375717  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.401418  8371 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:25.401819  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.369382  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.327956 12115 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:25.337752 12108 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:25.399343  7825 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:25.399638  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.323148 12030 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:25.403189  7753 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:25.438189  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.404594  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.381421 12113 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:25.381332 11854 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.406013  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:25.406443 11921 ts_tablet_manager.cc:1434] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.421s	user 0.016s	sys 0.000s
I20260501 14:00:25.406330  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.443694  7822 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:25.398934 11835 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.407795 11974 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.414789 12058 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.353505 12014 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260501 14:00:25.417435 12120 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.419118  8376 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:25.453454  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:25.454033  7823 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:25.348750 12123 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:25.420674 11182 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.425554 12035 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.428586 12106 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.458606  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.431224 12004 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.354555 12110 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.344485 11979 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:25.347922 12034 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.432435 12017 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.438922  7826 raft_consensus.cc:1813] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Handling vote request from an unknown peer 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:25.353561 12007 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:25.475627  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.371336 12128 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.442274  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.442658  7820 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260501 14:00:25.442773  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.444790  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:25.447530  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.485497  8371 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:25.485654  7827 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260501 14:00:25.485677  7819 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:25.360313 12023 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.452409  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.436300 11973 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.459379  8374 raft_consensus.cc:1813] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Handling vote request from an unknown peer 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:25.498668  8374 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:25.484601  7825 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:25.437016 12030 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:25.442800 12113 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:25.470095  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:25.479809  7826 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260501 14:00:25.449610  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45227.4us
I20260501 14:00:25.487309  7824 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:25.479987  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.500113  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:25.435305 12133 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.458653 12002 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:25.452879 11835 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.532446  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.476140 11979 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:25.543447 12002 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.548772 12002 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:25.552845  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 214509us
I20260501 14:00:25.558713  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:25.562659  7822 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:25.558916  8379 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:25.559406  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:25.565773  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:25.542479  7819 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:25.497283 12085 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:25.479233 12007 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:25.577162  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:25.575263  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 95352.7us
I20260501 14:00:25.580556  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.497529 12017 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.583264  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:25.506515 12107 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:25.498948 12128 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:25.532014 12113 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:25.582154  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.596088  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.505487 12110 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.585886  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:25.590929  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.458638 11974 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.574582 11872 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:25.574652 12063 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.609313  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:25.610074 11182 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:25.613744 11959 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:25.613920  7753 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:25.615696 11182 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.622797 11182 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:25.580314 12085 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.615945  7819 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:25.544955 12004 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260501 14:00:25.581099 12138 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:25.599555 12001 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:25.608390 12060 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:25.509115 11973 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.602931 12041 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.644155  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-93b661856a9e45bf823981177d99ae0c received from {username='slave'} at 127.0.0.1:42716
I20260501 14:00:25.609706 11872 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.480278 12108 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.633913 12085 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:25.599861 12107 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.641896 12001 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:25.637132 12014 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:25.624743 11975 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.641208 12060 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.611529 12110 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.643087 12123 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:25.597476 11972 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.648351 12132 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:25.662551 12138 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Leader election won for term 5
I20260501 14:00:25.623833 12063 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.626839 11959 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:25.692209  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 109005us
I20260501 14:00:25.664566 11872 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:25.680517 12014 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.657406 12041 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.692440 12060 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:25.627228 12030 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.678854 11182 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.725723  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.677973 12001 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:25.667407  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-93b661856a9e45bf823981177d99ae0c on tablet 93b661856a9e45bf823981177d99ae0c with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:25.731484  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:25.644891 12007 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.706112 12058 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.711874 12082 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:25.692479 11854 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.719233 12120 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:25.729467 12014 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:25.783854  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 174587us
I20260501 14:00:25.753557  7752 raft_consensus.cc:2393] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:25.759286  8374 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 10 LEARNER]: Advancing to term 12
I20260501 14:00:25.711000 12035 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.765556 11182 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.749225  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:25.735677 12123 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:25.750139  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:25.800266  8380 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:25.753237 12023 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:25.789827  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:25.734480 12138 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:25.780872 12030 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:25.785043  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.798977  7750 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:25.802192  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 198541us
I20260501 14:00:25.842329  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.844026  7678 raft_consensus.cc:1813] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Handling vote request from an unknown peer 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:25.844656  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.845145  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.734172 12108 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:25.808818 12058 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.839455  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.840662  7671 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260501 14:00:25.841015  7670 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260501 14:00:25.802793 12123 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.817462 12017 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.845791  7672 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:25.844638  7678 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260501 14:00:25.844638  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:25.843326  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 58378.7us
I20260501 14:00:25.789088 11854 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.864658  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.853427  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.856545  7670 pending_rounds.cc:85] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 8
I20260501 14:00:25.870496  7670 pending_rounds.cc:107] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260501 14:00:25.870790  7670 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:25.871922  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.872678  7670 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:25.842299 12137 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260501 14:00:25.802702 11835 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.832921 12023 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.832453 12035 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:25.820158 11975 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:25.863366  7679 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:25.868608  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.857205 12148 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.836133 12133 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.874210  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.870038  7675 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:25.874955  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.875110  7748 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:25.846084 12049 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.887338  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.897423 11961 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.888847  7753 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:25.890890  7823 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:25.892963 12131 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.653s	user 0.002s	sys 0.002s
I20260501 14:00:25.880712  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:25.911626  7672 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 7.
I20260501 14:00:25.884835  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:25.848784 12132 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:25.897871  7671 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:25.873489  8371 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:25.898437  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:25.859136 12088 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.001s
I20260501 14:00:25.899480  7752 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:25.894222  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:25.900468  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:25.863209 12123 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:25.859972 12141 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:25.912569 12114 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:25.913177 12126 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.917687 12091 raft_consensus.cc:2764] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260501 14:00:25.904011 12139 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260501 14:00:25.874718 12120 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:25.905169 11835 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:25.908457 12107 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:25.935042  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:25.863404 12058 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.946664  7672 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:25.911113 12038 consensus_meta.cc:287] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
W20260501 14:00:25.910122 12146 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260501 14:00:25.945497 11974 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.953889 12001 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:25.956073  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 75492.6us
I20260501 14:00:25.926306 12119 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:25.880932 12143 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260501 14:00:25.912370 11961 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.925879 12132 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.908324 12110 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.908361 12153 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:25.887184 11854 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.967686  7679 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:25.913566 12148 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.938454 12141 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.926602 12017 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:25.938697 12114 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:25.988627  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:26.030066  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:25.957291 12140 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:25.968627 11959 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:25.946003 11972 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:25.948539 11835 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:25.907362 12035 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:26.022457  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 147577us
I20260501 14:00:26.066124  7677 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:25.906796 11975 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:25.937925 12088 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.088215  7670 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 15: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:25.911490 12049 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.965209 12063 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:25.905316 12023 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.983794 12038 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:26.022915 12132 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:25.965960 12120 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:25.990068 12041 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.015308 11974 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:26.037951 12142 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:26.100535  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:26.025983 12119 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.074724 12151 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.074970 12148 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.077026 11961 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:26.033749 12017 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.079458 11975 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.016880 11979 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:26.080417 12144 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260501 14:00:26.080842 12003 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:26.081801 12035 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.082506  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:26.082666 12113 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.255138 12120 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.083338  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.065261 11835 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:26.256026 12169 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:26.257474 12169 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.257802 12169 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:26.257877 12034 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.083992  7673 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260501 14:00:26.074991 12127 consensus_meta.cc:287] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260501 14:00:26.260222 12127 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.084466 12085 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.033820 12140 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:26.263520 12140 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:26.067366 11976 consensus_meta.cc:287] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.002s
I20260501 14:00:26.084865  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:25.989799 12133 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260501 14:00:26.037737 12110 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.019457 12134 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260501 14:00:26.027508 12141 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.058387 12037 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:26.073081  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.101939  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.098106  7675 raft_consensus.cc:2955] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Committing config change with OpId 10.6: config changed from index -1 to 6. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:26.108458  8373 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:26.111289 11974 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:25.947614 12138 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.280052 11974 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:26.123111  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 490161us
I20260501 14:00:26.100737 12063 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:26.291606  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.292260  7824 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.292899  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.293326  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.293568  7825 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:26.294601  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.295257  7819 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:26.130074 12082 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:26.116652 12151 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.109467 11872 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.296878  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.297534  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.298120  7827 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:26.109747  7565 maintenance_manager.cc:643] P 0eb6c3b6d06a4c02bcd619b78c2cbb38: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.562s	user 0.210s	sys 0.076s Metrics: {"bytes_written":30650,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":121161,"dirs.run_cpu_time_us":614,"dirs.run_wall_time_us":30012,"drs_written":1,"lbm_read_time_us":395,"lbm_reads_lt_1ms":4,"lbm_write_time_us":134651,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":70755,"threads_started":1,"update_count":30}
I20260501 14:00:26.299604  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:26.273429 12110 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.300284  7748 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:26.300694 11872 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.301802 12110 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.112388 12119 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.304739 12113 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.305606 12170 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:26.277541 12085 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.248571 12001 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:26.248682  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:26.249950 12058 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:26.307304 12060 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.542s	user 0.015s	sys 0.000s
I20260501 14:00:26.130110 11961 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.247323 12038 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:26.027585 12153 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:26.307971 11961 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.309661 12153 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:26.310065  8375 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:26.306165 12170 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.272192 12126 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:26.312987 12088 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:26.144364  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.018s	sys 0.006s
W20260501 14:00:26.313767  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.023s	sys 0.051s
W20260501 14:00:26.314697  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:26.261842  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 179429us
I20260501 14:00:26.263049 12127 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:26.266434  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 181644us
I20260501 14:00:26.327039  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.263088 11854 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.269870 11976 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:26.265211 11874 consensus_meta.cc:287] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.059s	user 0.008s	sys 0.011s
I20260501 14:00:26.348474  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.285440  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.288480  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.288820  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:26.351881  8373 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:26.352180  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.290149  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.352864  7679 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:26.352982  7753 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:26.353842  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.353972  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.354457  7753 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:26.290967  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:26.291301 12158 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260501 14:00:26.291898 12063 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.296698  7671 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:26.355459  7752 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:26.298032  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.306151  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:26.253219 12023 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.254202 12123 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.364022  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.319180  7827 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:26.365459  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.366379  7827 raft_consensus.cc:2368] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:26.368140  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.320802  7748 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:26.321122  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.265762 12014 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.374667  7673 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:00:26.248018  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.327958  7670 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:26.375669  7677 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260501 14:00:26.376370  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.376947  7670 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:26.377727  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.378681  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.380213  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.374323  7828 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:26.381385  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:26.271286 11670 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.198s	user 0.021s	sys 0.000s
I20260501 14:00:26.349732  7826 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:26.382098  7825 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:26.382912  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 135005us
I20260501 14:00:26.322475  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.383709  8371 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:26.341158  7824 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:26.371178  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:26.370131  8372 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:26.371281  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.372516  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.386011  8380 raft_consensus.cc:2393] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 5: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:26.373282  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.386375  7751 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:26.387019  8376 raft_consensus.cc:2393] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:26.387180 12151 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.374069  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.387964 12049 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.388314  7819 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:26.381388  8377 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:26.352209 12128 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.002s
I20260501 14:00:26.389878  7754 raft_consensus.cc:2368] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8.
I20260501 14:00:26.379216  7670 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:26.342000 12002 consensus_meta.cc:287] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.793s	user 0.004s	sys 0.012s
I20260501 14:00:26.383762  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.307749 12060 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.385203  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.371191  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:26.391057  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.387432  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.354903 11872 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:26.396102  7747 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:26.361470  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.398326  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.412472  7826 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 15
I20260501 14:00:26.399832  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.400933  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.403250  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.413733  7675 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.413929  7673 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:26.402334  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:26.403666  7678 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:26.415212  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.416239  7673 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:26.415212  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.403780  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.417490  7824 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:26.417725  7750 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:26.415196  7752 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:26.419932  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.420562  7679 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:26.403291  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:26.421515  7751 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:26.402781  7745 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:26.408004  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.375325 11961 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:26.394722 12038 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:26.424167  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.424131  7718 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.425590  7827 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:26.426633  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.432046  7819 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:26.391744  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.411619  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.432520  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.432757  7670 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:26.433082  7827 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:26.427018  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.433748  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.434331  7679 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:26.399372 12034 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.437057  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:26.428177  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 66872.5us
I20260501 14:00:26.438439  7826 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:26.438875  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.429067  7677 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:26.435046  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.408617 12014 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.439477  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.439512  7824 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.443200  7827 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:26.440723  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:26.417500 12143 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:26.444293  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.407171 12002 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.444833 11874 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:26.453938  7827 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:26.450107  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.461903 12002 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.463007  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.444334  7566 maintenance_manager.cc:419] P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12312 bytes on disk
I20260501 14:00:26.472539  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.471648  7675 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:26.438248 12049 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:26.481693 12060 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.438318 11670 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260501 14:00:26.464217 11854 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:26.486979 11854 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.487442 11854 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:26.442276 12034 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.399719 12128 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.464742  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.432158 12001 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:26.464736  7822 raft_consensus.cc:2368] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:26.517726 12001 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:26.517488 12169 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.420730 11872 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.521765 11872 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:26.439430 12113 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:26.429275 11974 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260501 14:00:26.522464 12113 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.522879 12113 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:26.454175  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.523774  7746 raft_consensus.cc:1240] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:26.492595  7752 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
W20260501 14:00:26.528501  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 74464.2us
I20260501 14:00:26.529299  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.530158  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.495352  7565 maintenance_manager.cc:643] P 0eb6c3b6d06a4c02bcd619b78c2cbb38: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.022s	user 0.000s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":449,"lbm_reads_lt_1ms":4}
I20260501 14:00:26.447424 12143 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:26.496271 12002 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.492434  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.498734 11835 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.500041 11976 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.502524 12132 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:26.504030 12171 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260501 14:00:26.506707 12123 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.464000 12030 raft_consensus.cc:2764] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260501 14:00:26.465695 12038 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:26.544159 12038 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:26.534888 12143 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:26.544627 12038 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.546453 12017 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.507786 11979 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.508148  7754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "294b76c5890f455f97130fdbedace9af"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:26.547724  7754 raft_consensus.cc:606] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:26.490993 11874 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260501 14:00:26.509790 12128 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:26.510754 12115 consensus_meta.cc:287] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.070s	user 0.015s	sys 0.010s
I20260501 14:00:26.511627 12063 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.549829 12115 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.538512 12002 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.553196 12007 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:26.553647 12115 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.518388 12001 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:26.433247 12170 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.449476  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:26.556676  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 107292us
I20260501 14:00:26.543587 12049 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.513844  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.557709 12049 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.558296  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 632) took 1178 ms. Trace:
I20260501 14:00:26.558962 12115 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:26.559535 12115 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:26.559645  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 634) took 1158 ms. Trace:
I20260501 14:00:26.560196 12115 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:26.560209  8377 rpcz_store.cc:276] 0501 14:00:25.401300 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:25.401486 (+   186us) service_pool.cc:224] Handling call
0501 14:00:26.559435 (+1157949us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400680e54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:26.559582 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250652416}
I20260501 14:00:26.561869  7824 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:26.534735 12014 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:26.558717  8379 rpcz_store.cc:276] 0501 14:00:25.380114 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:25.380320 (+   206us) service_pool.cc:224] Handling call
0501 14:00:25.381061 (+   741us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:25.564713 (+183652us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:26.558034 (+993321us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540051d954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:26.558227 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380193024}
I20260501 14:00:26.564527  7751 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:26.564429 12114 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.557703  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.565764 12114 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:26.566298  7643 leader_election.cc:400] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:26.566648  7643 leader_election.cc:403] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:26.568522  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.569716  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.570657  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.553728 12002 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:26.530944  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.498734 12140 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.572751 11979 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:26.573014 12169 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.574676 12123 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:26.574574 12140 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.575544 12126 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:26.537788 11974 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:26.577553  7792 leader_election.cc:400] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8.
I20260501 14:00:26.537940 12151 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:26.577879  7792 leader_election.cc:403] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260501 14:00:26.556704  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1930) took 1338 ms. Trace:
I20260501 14:00:26.577255  7672 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:26.581765  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:26.583578  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:26.586635  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.586771  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.576064 12126 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.584457  7823 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:26.587028  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:26.587742  7751 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 15: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:26.588188  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:26.588821  7746 raft_consensus.cc:606] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:26.589144  7746 raft_consensus.cc:614] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:26.585458  7828 rpcz_store.cc:276] 0501 14:00:25.218451 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:25.219369 (+   918us) service_pool.cc:224] Handling call
0501 14:00:26.556475 (+1337106us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540025fb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:26.556615 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653896960}
I20260501 14:00:26.586872  8375 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:26.574730 11835 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.610656  7825 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:26.583890 12070 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:26.584065 11974 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.585793 12014 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:26.585539 12123 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:26.618714  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.587617 12151 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.630296  7751 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:26.630398  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.592676 12140 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:26.627878  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:26.596397 12049 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.629753  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.600310 11670 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:26.595491  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:26.643226  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 47832.3us
I20260501 14:00:26.631268  7828 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:26.631687  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.644315  7825 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:26.644352  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:26.592453 12160 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:26.632102  7746 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:26.590839 12126 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:26.646034  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:26.617645 12169 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:26.615198 11959 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.638499  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:26.650313  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:26.647743  7643 leader_election.cc:400] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:26.650913  7643 leader_election.cc:403] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260501 14:00:26.592686 12063 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260501 14:00:26.648089  7677 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:26.624788 11974 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:26.625984 12014 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.647555  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:26.630329 12070 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:26.657454  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:26.658022  7828 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:26.634743 12151 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:26.660288  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:26.637329 12123 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:26.663051  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.647105 12088 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:26.669252  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.649315 12110 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:26.628505 12109 consensus_queue.cc:1059] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260501 14:00:26.651544 12140 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:26.678743  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:26.704540  8373 raft_consensus.cc:2368] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8.
I20260501 14:00:26.679068 12132 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.704895 12140 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.686698 12057 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:26.706400 12057 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:26.707437 12057 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.708549 12123 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.661607 12002 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:26.715934 11976 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:26.716358 12002 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.716779 12002 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:26.716544 11976 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.718642 12070 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.697865 12113 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.655920 12014 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:26.676203 12037 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:26.723433 12037 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:26.656652 11959 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.723973 12037 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:26.668996 12035 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:26.725252 12035 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:26.726466 12035 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.728446 12119 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:26.729167 12119 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.659029 12082 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:26.654565 12128 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:26.701120 11974 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.656848 12160 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:26.740509 11973 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.749207 11959 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.749550 11974 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.735746 12128 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:26.744552 12119 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.750360 12128 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.723920 12113 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.752586 12141 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.758864  7828 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:26.760427  7748 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:26.784260  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:26.785137  8373 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:26.783344 12132 raft_consensus.cc:3055] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:26.792492 12132 raft_consensus.cc:740] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:26.793439 12132 consensus_queue.cc:260] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.794628 12141 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.794446 11854 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.794780 12132 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:26.795679 12160 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.797510 11979 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:26.783249 12038 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.798677  7745 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:26.799471 12038 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.803047 12126 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.762359 12113 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:26.804898 12113 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.807070 12091 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:26.808220 12091 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:26.808403 12034 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.808568 12091 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:26.809893 12091 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.811646 12091 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:26.812204 11976 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:26.814313 12128 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.742803 12115 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.815315  7821 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:26.817245 12113 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:26.835760  8381 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 14:00:26.855540  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.901362  7822 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
W20260501 14:00:26.868232  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 197378us
W20260501 14:00:26.857196  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 200301us
W20260501 14:00:26.969262  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 113806us
I20260501 14:00:26.970726  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:26.970817  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.823381  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 198) took 6446 ms. Trace:
I20260501 14:00:26.836139  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:26.855415 11182 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260501 14:00:26.974398  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.975375  8375 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:26.834355  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:26.976405  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.976949  8379 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:26.977213  7675 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:26.882362  8373 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:26.975728  7671 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:26.834415  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:26.979792  8377 raft_consensus.cc:2393] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:26.884778  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:26.983943  7679 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 4 FOLLOWER]: Advancing to term 5
I20260501 14:00:26.988103  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.988103  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:26.992084  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:27.011863  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:27.013226  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.013425  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.014403  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.938833 12082 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
W20260501 14:00:27.062318  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 45307.2us
I20260501 14:00:27.053992 11182 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:27.016090  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.063218  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:27.089808  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 73799.5us
I20260501 14:00:26.927636 12038 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.016203  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:26.921578 12126 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:26.925320 11854 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:27.077128  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:27.000514 12182 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260501 14:00:26.853375 12007 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.106019  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.090055  7676 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:27.140374  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.111204  7826 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:27.141621  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.142225  7826 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:27.143091  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.103029  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.144125  7824 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:27.089583 11182 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:26.972203  7576 rpcz_store.cc:276] 0501 14:00:20.376629 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:20.376800 (+   171us) service_pool.cc:224] Handling call
0501 14:00:26.823303 (+6446503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:24.935413 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:24.936244 (+   831us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:24.936294 (+    50us) write_op.cc:435] Acquired schema lock
0501 14:00:24.936320 (+    26us) tablet.cc:662] Decoding operations
0501 14:00:24.944673 (+  8353us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:24.944771 (+    98us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:24.944804 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0501 14:00:24.971708 (+ 26904us) tablet.cc:701] Row locks acquired
0501 14:00:24.971735 (+    27us) write_op.cc:260] PREPARE: finished
0501 14:00:24.972023 (+   288us) write_op.cc:270] Start()
0501 14:00:24.972150 (+   127us) write_op.cc:276] Timestamp: P: 1777644024971964 usec, L: 0
0501 14:00:24.972172 (+    22us) op_driver.cc:348] REPLICATION: starting
0501 14:00:24.973033 (+   861us) log.cc:844] Serialized 4710 byte log entry
0501 14:00:25.459175 (+486142us) op_driver.cc:464] REPLICATION: finished
0501 14:00:25.911703 (+452528us) write_op.cc:301] APPLY: starting
0501 14:00:25.911856 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:26.123993 (+212137us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:26.245220 (+121227us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:26.462498 (+217278us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:26.462759 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0501 14:00:26.462801 (+    42us) write_op.cc:312] APPLY: finished
0501 14:00:26.463153 (+   352us) log.cc:844] Serialized 113 byte log entry
0501 14:00:26.614501 (+151348us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:26.624922 (+ 10421us) write_op.cc:454] Released schema lock
0501 14:00:26.629755 (+  4833us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:26.666464 (+ 36709us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:26.669664 (+  3200us) write_op.cc:454] Released schema lock
0501 14:00:26.741720 (+ 72056us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b180033f160. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
Metrics: {"mutex_wait_us":152348,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":432855,"apply.run_cpu_time_us":36901,"apply.run_wall_time_us":739689,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48001,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":40543,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":12,"prepare.queue_time_us":364507,"prepare.run_cpu_time_us":25512,"prepare.run_wall_time_us":121142,"raft.queue_time_us":217432,"raft.run_cpu_time_us":29039,"raft.run_wall_time_us":367662,"replication_time_us":473882,"spinlock_wait_cycles":14126848,"thread_start_us":841354,"threads_started":5,"wal-append.queue_time_us":398392,"wal-append.run_cpu_time_us":29159,"wal-append.run_wall_time_us":1180123}]]}
I20260501 14:00:27.143745  7826 raft_consensus.cc:2368] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:26.925554 12169 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8.
I20260501 14:00:27.119125  7679 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260501 14:00:26.988456 12134 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.119247  7675 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:27.120141  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.159482  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.122143  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.119362  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.160133  7675 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:26.877295 12001 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.877699 12002 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:26.988204 12109 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.167373 12109 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.169492 12109 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:27.171674 12002 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:27.174834  7674 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260501 14:00:27.126085  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.175565  7821 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:27.175987  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.176410  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.177101  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.177497  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.178578  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.179262  7821 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:26.941512 12014 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.179894 11835 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:27.180394 11835 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.180758 11835 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.181903 12014 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.183705  7746 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.184098  7746 raft_consensus.cc:614] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:27.184769  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.185356  7825 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:26.956203 12153 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.127102  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.190500  7753 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.070218  8375 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:27.190542  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.058899 12017 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:26.946964 11976 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:27.058445 12063 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:27.009671 11959 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:27.133941  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.217484  7823 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:27.008908 12060 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260501 14:00:27.112250 12165 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260501 14:00:27.136663  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:50946 (request call id 1264) took 1710 ms. Trace:
I20260501 14:00:27.229113  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.229382  7820 rpcz_store.cc:276] 0501 14:00:25.415678 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:25.507392 (+ 91714us) service_pool.cc:224] Handling call
0501 14:00:27.113792 (+1606400us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400251054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb2ff6b911e 00007fb2f8c35437 00007fb2f8c353c2 00007fb2f8c352f1 00007fb2f8c3526c 00007fb2f8c34522 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:27.125781 (+ 11989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3274461568}
I20260501 14:00:27.095687 12141 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 14:00:27.212364 12182 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260501 14:00:26.837939 12143 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.147747  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.252096  7678 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:27.148211  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.148795  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.150239  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.151731  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.254280  7826 raft_consensus.cc:2368] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.143985  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.152482  8381 raft_consensus.cc:2368] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.256119  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.256697  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.257308  7823 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:27.259179  7745 raft_consensus.cc:2368] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.216795 12063 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.009516 12085 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260501 14:00:27.157830  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.220373 11959 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 14:00:27.280853  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 123111us
I20260501 14:00:27.160143  7752 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:00:27.285297  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:26.824106  7739 tablet_service.cc:1558] Processing DeleteTablet for tablet 4262547d9184416ab702339797bead6f with delete_type TABLET_DATA_TOMBSTONED (TS 109c9ba263c34ff8aee17bc446cf258e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60254
I20260501 14:00:27.123096  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.163399  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.166405  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.288553  7748 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:27.125283  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.190886  7824 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:27.127118  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.211385  7676 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:27.192032  7821 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:27.138887 12035 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.212756  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.213032  7827 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:27.213436  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.214712 11182 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.218025  7819 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:27.293536  8377 raft_consensus.cc:2368] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:27.242534 12017 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:27.150679 12183 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.156512 12113 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260501 14:00:27.282732  7574 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 12 to 13, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 13 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:27.130069 12038 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:27.231003  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 220929us
I20260501 14:00:26.908370 12114 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.306818  7574 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 8 to 9, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:27.251690 12160 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260501 14:00:27.251183  7674 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:27.236158 12180 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260501 14:00:27.263561  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.324386  7823 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:27.156826 12007 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.154261  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.062477 12070 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:27.236027 12141 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.162159  7677 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
W20260501 14:00:27.289485  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 123205us
I20260501 14:00:27.338428  7750 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:27.336694  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:27.338972  7643 leader_election.cc:400] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:27.339190  7745 raft_consensus.cc:606] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.339491  7643 leader_election.cc:403] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260501 14:00:27.339700  7745 raft_consensus.cc:614] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:27.204387 12134 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.342425 12202 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.342649 12134 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.343024 12202 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.287516  7673 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:27.322168 12030 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260501 14:00:27.343921  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:27.256557 12115 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.295646  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.344791  7749 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.345487 12205 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:27.295679  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.281172 12063 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:27.351585 12202 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.282927 12002 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:27.284832 11959 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:27.228381 11976 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.322350  7752 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:27.359575  7749 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:27.321977 12170 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.336611 12070 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.324718  7678 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:27.356254 12141 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.293160 12109 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:27.296241 12123 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:27.327759  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.388013 12123 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.328238  7679 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260501 14:00:27.393545 12188 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260501 14:00:27.398061 12037 consensus_meta.cc:287] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.002s
I20260501 14:00:27.398553 12037 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.399631  7671 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:27.380923 12070 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:27.400185 12017 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.404742 12038 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.410528 11835 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.243111 12153 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.413014 12153 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.308395 12128 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.413776  7823 raft_consensus.cc:606] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.414213  7823 raft_consensus.cc:614] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:27.366819 12197 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.416903 12197 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:27.420519 12185 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
W20260501 14:00:27.420816 12151 consensus_meta.cc:287] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.001s
I20260501 14:00:27.421239 12151 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.423164 12151 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.424567 12007 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.358157 12202 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.425962 12202 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.427980 12202 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.383577 12109 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:27.428685 12109 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:27.429486 12143 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.304497 12183 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.431797 12183 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:27.436647 12091 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.002s
I20260501 14:00:27.358816  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:27.458310  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 99578.5us
I20260501 14:00:27.459064  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.371493  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.319669  7574 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 6 to 7, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 7 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
W20260501 14:00:27.460386  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 88970.5us
I20260501 14:00:27.461432  7643 leader_election.cc:400] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.461678  7643 leader_election.cc:403] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260501 14:00:27.462033  7574 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:27.300741 12035 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.220677 12060 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.388477 12123 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:27.323105 12114 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:27.438215  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 145768us
I20260501 14:00:27.467361  7752 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260501 14:00:27.469215  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:27.461081  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:27.464457  7574 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:27.491909  7827 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:27.492653 12085 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:27.493017 12085 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.493541 11182 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:27.357281  7821 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:27.488372  7753 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:27.488778  7828 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:27.490091  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.496294  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.497099  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.497841  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.495682  7825 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:27.502467 12134 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:27.502700  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.503249 12134 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:27.439386 12143 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.506032  7747 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:27.493256 12085 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:27.507774  7670 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:27.486516 12060 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:27.510128  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.477936 12023 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:27.469100 12153 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.469410 12193 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:27.531876  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.517590  7749 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:27.477289 11854 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:27.485548 12034 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.486806 12001 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:27.522154  7753 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:27.383157 12170 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.519706  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.528288 12023 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.522293 12091 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
W20260501 14:00:27.542847  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50971.1us
I20260501 14:00:27.520117 12007 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:27.549037  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.554486  7752 raft_consensus.cc:2368] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:27.554442  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.517176 12143 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.542136 11854 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.555704  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.563683 12070 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.565534 11835 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.542735 12169 consensus_queue.cc:1059] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260501 14:00:27.566200 12170 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.566715 12091 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:27.567608 12143 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.568426  7747 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:27.569026 11854 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:27.571318  7674 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260501 14:00:27.576397 12207 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:00:27.577641 12207 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260501 14:00:27.578351 12207 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260501 14:00:27.580533 12001 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:27.564299 12037 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.580992 12001 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:27.582034 12001 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.583498 12001 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:27.548924 12082 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.551509 12023 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:27.593001  7822 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:27.594319  7792 leader_election.cc:400] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:27.627472  7792 leader_election.cc:403] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:27.594146  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.594313  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:27.564363 12200 log.cc:927] Time spent T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260501 14:00:27.563179 11959 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.629498 12132 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.624986  7643 leader_election.cc:400] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.537552 12153 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.630108 11670 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.631105 11670 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.631765 12153 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:27.632596  7826 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:27.633188 11670 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.635557  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.636184  7753 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:27.637486  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.638484 12153 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:27.638835 12153 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:27.639143 12153 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:27.639382 12132 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:27.631213  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:27.640965 12115 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:27.641585 12115 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:27.642573  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.642706 12115 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.643390 12205 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:27.643875  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.659495  7752 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:27.658255  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.666942  7825 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:27.571141 12007 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:27.669799  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1946) took 1292 ms. Trace:
I20260501 14:00:27.670346  7819 rpcz_store.cc:276] 0501 14:00:26.377756 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:26.466831 (+ 89075us) service_pool.cc:224] Handling call
0501 14:00:27.669578 (+1202747us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b540025f654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:27.669723 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569629056}
I20260501 14:00:27.674045  7823 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:27.580535 12169 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.619693 12143 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.686705  8373 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.618643 12037 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.657140 12205 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:27.692203  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:27.690433  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 46658.2us
I20260501 14:00:27.694098  7820 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:27.694442  7753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee17e865655f4db7affb37902439a8be"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:27.696601  7753 raft_consensus.cc:606] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.696981  7753 raft_consensus.cc:614] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:27.697016  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.697726  7819 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:27.700230  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.700157  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.704469  7752 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:27.567690 12091 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.707923  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.711359  7827 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.679504 11976 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:27.628047 12082 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.625998 12063 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.710593  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.699422 12193 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.572928 12134 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.694063 12115 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:27.685832 12169 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.690332 12210 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:27.699120 12198 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:27.730890  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.716552  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260501 14:00:27.736127  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 141918us
I20260501 14:00:27.737200  7819 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:27.725329 11976 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:27.747195 11976 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:27.748363 11976 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.749408 12207 ts_tablet_manager.cc:1916] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260501 14:00:27.751929 12205 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.701501  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:27.737227  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.738035  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:27.724345  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.693506 12143 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.759004  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:27.766110  7821 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:00:27.766522  7827 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:27.712322 12035 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.699410 12037 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.746342  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.724143 12114 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.759981  8373 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:27.759424  7823 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
W20260501 14:00:27.772378  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 71063.1us
I20260501 14:00:27.775748  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:27.776909  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.779290  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.780174  7677 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:27.781908  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.785127  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.785965  7672 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:27.732173 12210 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:27.782019  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.779211  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.782919  7679 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:27.790191  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.812229  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.812600  7673 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.814652 12034 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.814975  7643 leader_election.cc:400] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:27.815234 12034 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.816080  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:27.762423 12181 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:27.711670 11670 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260501 14:00:27.823083  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.712870 12007 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.814101 12210 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:27.828656  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 91569.6us
I20260501 14:00:27.829629  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.789707 12014 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:27.781273 12113 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:27.846114 12153 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.728689 12193 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:27.789780 12219 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:27.791157 12070 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.805594 11835 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:27.814659 12217 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:27.863379  7673 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:27.792102 12035 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260501 14:00:27.803197 12017 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260501 14:00:27.860041 12222 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260501 14:00:27.860186  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44195.9us
I20260501 14:00:27.757966 12215 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.120s
W20260501 14:00:27.862418  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 83727.7us
I20260501 14:00:27.877857  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:27.774646 12109 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.858672  7679 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:27.883152  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.884064  7824 raft_consensus.cc:2410] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260501 14:00:27.886857  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.869691  7677 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:27.859572 12227 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:27.890422 12181 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:27.889252  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.891359  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.791584 12115 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260501 14:00:27.875285  7643 leader_election.cc:400] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:27.894958  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:27.883433 12209 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260501 14:00:27.898798  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.902021  7749 raft_consensus.cc:2368] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:27.892290 12215 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:27.892231  7753 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:27.893536  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.895761  7827 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:27.889912 12204 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:27.898753  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.900393  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.904915  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.919754  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.921032  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.905413  7672 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:27.896045 12034 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.906721  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.875356 12219 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:27.907135  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.926244  7753 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:27.922930  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.906749  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.909673  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.928862  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.879968 12082 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:27.912688 12109 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:27.906212 12113 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:27.913733  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.951403  7748 raft_consensus.cc:2410] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260501 14:00:27.871932 12128 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.874724 11959 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:27.873373 12170 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:27.967231  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.921909  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.924234  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.910948  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:27.879070 12217 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:27.929486  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.931533  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.973176  8379 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:27.973549  7673 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:27.932332  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:27.974268  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.974584  7677 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 8: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:27.933288  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.934262  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:27.936699  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:27.974993  7675 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 5.
I20260501 14:00:27.940117  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.864269 12141 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:27.929757 12038 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader election won for term 8
I20260501 14:00:27.980559  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:27.944799  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.900004 11976 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:27.946973  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:27.948905 12014 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:27.985065  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:27.948575 12219 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.004381  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:28.005025  7749 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:27.954494  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.970837  7827 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:27.975648  7672 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:27.939637 12220 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260501 14:00:27.978965  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:27.939659  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:27.942739  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:27.943305 12215 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:27.983103  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.957458 12202 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:27.987051  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:27.988341  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:28.010354  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:27.973934 12223 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260501 14:00:28.012200  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:28.021703  8379 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:27.959578 12063 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.026265  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:28.027177  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:27.972538 12109 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:27.961989 12034 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:28.024740  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:28.029088  7825 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:28.030788  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:28.029682  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:28.048223  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:28.049548  7745 raft_consensus.cc:2368] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9.
I20260501 14:00:27.971663 12204 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:28.054003  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:28.004977 12214 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260501 14:00:28.054979  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:28.067137  7819 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:27.984776 11959 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260501 14:00:28.072532  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 47926.1us
I20260501 14:00:28.074779  7823 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260501 14:00:28.076123  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 138207us
I20260501 14:00:28.077824  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:28.085965  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:28.086607  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:28.086952  8374 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:00:28.004402 12143 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.086691  7677 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:28.088955  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.016007 12038 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:28.025344 12202 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:28.093465  8344 leader_election.cc:400] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9.
I20260501 14:00:28.098856  8344 leader_election.cc:403] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:28.024327 12169 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.095239  8381 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:28.069660 12109 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.096582  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:27.981318 12170 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:28.085024  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 403250us
I20260501 14:00:27.981539 12128 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.077493 12037 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.076488 12224 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:28.006986 11976 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.142963  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.097862 11959 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:28.071575 12034 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.074462 12205 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260501 14:00:28.101454 12202 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:28.145468 12169 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.153105 12204 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.156966  7823 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260501 14:00:28.158955  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:28.188795  7825 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:28.160079 12215 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.105018 12222 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9.
I20260501 14:00:28.104337 11835 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:28.137454 12230 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260501 14:00:28.094602 12113 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:28.312705  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 164065us
I20260501 14:00:28.318853  7792 leader_election.cc:400] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 7. Current term is 8.
W20260501 14:00:28.319298  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 243626us
I20260501 14:00:28.145180 12143 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:28.191679  7673 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:28.192756  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.316169  8373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51750 (request call id 685) took 1189 ms. Trace:
I20260501 14:00:28.322166  8373 rpcz_store.cc:276] 0501 14:00:27.126759 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.126885 (+   126us) service_pool.cc:224] Handling call
0501 14:00:28.315959 (+1189074us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54006af9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:28.316076 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912680832}
I20260501 14:00:28.320384  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.161615 12153 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:28.284309 12001 consensus_meta.cc:287] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.002s
I20260501 14:00:28.309468 12128 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:28.269433 12236 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260501 14:00:28.328780 11854 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.759s	user 0.013s	sys 0.001s
I20260501 14:00:28.368538  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:28.325703  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:28.187841 12193 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.298821 12109 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:28.174446 12132 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
W20260501 14:00:28.331060 12060 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.798s	user 0.013s	sys 0.001s
I20260501 14:00:28.289440 11976 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.237846 12114 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.267084 12034 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.296988 12141 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:28.356637 12233 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260501 14:00:28.356808 12023 consensus_meta.cc:287] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.001s
I20260501 14:00:28.267970 12170 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.265949 12038 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.358343  7822 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:28.360921 12017 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.400455 12017 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.402827 12017 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.364385 12001 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260501 14:00:28.365759 12085 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.003s
I20260501 14:00:28.405097 12085 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.384701 12132 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:28.406554  8376 raft_consensus.cc:2368] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15.
I20260501 14:00:28.407160 12132 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.408569 12085 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.371025  7749 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 15: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:28.372047  7825 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:28.248632 11835 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:28.325098 12143 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:28.349135 12123 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.001s
I20260501 14:00:28.245095 12169 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:28.383419  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 279734us
I20260501 14:00:28.150202 12217 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.397315 12023 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.398777 12114 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.384950 12060 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.365911  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.431350  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:28.445374  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 79555.6us
I20260501 14:00:28.433068  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:28.436483  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 122400us
I20260501 14:00:28.440536 11835 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.452296  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.455370 12001 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:28.456049 12001 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:28.456583 12001 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:28.457945  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 89528.3us
I20260501 14:00:28.459535  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.460268  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2207) took 1354 ms. Trace:
I20260501 14:00:28.460683  7828 rpcz_store.cc:276] 0501 14:00:27.105523 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.105664 (+   141us) service_pool.cc:224] Handling call
0501 14:00:28.460078 (+1354414us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540025e754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:28.460199 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762187136}
I20260501 14:00:28.382262 12140 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260501 14:00:28.377173 11854 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.461889  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:28.468791  7823 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:28.421347 12143 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:28.474640  8375 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:28.476948  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:28.477566  7749 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 15
W20260501 14:00:28.482880 12194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.000s	sys 0.012s
W20260501 14:00:28.483296 12194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.000s	sys 0.012s
I20260501 14:00:28.484644 12128 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:28.485345  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:28.486858 12128 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:28.460744 12205 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:28.492729  7749 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
W20260501 14:00:28.490166 12191 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 1.272s	user 0.000s	sys 0.015s
I20260501 14:00:28.424646 12123 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.472930 12034 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260501 14:00:28.477471 12017 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260501 14:00:28.554924  7745 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:28.553565  7671 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 16: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:28.574278  7823 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:28.563606  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:28.612355  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:28.638366  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 78580.3us
I20260501 14:00:28.640643  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:28.644019  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 59072.5us
I20260501 14:00:28.476747 12230 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260501 14:00:28.537132 12186 log.cc:927] Time spent T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.316s	user 0.006s	sys 0.008s
W20260501 14:00:28.537362 12245 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260501 14:00:28.648530  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:28.538532 12189 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 1.335s	user 0.003s	sys 0.003s
W20260501 14:00:28.536580 12244 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260501 14:00:28.657932  7750 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
W20260501 14:00:28.566547 12210 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.002s
I20260501 14:00:28.538689 12114 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:28.554062 11854 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.557089 12205 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:28.693715 12205 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:28.658764 12235 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:28.546593 12123 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.553079 12017 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:28.696437 12017 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:28.697394 12017 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.680927  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.652112 12141 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260501 14:00:28.683419  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.648950 12038 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260501 14:00:28.695683 12235 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.635332 12132 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.638106 12128 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:28.649072 12160 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:28.700764  7750 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:28.645725 12113 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:28.541002 12060 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:28.535746 12169 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.719038 12128 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 14:00:28.725235 12251 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260501 14:00:28.727142 12128 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:28.728361 12134 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:28.729252 12134 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.730324 12235 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:28.709604 12114 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:28.736495  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.737814  7750 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:28.740859  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.737360 12114 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:28.652930 12230 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:28.659714  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.659715 12014 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:28.762701  7745 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:28.529305  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 69824.8us
W20260501 14:00:28.815699  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:28.816390  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.822573  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:28.824484  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:28.827091  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 333598us
I20260501 14:00:28.829107  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:28.731675 12134 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:28.831703  7749 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:28.830189  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:28.834419  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:28.840086  7825 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260501 14:00:28.842409  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:28.762779 12114 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:28.853502  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:28.716841 12132 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.847009  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:28.763705 12230 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:28.790522 12202 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260501 14:00:28.763732 12091 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:28.856539  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:28.848783  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:28.832358 12256 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:28.745947 12113 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.812912 11874 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.857492  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:28.862442  7825 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260501 14:00:28.856827  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 202602us
I20260501 14:00:28.830030 12240 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:28.832063 11854 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.866392 12169 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:28.771081 12160 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:28.917174  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:28.898782  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 66533.5us
I20260501 14:00:28.813508 12014 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:28.732579 12001 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.854992 12153 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:28.856604 12134 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:28.793427 12143 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.884176  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:28.895861  7749 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:29.006733  7749 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260501 14:00:28.902263  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.522s (SENT) [suppressed 2 similar messages]
W20260501 14:00:29.008260  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 106048us
I20260501 14:00:28.913975  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:29.009860  7745 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:28.847633 12257 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260501 14:00:28.868695 12091 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:28.722422 12210 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:28.991508  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:28.994531  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 152237us
I20260501 14:00:28.997290  8377 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260501 14:00:28.998085  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:29.040495  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:28.875020 12202 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.056841  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:29.057381  7752 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:29.044865  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:29.071324  7819 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:28.990797 12014 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:28.993626 12153 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:28.888068 11874 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.120687 12134 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:29.138548 12134 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.049155 12091 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:29.169402  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:29.018442 12255 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:28.973886 12169 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:28.973093 11854 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:29.191993  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:29.197296  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:28.990557 12222 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260501 14:00:29.122727 12153 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:28.915086 12240 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.333864  7819 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:29.258778 12085 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:29.310232 12256 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:29.365444 11874 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.367091 12169 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:29.369153 12268 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260501 14:00:29.372736 12250 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.560s	user 0.001s	sys 0.000s
W20260501 14:00:29.369153 12231 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 1.368s	user 0.012s	sys 0.007s
I20260501 14:00:29.299569 12255 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:29.409102 12085 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.433609  7749 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260501 14:00:29.451341  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:29.481387  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:29.483003 12274 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:29.484556  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:29.485387  7677 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:29.486454  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:29.487112  7677 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:29.458662 12265 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:29.489125 12265 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.490257 12085 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:29.488427 12197 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:29.483460  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:29.492887  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:29.496381 12113 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:29.465620  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:29.500254 12197 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:29.500401  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:29.500990 12197 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:29.481393  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:29.502738 12001 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.502249 12197 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.503343 12222 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:29.500610 12255 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.411957 11874 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:29.504298 11835 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:29.504802  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:29.543340  7749 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260501 14:00:29.560599  7749 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:29.561631  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 106004us
I20260501 14:00:29.565881 11835 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:29.567327 11835 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.426249 12202 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.432715 12132 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:29.542913 12258 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260501 14:00:29.658828  7749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:29.660209  7749 raft_consensus.cc:606] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:29.660782  7749 raft_consensus.cc:614] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:29.668553 12266 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260501 14:00:29.678565  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:29.351380 12160 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:29.691298  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:29.482019 12169 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:29.711964  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 671533us
I20260501 14:00:29.712488  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:29.713179  7678 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:29.713953  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:29.717034  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:29.718566  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:29.712383  7793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.003s	sys 0.004s
W20260501 14:00:29.722325  7793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.003s	sys 0.004s
W20260501 14:00:29.717073  7745 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.000s
I20260501 14:00:29.740096  7745 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 16.
W20260501 14:00:29.722815  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:29.715045  7642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.000s	sys 0.009s
W20260501 14:00:29.831293  7642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.000s	sys 0.009s
I20260501 14:00:29.736624  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:29.833062  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 96545.9us
I20260501 14:00:29.425832 12256 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.709424 12210 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:29.865659  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 360917us
I20260501 14:00:29.868170 12269 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:29.889288 12269 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.901063 12207 ts_tablet_manager.cc:1929] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260501 14:00:29.901808 12207 log.cc:1199] T 4262547d9184416ab702339797bead6f P 109c9ba263c34ff8aee17bc446cf258e: Deleting WAL directory at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/wals/4262547d9184416ab702339797bead6f
I20260501 14:00:29.903298 12207 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60254 (request call id 677) took 3079 ms. Trace:
I20260501 14:00:29.853943 12263 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:29.905018 12240 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.869680 11854 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.876858 12239 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:29.911211 12239 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:29.882128  7677 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260501 14:00:29.887943 12273 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:29.915356  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 352352us
I20260501 14:00:29.919251  7643 leader_election.cc:400] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:29.923192 12265 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:29.924219 12240 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:29.914949 12273 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.927475 11854 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:29.928444 11854 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.930027 12273 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:29.931092 11854 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:29.932225  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:29.939752 12134 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.828584 11874 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:29.924939 12240 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:29.947662 12205 consensus_meta.cc:287] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.253s	user 0.013s	sys 0.002s
I20260501 14:00:29.962292 12269 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.963630 12239 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:29.829396 12132 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:30.056927  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 343027us
I20260501 14:00:30.025116  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:30.083279  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 1047) took 2074 ms. Trace:
I20260501 14:00:30.084446  7746 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260501 14:00:30.083379  7747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3224) took 2574 ms (client timeout 3158 ms). Trace:
W20260501 14:00:30.085513  7747 rpcz_store.cc:269] 0501 14:00:27.509437 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.511471 (+  2034us) service_pool.cc:224] Handling call
0501 14:00:30.083162 (+2571691us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b540026edd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.083304 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52490112}
I20260501 14:00:30.084021  7753 rpcz_store.cc:276] 0501 14:00:28.008558 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.030321 (+ 21763us) service_pool.cc:224] Handling call
0501 14:00:28.030634 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:28.161203 (+130569us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:28.161238 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:28.161287 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:28.161326 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.082943 (+1921617us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003ac0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:30.083010 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:30.083201 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299786496}
I20260501 14:00:30.090342  7675 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260501 14:00:30.053938  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.012s
W20260501 14:00:30.093001  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.001s	sys 0.012s
W20260501 14:00:30.094581  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 73741.1us
W20260501 14:00:29.967711 12014 consensus_meta.cc:287] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.001s
I20260501 14:00:30.106739 12060 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.107331 12060 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.109963 12060 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:30.101842  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:30.106269 12254 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:30.106547  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.016s	sys 0.034s
I20260501 14:00:30.107292 12014 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:30.111937  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.016s	sys 0.035s
I20260501 14:00:30.111160 12254 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.113647 12014 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.115603 12254 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:30.101816  7748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 1045) took 2123 ms. Trace:
I20260501 14:00:30.116616  7748 rpcz_store.cc:276] 0501 14:00:27.959292 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.982090 (+ 22798us) service_pool.cc:224] Handling call
0501 14:00:27.982478 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:28.164449 (+181971us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:28.164480 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:28.164519 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:28.164547 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.082629 (+1918082us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540012bbd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:30.082702 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:30.082874 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418002304}
I20260501 14:00:30.119172  7819 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:30.120815  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:30.124943 12134 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.125742 12134 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.081805 11874 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.138644 11874 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.143955 12272 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:30.144655 12272 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:30.145208 12272 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:30.147117  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:30.151656 12267 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260501 14:00:30.153127  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1975) took 1319 ms. Trace:
I20260501 14:00:29.979018 12038 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.153563  7827 rpcz_store.cc:276] 0501 14:00:28.833998 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.834112 (+   114us) service_pool.cc:224] Handling call
0501 14:00:28.834520 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:28.834918 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:28.834957 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:28.835591 (+   634us) log.cc:844] Serialized 26 byte log entry
0501 14:00:29.038425 (+202834us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:29.038494 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:29.038604 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:30.152834 (+1114230us) raft_consensus.cc:1685] finished
0501 14:00:30.152862 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:30.153030 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5430,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10256,"spinlock_wait_cycles":56832,"thread_start_us":170115,"threads_started":1,"wal-append.queue_time_us":840386}
I20260501 14:00:30.156553  7827 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:30.157701 12278 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:30.158434 12278 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:30.160846 12278 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:30.066051 12141 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:29.987149 12202 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:29.978410 12263 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:30.154297 12038 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:29.979398 12215 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:30.177464  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75729.6us
I20260501 14:00:30.167708  7678 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:30.182794  7825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.000s	sys 0.031s
I20260501 14:00:30.191001  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:30.191390  7825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.000s	sys 0.031s
W20260501 14:00:30.188035  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 91676.6us
I20260501 14:00:30.193058 12254 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:30.192413  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:30.166556  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:30.193959 12279 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.194679 12279 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:30.195936 12254 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:30.195158  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:30.197110 12254 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:30.193934  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2227) took 1304 ms. Trace:
I20260501 14:00:30.200639  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:29.720852 12169 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:30.204763  8381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 644) took 2289 ms (client timeout 1522 ms). Trace:
W20260501 14:00:30.206266  7670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1876) took 3043 ms (client timeout 1740 ms). Trace:
W20260501 14:00:30.206808  7670 rpcz_store.cc:269] 0501 14:00:27.147551 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.148571 (+  1020us) service_pool.cc:224] Handling call
0501 14:00:30.191073 (+3042502us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540024cf54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.191204 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584119552}
W20260501 14:00:30.208235  7754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 2104) took 3088 ms (client timeout 2099 ms). Trace:
W20260501 14:00:30.208669  7754 rpcz_store.cc:269] 0501 14:00:27.119760 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.119931 (+   171us) service_pool.cc:224] Handling call
0501 14:00:30.201394 (+3081463us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54001d4cd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.208142 (+  6748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843414272}
W20260501 14:00:30.205302  8381 rpcz_store.cc:269] 0501 14:00:27.899594 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.899738 (+   144us) service_pool.cc:224] Handling call
0501 14:00:30.189218 (+2289480us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b5400680e54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.189441 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193114496}
I20260501 14:00:30.237138  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:30.243639  7819 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:30.248731  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:30.188062 12265 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:30.104569 12132 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:30.201143 12060 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260501 14:00:30.253612  7747 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:30.222913 12269 raft_consensus.cc:1064] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:00:30.173683 12255 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:30.188585 12239 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:30.079433 12205 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.188129 12141 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:30.255997 12114 consensus_meta.cc:287] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.389s	user 0.014s	sys 0.000s
W20260501 14:00:30.289172  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 357037us
I20260501 14:00:30.290203  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:30.292048  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:30.296955  7819 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:30.299396  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:30.248003 12278 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.311411  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:30.298295  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:30.263022 12276 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:30.336539  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:30.201773 12202 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:30.343070  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 143307us
I20260501 14:00:30.264060 12239 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:30.220474 12215 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:30.337714 12250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.045s
I20260501 14:00:30.401437 12169 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:30.352669  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.019s	sys 0.050s
I20260501 14:00:30.333691 12114 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:30.363355  8375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 652) took 2461 ms (client timeout 1579 ms). Trace:
I20260501 14:00:30.368664  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 1038) took 2479 ms. Trace:
I20260501 14:00:30.409626  7752 rpcz_store.cc:276] 0501 14:00:27.889321 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.917802 (+ 28481us) service_pool.cc:224] Handling call
0501 14:00:27.962401 (+ 44599us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:29.077636 (+1115235us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.368334 (+1290698us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000636d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:30.368578 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517713664}
W20260501 14:00:30.373119  8376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 646) took 2472 ms (client timeout 1531 ms). Trace:
I20260501 14:00:30.320407 12134 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.377863  7820 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:30.382458  7826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 1963) took 2873 ms (client timeout 1742 ms). Trace:
W20260501 14:00:30.411602  8376 rpcz_store.cc:269] 0501 14:00:27.900282 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.900402 (+   120us) service_pool.cc:224] Handling call
0501 14:00:30.372854 (+2472452us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54005901d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.373030 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099442688}
W20260501 14:00:30.408771  8375 rpcz_store.cc:269] 0501 14:00:27.902224 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.932948 (+ 30724us) service_pool.cc:224] Handling call
0501 14:00:30.363049 (+2430101us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540039b7d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.363260 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147942784}
W20260501 14:00:30.416399  7826 rpcz_store.cc:269] 0501 14:00:27.492259 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.495949 (+  3690us) service_pool.cc:224] Handling call
0501 14:00:30.365258 (+2869309us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400133654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.365438 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311010048}
W20260501 14:00:30.383014  7822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2220) took 2665 ms (client timeout 1560 ms). Trace:
I20260501 14:00:30.260777 12265 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.388554  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:30.390318  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:30.280011 12255 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.350808 12289 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.319911 12257 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:30.405997  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.020s	sys 0.050s
W20260501 14:00:30.389201 12230 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.514s	user 0.014s	sys 0.001s
I20260501 14:00:30.418521  7826 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260501 14:00:30.420428  7822 rpcz_store.cc:269] 0501 14:00:27.699776 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.699962 (+   186us) service_pool.cc:224] Handling call
0501 14:00:30.364604 (+2664642us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54001f2054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.364743 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493318016}
W20260501 14:00:30.398458 12250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.008s	sys 0.045s
I20260501 14:00:30.425117  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:30.377708 12286 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:30.475263  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:30.476437  8376 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:29.903781 12207 rpcz_store.cc:276] 0501 14:00:26.823509 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:26.823743 (+   234us) service_pool.cc:224] Handling call
0501 14:00:27.550573 (+726830us) ts_tablet_manager.cc:1151] Deleting tablet 4262547d9184416ab702339797bead6f
0501 14:00:27.570823 (+ 20250us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0501 14:00:28.435062 (+864239us) tablet_metadata.cc:665] Metadata flushed
0501 14:00:29.900833 (+1465771us) tablet_metadata.cc:665] Metadata flushed
0501 14:00:29.903186 (+  2353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":234868,"thread_start_us":79774,"threads_started":1}
I20260501 14:00:30.398865 12239 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:30.359489 12278 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:30.435806  8346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.011s	sys 0.027s
W20260501 14:00:30.489570  8346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.012s	sys 0.027s
I20260501 14:00:30.414108 12169 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.431416 12240 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.444880  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:30.412659 12060 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:30.436439 12279 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:30.387305 12276 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.614804  8375 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:30.935001  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1218) took 1472 ms. Trace:
W20260501 14:00:30.859961  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:30.355796  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 57628.2us
W20260501 14:00:30.862442  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:30.371165  7671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1891) took 2592 ms (client timeout 1633 ms). Trace:
W20260501 14:00:30.936945  7671 rpcz_store.cc:269] 0501 14:00:27.778645 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.778806 (+   161us) service_pool.cc:224] Handling call
0501 14:00:30.370888 (+2592082us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b540042dbd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.371067 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707760512}
W20260501 14:00:30.369758  7673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2842) took 2409 ms (client timeout 1948 ms). Trace:
I20260501 14:00:30.935704  8375 rpcz_store.cc:276] 0501 14:00:29.462192 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:30.568004 (+1105812us) service_pool.cc:224] Handling call
0501 14:00:30.568520 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:30.934107 (+365587us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.934705 (+   598us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260501 14:00:30.939117  7673 rpcz_store.cc:269] 0501 14:00:27.960612 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.977357 (+ 16745us) service_pool.cc:224] Handling call
0501 14:00:30.369502 (+2392145us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000c1554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.369664 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483751168}
W20260501 14:00:30.372157  7679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1897) took 2569 ms (client timeout 2132 ms). Trace:
W20260501 14:00:30.873713  7745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.018s
W20260501 14:00:30.874848  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:30.941067  7745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.004s	sys 0.018s
W20260501 14:00:30.941083  7679 rpcz_store.cc:269] 0501 14:00:27.802906 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.811943 (+  9037us) service_pool.cc:224] Handling call
0501 14:00:30.371932 (+2559989us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b540024c054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:30.372068 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100352256}
I20260501 14:00:30.426934  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:30.623198  8376 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:30.943755  8375 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260501 14:00:30.944494  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1217) took 1482 ms. Trace:
W20260501 14:00:30.945761  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 518779us
I20260501 14:00:30.945176  8376 rpcz_store.cc:276] 0501 14:00:29.461817 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:30.503829 (+1042012us) service_pool.cc:224] Handling call
0501 14:00:30.622819 (+118990us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:30.943628 (+320809us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.944241 (+   613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 14:00:30.951475  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:30.658267  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:30.486829 12038 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:30.987211 12310 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.557964 12060 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:30.988349 12310 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.989398 12291 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:30.800050 12091 consensus_meta.cc:287] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.500s	user 0.016s	sys 0.000s
I20260501 14:00:30.990669 12291 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:30.992178 12091 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:30.993386 12310 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:30.981612  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.001s	sys 0.014s
W20260501 14:00:30.994789  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.001s	sys 0.014s
I20260501 14:00:30.733520 12114 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:30.718056 12132 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:30.782315 12141 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:30.733996 12153 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.378s	user 0.013s	sys 0.000s
I20260501 14:00:30.999150 12153 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.003310 12153 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:30.725785 12197 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260501 14:00:30.797075 12202 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:30.733925 12205 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.734786 12215 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:30.442998 12230 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.029155 12197 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:31.029295 12230 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.029707 12197 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:31.031774  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:30.361999 12263 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.027256 12295 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:31.040328 12295 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.041792 12230 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:30.484364 12277 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:30.795527 12276 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.736541 12278 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:30.439592 12289 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:30.732652 12283 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.381s	user 0.000s	sys 0.000s
W20260501 14:00:30.792019 12292 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260501 14:00:30.730705 12301 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260501 14:00:30.768951 12307 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:30.769898 12272 consensus_meta.cc:287] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.006s
I20260501 14:00:30.792230 12309 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.562757 12169 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.004792  7823 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260501 14:00:31.006945 12287 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:31.008409 12293 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.010519 12299 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.012377 12296 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
W20260501 14:00:31.013202  8380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 660) took 2017 ms (client timeout 2008 ms). Trace:
I20260501 14:00:31.014250 12298 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:31.015018 12303 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:30.773581 11874 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:31.018829 12091 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:30.826771 12254 consensus_meta.cc:287] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.004s
I20260501 14:00:31.043085 12295 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:31.135975  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.012s	sys 0.022s
W20260501 14:00:31.136541  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.023s
W20260501 14:00:31.137041  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 740930us
W20260501 14:00:31.138957 12226 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 3.114s	user 0.022s	sys 0.058s
W20260501 14:00:31.139256  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.014s	sys 0.019s
I20260501 14:00:31.033104  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 1043) took 3106 ms. Trace:
W20260501 14:00:31.139777  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.014s	sys 0.019s
I20260501 14:00:31.139998  7746 rpcz_store.cc:276] 0501 14:00:27.926434 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.972343 (+ 45909us) service_pool.cc:224] Handling call
0501 14:00:30.084100 (+2111757us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:30.084981 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.032622 (+947641us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540026edd0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:31.032874 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4844059008}
I20260501 14:00:30.736570 12255 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:31.142267  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:31.146733 12141 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:30.729547 12265 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.043386  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:31.147854 12141 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.151854 12307 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:31.149092  8380 rpcz_store.cc:269] 0501 14:00:28.995810 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.996026 (+   216us) service_pool.cc:224] Handling call
0501 14:00:30.657974 (+1661948us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 14:00:31.012806 (+354832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15028608}
I20260501 14:00:31.031430 12197 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.163156 12265 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:31.171470 12254 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:31.167994  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1901) took 1713 ms. Trace:
I20260501 14:00:31.176668 12289 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:31.177402 12143 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.177587 12197 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:31.178285 12169 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.178194  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:31.184418 12141 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:31.185005  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.015s	sys 0.025s
I20260501 14:00:31.185349 12023 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.166028 12091 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.162386 12296 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:31.166797 12291 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:31.206710  7717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.001s	sys 0.024s
W20260501 14:00:31.207672  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.019s	sys 0.025s
I20260501 14:00:31.210192 12091 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:31.211628  7717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.002s	sys 0.024s
W20260501 14:00:31.196693  7824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2218) took 3503 ms (client timeout 1633 ms). Trace:
I20260501 14:00:31.179591  7674 rpcz_store.cc:276] 0501 14:00:29.452808 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:29.452958 (+   150us) service_pool.cc:224] Handling call
0501 14:00:29.714398 (+261440us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:30.085979 (+371581us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:30.086027 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:30.155173 (+ 69146us) log.cc:844] Serialized 26 byte log entry
0501 14:00:30.263037 (+107864us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:30.263097 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.263191 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:31.155795 (+892604us) raft_consensus.cc:1685] finished
0501 14:00:31.157925 (+  2130us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:31.165681 (+  7756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372260,"raft.queue_time_us":460944,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":19446,"thread_start_us":107384,"threads_started":1,"wal-append.queue_time_us":269278}
W20260501 14:00:31.215590 12228 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 3.213s	user 0.040s	sys 0.036s
I20260501 14:00:31.179342 12265 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:31.220392  8379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.015s
W20260501 14:00:31.220923  8379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.013s	sys 0.015s
I20260501 14:00:31.223562 12278 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260501 14:00:31.225785 12169 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.226500 12309 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.226712 12169 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.229238 12309 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.229274 12169 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.230134 12272 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.231859 12169 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:31.232761 12169 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.231868  7828 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:31.234522 12296 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.235306 12169 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.233110 12272 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.171701 11874 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.238266 11874 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.238649 12272 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.239584  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2217) took 3546 ms. Trace:
I20260501 14:00:31.239423 12272 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.240242  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 664) took 2243 ms. Trace:
I20260501 14:00:31.223583 12210 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:31.239977  7821 rpcz_store.cc:276] 0501 14:00:27.692752 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.692940 (+   188us) service_pool.cc:224] Handling call
0501 14:00:27.693221 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:27.766616 (+ 73395us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.238938 (+3472322us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b540025f154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:31.239341 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166537472}
I20260501 14:00:31.241852  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:31.241966 12272 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.236971  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 1009) took 1208 ms. Trace:
I20260501 14:00:31.244323  7828 rpcz_store.cc:276] 0501 14:00:30.028804 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:30.028948 (+   144us) service_pool.cc:224] Handling call
0501 14:00:30.102833 (+ 73885us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:31.234335 (+1131502us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.236514 (+  2179us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002cc4d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:31.236830 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2595367680}
I20260501 14:00:31.245718  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:31.246814  7821 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:31.250212  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:31.250873  7822 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
W20260501 14:00:31.243880  8374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 659) took 2248 ms (client timeout 2029 ms). Trace:
W20260501 14:00:31.216073  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 263077us
W20260501 14:00:31.273931 12237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.119s	user 0.029s	sys 0.066s
W20260501 14:00:31.274624 12237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.120s	user 0.029s	sys 0.066s
W20260501 14:00:31.212924  7824 rpcz_store.cc:269] 0501 14:00:27.693061 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.693279 (+   218us) service_pool.cc:224] Handling call
0501 14:00:31.196029 (+3502750us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54002e9354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:31.196326 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373426048}
W20260501 14:00:31.256697  8374 rpcz_store.cc:269] 0501 14:00:28.995359 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.995519 (+   160us) service_pool.cc:224] Handling call
0501 14:00:31.241487 (+2245968us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 14:00:31.243761 (+  2274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14995712}
I20260501 14:00:31.167635 12298 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:31.290450 12252 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 2.434s	user 0.015s	sys 0.009s
I20260501 14:00:31.264971 12265 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:31.304018  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 146193us
I20260501 14:00:31.303439 12291 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260501 14:00:31.306429 11670 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:31.309542 12254 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:31.285365 12023 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:31.303529 12278 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260501 14:00:31.342749 12023 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.346812 12070 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:31.347390 12070 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:31.247804 12060 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.349375 12023 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:31.216507 12299 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:31.382845 12204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.842s	user 0.020s	sys 0.053s
W20260501 14:00:31.383347 12204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.941s	user 0.021s	sys 0.054s
I20260501 14:00:31.384130 12299 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:31.384533 12312 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:31.385001  8374 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:31.385322 12312 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:31.388913  7751 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:31.390000 12256 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:31.390625 12256 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.240692  8379 rpcz_store.cc:276] 0501 14:00:28.997141 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:29.851510 (+854369us) service_pool.cc:224] Handling call
0501 14:00:29.852069 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:30.082093 (+230024us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:30.267505 (+185412us) log.cc:844] Serialized 14 byte log entry
0501 14:00:31.221555 (+954050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:31.222595 (+  1040us) log.cc:844] Serialized 26 byte log entry
0501 14:00:31.222950 (+   355us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:31.223017 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.223177 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:31.239904 (+ 16727us) raft_consensus.cc:1685] finished
0501 14:00:31.239929 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:31.240150 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259827,"prepare.queue_time_us":243046,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":17870,"raft.queue_time_us":433557,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":31145,"thread_start_us":1026382,"threads_started":3,"wal-append.queue_time_us":397555}
W20260501 14:00:31.393850  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:31.279456 12293 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:31.400743 12293 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:31.304723 12227 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260501 14:00:31.401877 12227 consensus_queue.cc:1243] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260501 14:00:31.407083  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:31.412154 12307 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.414398 12298 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:31.414710 12234 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 2.974s	user 0.011s	sys 0.030s
I20260501 14:00:31.416625  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:31.417126 12091 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:31.418227  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:31.419049 12316 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:31.419750 12316 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:31.425097  8371 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:31.425660  8371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 663) took 2428 ms (client timeout 2562 ms). Trace:
I20260501 14:00:31.426081  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1215) took 2393 ms. Trace:
I20260501 14:00:31.387094 12312 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.106721 12197 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:31.426195  8371 rpcz_store.cc:269] 0501 14:00:28.996884 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:29.078141 (+ 81257us) service_pool.cc:224] Handling call
0501 14:00:31.406686 (+2328545us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 14:00:31.425592 (+ 18906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9955200}
I20260501 14:00:31.508661  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 740) took 3573 ms. Trace:
I20260501 14:00:32.108731 12197 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.418195  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:32.109587  7676 rpcz_store.cc:276] 0501 14:00:27.935473 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.069594 (+134121us) service_pool.cc:224] Handling call
0501 14:00:30.191723 (+2122129us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:30.191946 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:30.191973 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:30.192017 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:30.192046 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.192104 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:31.508164 (+1316060us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540024cf50. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:31.508431 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4843786496}
I20260501 14:00:31.429081  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:31.427433 12256 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.426915  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.112429 12197 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:31.869021  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.112654  8381 rpcz_store.cc:276] 0501 14:00:29.032772 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:30.241847 (+1209075us) service_pool.cc:224] Handling call
0501 14:00:30.258112 (+ 16265us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:30.261040 (+  2928us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:30.261073 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:30.261572 (+   499us) log.cc:844] Serialized 26 byte log entry
0501 14:00:30.410475 (+148903us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:30.410543 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.421098 (+1010555us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b54006801d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:31.421183 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:31.425560 (+  4377us) raft_consensus.cc:1685] finished
0501 14:00:31.425582 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:31.425892 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258,"raft.queue_time_us":128633,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":5175040,"thread_start_us":65010,"threads_started":1,"wal-append.queue_time_us":439114,"wal-append.run_cpu_time_us":3116,"wal-append.run_wall_time_us":1059814}
I20260501 14:00:31.686046  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1979) took 2824 ms. Trace:
I20260501 14:00:31.480225  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:31.750000 12239 consensus_meta.cc:287] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.883s	user 0.010s	sys 0.013s
I20260501 14:00:31.430262  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.116570 12239 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:31.568876  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:31.667761 12303 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.480141 12049 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:32.119711 12049 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:32.119656 12303 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:31.703497 12316 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.121779 12049 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.122536 12303 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:31.485275  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 648) took 3584 ms. Trace:
I20260501 14:00:31.431428  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:31.615937  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:31.428599  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.115557  7820 rpcz_store.cc:276] 0501 14:00:28.861283 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.861403 (+   120us) service_pool.cc:224] Handling call
0501 14:00:30.373678 (+1512275us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:30.415948 (+ 42270us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.685539 (+1269591us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400133650. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:31.685798 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3470072704}
I20260501 14:00:31.775683 12298 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:31.486694  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 739) took 3551 ms. Trace:
I20260501 14:00:31.474853  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:31.852447 12160 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:32.135131  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2126) took 3312 ms. Trace:
I20260501 14:00:32.118424  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:32.108656  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.144201  8376 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
W20260501 14:00:32.104950 12265 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.809s	user 0.002s	sys 0.031s
W20260501 14:00:32.144867  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.148110  7751 rpcz_store.cc:276] 0501 14:00:28.822902 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.823150 (+   248us) service_pool.cc:224] Handling call
0501 14:00:28.840835 (+ 17685us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:31.389379 (+2548544us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:32.134684 (+745305us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b5400063bd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:32.135046 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5858768128}
I20260501 14:00:32.146189  7672 rpcz_store.cc:276] 0501 14:00:27.935134 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.078914 (+143780us) service_pool.cc:224] Handling call
0501 14:00:30.369709 (+2290795us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:30.369914 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:30.369939 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:30.369997 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0501 14:00:30.370032 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.370092 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:31.486276 (+1116184us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54000c1550. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:31.486469 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5216734592}
I20260501 14:00:32.157316  8375 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:32.158416 12160 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.158897  7754 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:32.154995 12265 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.162199 12160 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:32.144758 12295 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:32.163010 12265 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.163364 12295 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.166191 12295 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:32.166453  8380 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:32.169039  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.172762 12227 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260501 14:00:32.173151  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 755142us
I20260501 14:00:32.173870 12049 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:32.176116 12256 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.177100 12256 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.142590  8372 rpcz_store.cc:276] 0501 14:00:27.901110 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:27.902937 (+  1827us) service_pool.cc:224] Handling call
0501 14:00:27.903438 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:27.903964 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:27.904009 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:27.904681 (+   672us) log.cc:844] Serialized 26 byte log entry
0501 14:00:28.140600 (+235919us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:28.140662 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:28.140763 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:31.413645 (+3272882us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:31.484631 (+ 70986us) raft_consensus.cc:1685] finished
0501 14:00:31.484660 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:31.485028 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18298,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":12424,"spinlock_wait_cycles":10319744,"thread_start_us":159727,"threads_started":1,"wal-append.queue_time_us":485273}
W20260501 14:00:32.182282  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75437.9us
I20260501 14:00:32.167917 12298 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.189545 12239 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.193922 12057 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.194777 12057 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.195282 12198 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.195885 12198 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.197587 12057 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:32.197517  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.201887  8373 raft_consensus.cc:2410] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260501 14:00:32.197938 12198 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:32.203428  8373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51744 (request call id 1213) took 3205 ms (client timeout 1641 ms). Trace:
W20260501 14:00:32.204732  8373 rpcz_store.cc:269] 0501 14:00:28.997870 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:29.044278 (+ 46408us) service_pool.cc:224] Handling call
0501 14:00:31.486481 (+2442203us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 14:00:32.197170 (+710689us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76069ec 00007fb2f76065ab 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 14:00:32.203333 (+  6163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53089408}
I20260501 14:00:32.205080  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.206032  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:32.206640  7746 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:32.206506 12330 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:32.208595 12256 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.211954 12275 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.212726 12275 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.215232 12275 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.217736 12298 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
W20260501 14:00:32.201948 12222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.003s
I20260501 14:00:32.228423  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:32.229183  7751 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:32.229387  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:32.230244  7754 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:32.232930 12128 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
W20260501 14:00:32.224305 12222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.003s	sys 0.004s
I20260501 14:00:32.234324  7746 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:32.233395 12128 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:32.238229  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.239271 12128 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.241464 12060 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:32.241581  7718 leader_election.cc:336] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.522s (SENT)
I20260501 14:00:32.241796 12128 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:32.243013  7718 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.531s (SENT)
I20260501 14:00:32.243505  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:32.245309  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.245453  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:30.198537  7825 rpcz_store.cc:276] 0501 14:00:28.889580 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.889789 (+   209us) service_pool.cc:224] Handling call
0501 14:00:28.914053 (+ 24264us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:28.914280 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:29.246705 (+332425us) log.cc:844] Serialized 14 byte log entry
0501 14:00:30.193373 (+946668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:30.193465 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:30.193620 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:30.193718 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:30.193860 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":778498,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":206,"thread_start_us":1179987,"threads_started":2}
I20260501 14:00:32.248826  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.249601  7745 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:32.250799 12049 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:32.250516 12070 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.251684 12070 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:32.255549  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.258946  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.259768  7745 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:32.260931  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:32.263691  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:32.263926  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.264695  7825 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:32.265080  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.265322  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.266135  7674 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:32.264695  7673 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:32.267491  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.268004  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.268502  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.268837  7822 raft_consensus.cc:2410] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260501 14:00:32.269237  7828 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:32.270951  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.271808  7670 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:32.272187  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.272917  7745 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:32.267611 12119 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:32.273524 12119 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:31.143065  7562 catalog_manager.cc:5002] TS 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): tablet 4262547d9184416ab702339797bead6f (table test-workload [id=c5936b8507254212aa6fe952ce09c0eb]) successfully deleted
I20260501 14:00:32.275084  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:32.275575  7562 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 1.13268e+06us
I20260501 14:00:32.275926  7670 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:32.276517  7824 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260501 14:00:32.277053  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.274711 12119 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.279284 12119 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:32.280089  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.280563  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.281363  7674 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:32.279309 12017 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:32.282384  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.283280  7670 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:32.284256  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.288275  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.289222  7676 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:32.290005  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:32.267568  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.291328  7820 raft_consensus.cc:2410] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260501 14:00:32.297284  7825 raft_consensus.cc:2376] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10. Re-sending same reply.
W20260501 14:00:32.301333 12328 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260501 14:00:32.304330 12049 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.304472 12222 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:32.312598  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.315692  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:32.328532  7673 raft_consensus.cc:3060] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 15
I20260501 14:00:32.328816  7754 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:32.336714  7718 leader_election.cc:336] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 2.562s (SENT)
W20260501 14:00:32.328099 12327 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260501 14:00:32.347313  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.348755 12317 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:32.349288 12317 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:32.350471 12317 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.351994 12049 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.331190 12222 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:32.361863  7751 raft_consensus.cc:2410] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260501 14:00:32.363549  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 259576us
I20260501 14:00:32.374993  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:32.374856 12217 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:32.376521 12085 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:32.377236 12085 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:32.377673 12217 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:32.380842  7673 raft_consensus.cc:2468] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:32.383078  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:32.387871  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:32.378918 12085 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.390030  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:32.387655  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 79436us
I20260501 14:00:32.393219  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.396271  8377 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:32.397651  7751 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260501 14:00:32.401904  7825 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
W20260501 14:00:32.403070 12219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.205s	user 0.041s	sys 0.082s
I20260501 14:00:32.403254  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:32.403661 12219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.248s	user 0.041s	sys 0.083s
I20260501 14:00:32.404206  7826 raft_consensus.cc:2393] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:32.405169  7821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2235) took 1159 ms. Trace:
I20260501 14:00:32.408685  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:32.405157  8377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51762 (request call id 665) took 3399 ms (client timeout 1931 ms). Trace:
I20260501 14:00:32.405009 12230 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:32.379703 12217 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260501 14:00:32.417812  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.442381  7820 raft_consensus.cc:2410] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 16 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260501 14:00:32.409970  8377 rpcz_store.cc:269] 0501 14:00:28.997377 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:29.077867 (+ 80490us) service_pool.cc:224] Handling call
0501 14:00:32.362650 (+3284783us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6b5760 00007fb2ff6b5044 00007fb2f8c22834 00007fb2f8c227c2
0501 14:00:32.396897 (+ 34247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13535104}
I20260501 14:00:32.420665  7822 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:32.420797  7819 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:32.424050  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 1972) took 3592 ms. Trace:
I20260501 14:00:32.424115  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.427987  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:32.418568 12230 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:32.418991 12049 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.430409 12222 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.432243  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.432865  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.433121  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:32.433768  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.448696  7671 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:32.434713  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.405812  7821 rpcz_store.cc:276] 0501 14:00:31.248478 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:31.248791 (+   313us) service_pool.cc:224] Handling call
0501 14:00:31.249278 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:31.249844 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:31.249877 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:31.250481 (+   604us) log.cc:844] Serialized 26 byte log entry
0501 14:00:31.396464 (+145983us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:31.396509 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:31.396613 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:32.404919 (+1008306us) raft_consensus.cc:1685] finished
0501 14:00:32.404942 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:32.405094 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1986,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":136,"thread_start_us":55686,"threads_started":1,"wal-append.queue_time_us":869090}
I20260501 14:00:32.435109  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.437572  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:32.438117  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 107348us
I20260501 14:00:32.439405  7750 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:32.440865  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.441327  7672 raft_consensus.cc:2410] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260501 14:00:32.443979  7823 rpcz_store.cc:276] 0501 14:00:28.831613 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:28.831903 (+   290us) service_pool.cc:224] Handling call
0501 14:00:28.854113 (+ 22210us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:31.151585 (+2297472us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:32.414294 (+1262709us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400297f54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:32.423976 (+  9682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4944287104}
I20260501 14:00:32.446506  7824 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:32.450562  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.441336 12317 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:32.452075 11973 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.452667 11973 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:32.451921  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.456907  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:32.451896  7670 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:32.458281  7750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 1059) took 2068 ms (client timeout 1617 ms). Trace:
I20260501 14:00:32.458949 12230 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.460350  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.461072  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.460407 12230 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:32.462687 12217 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:32.463023 11973 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.463107 12217 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:32.464321 12217 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.465269  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.465772 12217 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:32.451795  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:32.468114  7819 raft_consensus.cc:606] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:32.469031  7819 raft_consensus.cc:614] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:32.468968  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.468981  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.461934  7827 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:32.474121 12222 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:32.475131  7751 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:32.476280  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.476881  7827 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
W20260501 14:00:32.477438  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Timed out: RequestConsensusVote RPC to 127.6.77.131:35015 timed out after 1.560s (SENT)
I20260501 14:00:32.477926  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:32.479377  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.579s (SENT)
I20260501 14:00:32.479442 12017 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260501 14:00:32.458724  7750 rpcz_store.cc:269] 0501 14:00:30.389845 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:30.390021 (+   176us) service_pool.cc:224] Handling call
0501 14:00:32.458024 (+2068003us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54001068d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:32.458164 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4642313088}
I20260501 14:00:32.480854  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.481406  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:32.441965  7792 connection.cc:254] RPC call timeout handler was delayed by -1.1053905139999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260501 14:00:32.487454  7826 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:32.498836  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.495800  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.503413  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.505172  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.509829  7573 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:32.512168  7679 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:32.513897  7750 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260501 14:00:32.514003  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.633s (SENT)
W20260501 14:00:32.514671  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Timed out: RequestConsensusVote RPC to 127.6.77.131:35015 timed out after 1.633s (SENT)
I20260501 14:00:32.515040  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:32.515386  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.515870 12017 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:00:32.517835  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.740s (SENT)
I20260501 14:00:32.518986  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:32.520129  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.521123 12017 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:32.521418  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.523133 12017 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:32.525230  7674 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:32.527830  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:32.527729 12128 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:32.529547 12141 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:32.529598 12128 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:32.530051 12141 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:32.530473 12141 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:32.533113  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.504302  7824 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:32.544708  7746 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:32.552744 12269 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:32.560346  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:32.564452  7574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 303) took 12071 ms (client timeout 15000 ms). Trace:
I20260501 14:00:32.568683  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.573664  7746 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:32.574453  8377 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:32.575942  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.576913  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:32.565661  7574 rpcz_store.cc:269] 0501 14:00:20.492542 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:20.496014 (+  3472us) service_pool.cc:224] Handling call
0501 14:00:32.564166 (+12068152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:27.725879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:27.874694 (+148815us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:27.878153 (+  3459us) write_op.cc:435] Acquired schema lock
0501 14:00:27.881094 (+  2941us) tablet.cc:662] Decoding operations
0501 14:00:28.096950 (+215856us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:28.104145 (+  7195us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:28.128843 (+ 24698us) tablet.cc:685] Acquiring locks for 5 operations
0501 14:00:28.274300 (+145457us) tablet.cc:701] Row locks acquired
0501 14:00:28.274333 (+    33us) write_op.cc:260] PREPARE: finished
0501 14:00:28.274565 (+   232us) write_op.cc:270] Start()
0501 14:00:28.274743 (+   178us) write_op.cc:276] Timestamp: P: 1777644028274493 usec, L: 0
0501 14:00:28.274774 (+    31us) op_driver.cc:348] REPLICATION: starting
0501 14:00:28.275669 (+   895us) log.cc:844] Serialized 2074 byte log entry
0501 14:00:30.761682 (+2486013us) op_driver.cc:464] REPLICATION: finished
0501 14:00:30.816404 (+ 54722us) write_op.cc:301] APPLY: starting
0501 14:00:30.816579 (+   175us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:30.820583 (+  4004us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:30.820719 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:30.828890 (+  8171us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:30.829211 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0501 14:00:30.829285 (+    74us) write_op.cc:312] APPLY: finished
0501 14:00:30.829667 (+   382us) log.cc:844] Serialized 57 byte log entry
0501 14:00:30.829904 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:30.830103 (+   199us) write_op.cc:454] Released schema lock
0501 14:00:30.830183 (+    80us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:30.987141 (+156958us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:30.987243 (+   102us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23234,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":54348,"apply.run_cpu_time_us":10255,"apply.run_wall_time_us":165520,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24997,"num_ops":5,"prepare.queue_time_us":135774,"prepare.run_cpu_time_us":19803,"prepare.run_wall_time_us":755752,"raft.queue_time_us":1071169,"raft.run_cpu_time_us":16639,"raft.run_wall_time_us":45145,"replication_time_us":2486667,"thread_start_us":1001431,"threads_started":4,"wal-append.queue_time_us":494938,"wal-append.run_cpu_time_us":63712,"wal-append.run_wall_time_us":3219952}]]}
I20260501 14:00:32.577683  7828 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:32.577538  7750 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:32.575960  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.575999  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:32.544785  7573 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:32.584149  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:32.596482  8377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
W20260501 14:00:32.596858  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.597311  8377 raft_consensus.cc:606] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:32.601048  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:32.602869  7746 raft_consensus.cc:606] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:32.603372  7746 raft_consensus.cc:614] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:32.605655  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.606541  7745 raft_consensus.cc:2410] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260501 14:00:32.606775  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.606647  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.607558  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.608240  7750 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:32.609347  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "962840f0434049bbb395d330e010962d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:32.609967  7750 raft_consensus.cc:606] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:32.610306  7750 raft_consensus.cc:614] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:32.611572  7828 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:32.612424  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.613183  7573 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 8, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:32.613955  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
W20260501 14:00:32.614926  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:32.615687  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.614526  7750 raft_consensus.cc:606] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:32.615846  7573 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:32.616647  7750 raft_consensus.cc:614] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:32.619182  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:32.620587  7819 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:32.621315  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.621465  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:32.622159  7750 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:32.622997  7750 raft_consensus.cc:614] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:32.628476  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 44436us
I20260501 14:00:32.631203  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:32.631435 11670 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:32.632525  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.632552  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.632941 11670 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.633636  8377 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:32.633795  7750 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:32.635880 11670 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:32.636289  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260501 14:00:32.636736  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.637809  8372 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:32.639281  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.639287  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:32.591199 12085 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.643623  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:32.647994  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.647921 12085 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.644904  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:32.656389  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1909) took 3200 ms. Trace:
I20260501 14:00:32.664175 12017 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:32.665762  8373 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:32.666832 12265 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:32.670488  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.670789 12265 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:00:32.671223 12085 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:32.671866  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.672541  8372 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:32.673017 12265 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:32.673595 12134 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:32.673761  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.674196 12134 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.625277  7573 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 10, term changed from 10 to 12, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to <none>, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added, no longer has a pending config: VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129), VOTER 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130), VOTER ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131), NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:32.658082  7677 rpcz_store.cc:276] 0501 14:00:29.455343 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:29.913228 (+457885us) service_pool.cc:224] Handling call
0501 14:00:29.913708 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:29.914144 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:30.215507 (+301363us) log.cc:844] Serialized 14 byte log entry
0501 14:00:32.348772 (+2133265us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18004c8580. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa2805da
0501 14:00:32.410554 (+ 61782us) log.cc:844] Serialized 14 byte log entry
0501 14:00:32.549352 (+138798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:32.549696 (+   344us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:32.592153 (+ 42457us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:32.631381 (+ 39228us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:32.655756 (+ 24375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15440,"prepare.queue_time_us":576734,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":7410,"raft.queue_time_us":5250,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":3883,"spinlock_wait_cycles":29737856,"thread_start_us":603968,"threads_started":4,"wal-append.queue_time_us":269033,"wal-append.run_cpu_time_us":1748,"wal-append.run_wall_time_us":1247809}
I20260501 14:00:32.676364 12017 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260501 14:00:32.690131  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.696686  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.699777  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.702369  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.703096  8376 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 8.
I20260501 14:00:32.703775  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.700734  8374 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:32.706254  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.707170  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.709142  7750 raft_consensus.cc:2410] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:32.709712  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.711212  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.713039  8375 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260501 14:00:32.712867 12134 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.688853 12265 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260501 14:00:32.715399  8381 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:32.712417  7573 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 13, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:32.721491  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.722312  8374 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:32.724315 12257 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:32.725687  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:32.727286  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 59456.8us
I20260501 14:00:32.730528  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.725013 12257 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.729303 11835 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:32.727527 12134 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:32.737903  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.740732  8381 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:32.743597  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.747105  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:32.752643  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.741950 11835 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:32.763597  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.753758  7573 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:32.737223 12128 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260501 14:00:32.743945 12141 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.775684  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.777778  8381 raft_consensus.cc:2410] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260501 14:00:32.768980 11835 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:32.745972 12134 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:32.790103  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.790889  7750 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:32.792132 12348 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:32.780457 12230 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:32.798975 12230 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:32.803081  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.803716 12257 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:32.804940  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.805959 12141 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:32.806289  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.806963  8373 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:32.808034  8376 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:32.775951 12265 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260501 14:00:32.832392  8380 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
W20260501 14:00:32.833328  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 97994.3us
I20260501 14:00:32.835084  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.836500  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.844221  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:32.845057  7828 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:32.844682  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:32.847131 12230 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:32.855185  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:32.856766 12128 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:32.858500  8376 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:32.863319  7745 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:32.872797  7750 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:32.872866  8375 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:32.877907  8374 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:32.882958  7819 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:32.887470  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:32.899632  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:32.900501  7745 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:32.916046 12350 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:32.917814  7750 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:32.928666  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:32.959987  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:32.968950  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:32.991214  7750 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 14. Ops: []
I20260501 14:00:32.993027  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:32.993739  7820 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:32.940764 12317 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:33.004499 11973 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:33.004305  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.005748  7754 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260501 14:00:33.006868 11973 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.013188  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:33.016661  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:33.017275  7750 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:33.018250  7752 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260501 14:00:33.019176  7753 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260501 14:00:33.017357  8374 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:33.020419  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:33.020900  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.021298  7748 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:33.022465  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.022167 12317 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.022492  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:33.032689  8380 raft_consensus.cc:2410] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260501 14:00:33.046537  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.039927  7643 connection.cc:254] RPC call timeout handler was delayed by -3.4123473649999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260501 14:00:33.049628  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.050016  7643 connection.cc:254] RPC call timeout handler was delayed by -2.2046748159999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260501 14:00:33.050606  7643 connection.cc:254] RPC call timeout handler was delayed by -2.0012748159999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260501 14:00:33.051040  7643 connection.cc:254] RPC call timeout handler was delayed by -1.6817748160000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260501 14:00:33.055639  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.058624  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 186132us
I20260501 14:00:33.029582 12134 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.069068  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.069430  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.069191  7676 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:33.029560 12317 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:33.071887  7677 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:33.071342  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.073793  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.075733  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.077045  7676 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:33.077104  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.078476  7679 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:33.077863  7670 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:33.090618  7671 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:33.093171  7673 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:33.093930  7674 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:33.096311  7820 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:33.097877  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.108167  7678 raft_consensus.cc:2393] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:33.109218  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.110311  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:33.112782  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.114817  7672 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:33.115932  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.113739  7677 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
W20260501 14:00:33.117619  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 273062us
I20260501 14:00:33.117828  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.118295  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:33.119160  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.121980 12257 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:33.123113  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.123446  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:33.121490  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:33.124930 12257 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:33.126763 12257 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260501 14:00:33.127285 11973 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.127878  7671 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:33.132503 12257 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:33.133822 11854 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:33.134196 11854 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:33.135092 11854 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.135236 11835 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.136866  7751 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:33.136902 11854 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:33.138811 12257 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:33.145030  7677 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:33.145545  7677 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:33.146857  7671 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260501 14:00:33.146677  7677 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.147672  7677 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:33.089155 12230 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:33.148527 12230 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.151237 12230 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.152810  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:33.155876  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 43732.1us
I20260501 14:00:33.157860  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.159359  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:33.154779  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44594.4us
I20260501 14:00:33.176628  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.179006  7820 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:33.108547 12141 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260501 14:00:33.204939  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.206099  7671 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260501 14:00:33.206681  7671 pending_rounds.cc:85] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 6
I20260501 14:00:33.169546 12017 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260501 14:00:33.213454  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 90080.9us
I20260501 14:00:33.170347 12348 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:33.206961  7671 pending_rounds.cc:107] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260501 14:00:33.217309  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:33.217768  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.218777  7671 raft_consensus.cc:2889] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:33.219197  7820 raft_consensus.cc:2393] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:33.220217  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.220487  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.224717  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:33.226835  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.228905  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.230063  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.230624  7673 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:33.231448  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.213457 12017 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:33.233337 12017 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:33.221117 12348 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:33.232455  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.236241 12348 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:33.237097  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.225466  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.238261  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.232688  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.238915  7674 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:33.243942  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.245734  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.245896  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.246521  7671 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:33.246258  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.245357  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.246654  7670 raft_consensus.cc:2410] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260501 14:00:33.247861  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.251638  7679 raft_consensus.cc:2410] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260501 14:00:33.216188  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:33.259025  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.262279  7672 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:33.263366  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.265556  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.263419  7675 raft_consensus.cc:2393] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:33.270462  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.276928  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.273936  7678 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:33.277824  7820 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:33.296316  7673 raft_consensus.cc:2410] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260501 14:00:33.278206  7678 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:33.297737  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.272099 11835 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:33.302990  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.303349  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.304420  7820 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:33.305580  7675 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:33.271430 12362 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:33.307921 12358 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:33.303664  7677 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:33.308418 12358 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:33.308813 12358 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:33.309907  7677 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:33.310040  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.311463  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.311964 12362 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:33.312211  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.312414 12362 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:33.313235  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.313396  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:33.314352  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 112519us
I20260501 14:00:33.317929  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:33.327201  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.334290  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.333824  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:33.337302  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.338444  7718 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.605s (SENT)
I20260501 14:00:33.336861  7675 raft_consensus.cc:2376] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9. Re-sending same reply.
I20260501 14:00:33.277114 12360 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:33.342756  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:33.343369  7824 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:33.345093  7821 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:33.340255  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:33.339395  7678 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.353572  7678 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:33.349525 11835 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:33.360289  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.361116  7679 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 7.
I20260501 14:00:33.362795  7821 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:33.368275  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.369168  7673 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:33.333665 12356 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:33.382098  7678 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260501 14:00:33.395164  7824 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:33.396193  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.394099  7678 pending_rounds.cc:85] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 8
I20260501 14:00:33.396976  7678 pending_rounds.cc:107] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260501 14:00:33.397291  7678 raft_consensus.cc:2889] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:33.339385 12359 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 14:00:33.397712  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44443.8us
I20260501 14:00:33.404291  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.404665  7792 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.393810 12356 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:33.434492 12356 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:33.436393  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.401548 12359 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:33.443198 12359 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:33.451758  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 49397.4us
I20260501 14:00:33.454221  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.413468 12358 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.415277 12362 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:33.424701 12355 log.cc:927] Time spent T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260501 14:00:33.424830  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 86403.5us
W20260501 14:00:33.425581  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.400831 12354 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:33.429705  7673 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260501 14:00:33.467026 12354 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:33.429992  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.431381  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.433394 12017 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.468335  7672 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:33.470187 12017 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.458226  7678 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:33.459586  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.462133 12358 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.463195 12362 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.457211 12350 raft_consensus.cc:2804] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:33.464150 12265 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:33.457616  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.472615  7671 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:33.476190  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:33.467633 12354 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:33.479830  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.481552  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.457433 12230 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260501 14:00:33.490542  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:33.496912  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.484102 12134 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:33.481063 12265 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:33.500125  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.485479 11854 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:33.484285 12350 raft_consensus.cc:697] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:33.513803  7678 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:33.504928 12362 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:33.506052 12134 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:33.508323 11854 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:33.524072 11854 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:33.523371 12362 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:33.530910 12362 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:33.508744 12265 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:33.511008 12368 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:33.541288 12368 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:33.542239 12368 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.543979 12134 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:33.549057  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.549712  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 63296.5us
I20260501 14:00:33.550007  7820 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:33.552731  7672 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:33.521400 12257 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:33.568032  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.574018  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.574338  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:33.578305 12367 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260501 14:00:33.581521 11854 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.584085 11854 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:33.585214  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.585893  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:33.608606  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 150855us
W20260501 14:00:33.609546  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 98389.7us
W20260501 14:00:33.614077  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.929s (SENT)
I20260501 14:00:33.614709  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:33.589673 12377 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:33.616050 12377 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:33.616462 12377 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:33.620051  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.590018 12317 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260501 14:00:33.632328  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:33.629062 12230 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260501 14:00:33.629335 12017 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:33.648351 11670 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:33.649041 11670 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:33.649531 11670 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:33.652194 12385 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:33.652629 12385 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:33.652940 12385 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:33.658263 12362 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.592849 12350 consensus_queue.cc:237] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.646026 12230 consensus_queue.cc:1243] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260501 14:00:33.669517 12359 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.673645 12134 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:33.677429  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 57471.6us
W20260501 14:00:33.679358  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69606.5us
I20260501 14:00:33.680413  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:33.679939  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 91262.1us
I20260501 14:00:33.682011 12265 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.683099 12348 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.684401  7821 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:33.686265 12230 raft_consensus.cc:2764] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260501 14:00:33.692449 12362 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:33.694598 12356 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.696620 12356 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:33.681046  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.706265  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.671715 12359 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.709795  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:33.696705 12377 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.717787  7754 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:33.667506 12354 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.723363 12354 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.721094 12017 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:33.723989 12017 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:33.724365 12017 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:33.724830 11670 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.726907 11670 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:33.729830  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.730947  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:33.705766 12134 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:33.739756  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.745565 12049 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:33.746094 12049 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:33.746155  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:33.747162 12128 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:33.747066 12049 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.737231 12385 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.758863  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.763217  7826 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:33.764109  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.739769 12348 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.765599  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.712636 12230 consensus_queue.cc:1059] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260501 14:00:33.747706 12128 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:33.737963 11854 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260501 14:00:33.785403  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.785739  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.785192  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:33.793154  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:33.794176  7823 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260501 14:00:33.794658  8374 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:33.795287  7751 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:33.792626  8380 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260501 14:00:33.798768  7748 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260501 14:00:33.799427  7747 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260501 14:00:33.800711  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:33.801177  7820 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260501 14:00:33.804265 12375 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260501 14:00:33.805920 12375 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:33.806463 12375 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.812456  7827 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260501 14:00:33.813750  7822 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:33.815181 12385 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:33.816305 12386 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260501 14:00:33.826177  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:33.778335 12265 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:33.831873 12128 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.830137 12230 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:33.835786 12230 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:33.836035 12368 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:33.836436 12368 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:33.836804 12368 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:33.836719 12230 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:33.843866 12017 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:33.846468  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.847877  7828 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
W20260501 14:00:33.849704  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50376.9us
I20260501 14:00:33.850685  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:33.850715  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:33.861601  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.861917  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.862708  7672 raft_consensus.cc:2410] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260501 14:00:33.873093  7747 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260501 14:00:33.876396  7675 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260501 14:00:33.877024  7675 pending_rounds.cc:85] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 9
I20260501 14:00:33.877485  7675 pending_rounds.cc:107] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260501 14:00:33.877844  7675 raft_consensus.cc:2889] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:33.876871  7754 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:33.884238  7678 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:33.884624  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:33.885939  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:33.886384  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.886893  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:33.888773  7673 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:33.888659  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.893261  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.895016  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:33.895426  7679 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:33.895751  8380 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 8: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:33.896270  7751 pending_rounds.cc:85] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 7
I20260501 14:00:33.896574  7751 pending_rounds.cc:107] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260501 14:00:33.896413  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45795.8us
I20260501 14:00:33.896829  7751 raft_consensus.cc:2889] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:33.891575  7676 raft_consensus.cc:2376] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15. Re-sending same reply.
I20260501 14:00:33.899520  7748 raft_consensus.cc:2368] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:33.855336 12230 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:33.899364  7671 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260501 14:00:33.900434  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 172646us
I20260501 14:00:33.903000  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.876379 12348 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:33.905256  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:33.905185  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.908491  7674 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:33.916501  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:33.928447  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 158637us
I20260501 14:00:33.941573  7672 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:33.950368  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:33.950623  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:33.951578  7678 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:33.937613 12269 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:33.956883  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.940508 12377 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:33.965548  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:33.952509 11854 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:33.963749 12265 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260501 14:00:33.986081  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:33.991219  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:33.968446 12134 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:34.003403 12385 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:33.989558 12377 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260501 14:00:33.996590 12134 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:34.008641 12134 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:34.020967 12398 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260501 14:00:33.969146 12375 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.974685 11854 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.025846 11854 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:33.967564 12395 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260501 14:00:34.030612 12368 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.033104 12366 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:34.033663 12368 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.033753 12366 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.036497 12366 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:33.975456 12017 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:33.967389 12269 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:33.996845 12049 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:34.041240  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:34.093637  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 102500us
I20260501 14:00:34.095584  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:34.058669  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 120959us
I20260501 14:00:34.098992  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:34.102954  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.102867  7670 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:34.037618  7826 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260501 14:00:34.120416 11670 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:34.120951 11670 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:34.121865 11670 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.123260 11670 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:34.132354  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 215898us
I20260501 14:00:34.141546  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.151383  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.043722 12269 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.157586  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:34.124667 12348 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:34.052461 12385 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:34.156276  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.172210  7754 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:34.151494  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.164626  7823 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:34.145589 12368 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:34.174525  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:34.171994  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.175619  7819 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:34.181288  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 288713us
W20260501 14:00:34.148025  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.901s (SENT) [suppressed 42 similar messages]
W20260501 14:00:34.185073  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 43801.6us
W20260501 14:00:34.185952  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.189155  7821 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: []
W20260501 14:00:34.190694  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.044288 12049 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.201836  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.200736  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:34.202759  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54791.2us
I20260501 14:00:34.151446 12128 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260501 14:00:34.181454 12368 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:34.212126  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.210299  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:34.214521  7718 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.132s (SENT)
I20260501 14:00:34.222733  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.222792  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.224169  7748 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:34.226296 12416 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:34.228938 11835 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:34.230983  7718 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.135s (SENT)
I20260501 14:00:34.232599 12409 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:34.243559  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:34.213291 12368 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:34.187472 12385 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.240826 12409 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.245973 12269 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:34.261873  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.236863 12354 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260501 14:00:34.290818 12230 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.292032 12387 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:34.245625 12396 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:34.323025  7748 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260501 14:00:34.328155 12385 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.313510 12405 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:34.328971 12405 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:34.330965 12409 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.314231  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:34.314987 12415 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:34.336760 12415 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:34.340968  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.330349 12405 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.347211  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:34.348346 11670 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:34.320752  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:34.316146  7792 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.545s (SENT)
I20260501 14:00:34.350584 11670 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:34.351553 11670 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:34.355053  7754 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:34.345981 12415 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:34.368813  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.369798 11670 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.372560 11670 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:34.376942  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 166806us
I20260501 14:00:34.377619 11670 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 14:00:34.378763  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 58160.8us
I20260501 14:00:34.379920  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.381245  7747 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
W20260501 14:00:34.381850  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.378429  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.320713 12274 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260501 14:00:34.384155  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.391855 12407 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:34.382649 12405 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:34.392042 12409 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:34.393471 12128 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:34.394183  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.394305  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:34.395277 12128 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:34.395668  8380 raft_consensus.cc:606] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.395889 12128 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:34.396322 12128 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:34.381765 11854 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260501 14:00:34.401278  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.401403 12407 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:34.407088  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.407954 12049 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:34.408000 12359 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:34.410029  7820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:34.410043  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.411383 12359 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.378451  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.415678 11670 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:34.416175  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:34.419731  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 103629us
I20260501 14:00:34.420661 11854 consensus_queue.cc:1243] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 91854d93e96c4756834efe8b2ef59fce log is divergent from this leader: its last log entry 12.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260501 14:00:34.407572 12407 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.421195 12230 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:34.395195 12134 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.421662 12230 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:34.422083  7820 raft_consensus.cc:606] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.422487  7820 raft_consensus.cc:614] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:34.422627  7754 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:34.423257 12134 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:34.422952 12230 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.423938  7826 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:34.424309 12230 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:34.419473 12416 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:34.432988 11854 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:34.433494 11854 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:34.433840 11854 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:34.434407 12406 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:34.438974 12317 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:34.439452 12317 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:34.440470 12317 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.442009 12317 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:34.442394  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.439328 12368 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.444715  7825 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:34.444865  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:34.445525  8380 raft_consensus.cc:606] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:34.445829  8380 raft_consensus.cc:614] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:34.420058  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:34.458294  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45683.7us
I20260501 14:00:34.458715 12415 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.448969 12368 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:34.460836 12407 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:34.461411 12409 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260501 14:00:34.465634  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.641s (SENT)
I20260501 14:00:34.466459  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.444577 12128 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.471112  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.469965 12406 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260501 14:00:34.477342  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.478691  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.472102 12368 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:34.481652 12395 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.484509  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "962840f0434049bbb395d330e010962d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:34.484793 12406 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.485343  7747 raft_consensus.cc:606] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.486039  7747 raft_consensus.cc:614] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:34.443502 11854 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.475862  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:34.501943  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:34.501579  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.503145 12405 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:34.508067  7625 auto_rebalancer.cc:786] Removing replace marker failed: Couldn't find leader for tablet 93b661856a9e45bf823981177d99ae0c
I20260501 14:00:34.502835  8380 raft_consensus.cc:606] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.516444  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.470902 12415 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:34.508772  7625 auto_rebalancer.cc:814] Could not move replica: Not found: Couldn't find leader for tablet 93b661856a9e45bf823981177d99ae0c
I20260501 14:00:34.523190  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:34.522305  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet 93b661856a9e45bf823981177d99ae0c
W20260501 14:00:34.528996  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 63395us
W20260501 14:00:34.532686  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.533358  8376 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260501 14:00:34.535009  8374 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:34.536159  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:34.536551  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.778s (SENT)
I20260501 14:00:34.538087  8372 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
W20260501 14:00:34.539245  7573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 284) took 11592 ms (client timeout 15000 ms). Trace:
I20260501 14:00:34.521674 12395 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.541524  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:34.521595 12377 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:34.542184  7747 raft_consensus.cc:606] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.543463  7747 raft_consensus.cc:614] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:34.543741  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.544399  8374 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:34.544559 12017 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:34.545778  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.546343  8380 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:34.542788 12366 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:34.519996 12409 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260501 14:00:34.548756  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:34.552241  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:34.528996 12407 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260501 14:00:34.547147 12377 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:34.559968 12377 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:34.561902  7828 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260501 14:00:34.557868  7825 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:34.548590 12366 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:34.563369 12366 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:34.564154  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:34.564904  7825 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:34.568477 12395 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:34.563251  7576 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:34.569182 12395 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.572289  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.574167  7825 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260501 14:00:34.576084  7718 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.630s (SENT)
I20260501 14:00:34.581805  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.583847  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:34.571798  7576 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 6 to 8, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 8 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:34.587551  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:34.587792  8374 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:34.584019  8380 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
W20260501 14:00:34.542963  7573 rpcz_store.cc:269] 0501 14:00:22.946976 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:22.961277 (+ 14301us) service_pool.cc:224] Handling call
0501 14:00:23.478769 (+517492us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:34.539169 (+11060400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:33.543951 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:33.544692 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:33.544752 (+    60us) write_op.cc:435] Acquired schema lock
0501 14:00:33.544774 (+    22us) tablet.cc:662] Decoding operations
0501 14:00:33.545723 (+   949us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:33.545824 (+   101us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:33.545869 (+    45us) tablet.cc:685] Acquiring locks for 7 operations
0501 14:00:33.546632 (+   763us) tablet.cc:701] Row locks acquired
0501 14:00:33.546655 (+    23us) write_op.cc:260] PREPARE: finished
0501 14:00:33.546826 (+   171us) write_op.cc:270] Start()
0501 14:00:33.546964 (+   138us) write_op.cc:276] Timestamp: P: 1777644033546759 usec, L: 0
0501 14:00:33.547013 (+    49us) op_driver.cc:348] REPLICATION: starting
0501 14:00:33.547787 (+   774us) log.cc:844] Serialized 2848 byte log entry
0501 14:00:34.004954 (+457167us) op_driver.cc:464] REPLICATION: finished
0501 14:00:34.054552 (+ 49598us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2f762682c 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fe123360
0501 14:00:34.258922 (+204370us) write_op.cc:301] APPLY: starting
0501 14:00:34.271544 (+ 12622us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:34.371889 (+100345us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:34.371935 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:34.429200 (+ 57265us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:34.429652 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0501 14:00:34.429725 (+    73us) write_op.cc:312] APPLY: finished
0501 14:00:34.445371 (+ 15646us) log.cc:844] Serialized 73 byte log entry
0501 14:00:34.448405 (+  3034us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:34.448551 (+   146us) write_op.cc:454] Released schema lock
0501 14:00:34.448624 (+    73us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:34.449270 (+   646us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:34.449302 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":169488,"reported_tablets":32,"spinlock_wait_cycles":163967360,"child_traces":[["op",{"apply.queue_time_us":241496,"apply.run_cpu_time_us":13504,"apply.run_wall_time_us":190189,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":485270,"prepare.run_cpu_time_us":10219,"prepare.run_wall_time_us":116446,"raft.queue_time_us":151070,"raft.run_cpu_time_us":18326,"raft.run_wall_time_us":199802,"replication_time_us":446852,"spinlock_wait_cycles":87831296,"thread_start_us":644246,"threads_started":4,"wal-append.queue_time_us":143046}]]}
I20260501 14:00:34.593201  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.594630  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:34.595856  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56651.3us
I20260501 14:00:34.596946  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:34.588568  7576 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 6, term changed from 10 to 11, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to <none>. New cstate: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:34.601998  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.607936 12409 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:34.601166 12415 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:34.609094 12415 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:34.609481 12415 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:34.595038 12368 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:34.610183 12368 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:34.611209 12368 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.595243 12354 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260501 14:00:34.591655 12134 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260501 14:00:34.614575 12396 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:34.615151 12396 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.599871 12265 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:34.616251 12265 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:34.619311  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:34.617332 12265 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.623790  7576 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:34.629407 12128 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.624890  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.630630 12406 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:34.617352 12396 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:34.632071  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.632946 12406 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:00:34.628744  7576 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: leader changed from <none> to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 12 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:00:34.636615  7576 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:34.638334  7576 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:34.640233 11854 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.631963 12017 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260501 14:00:34.650619  7792 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.948s (SENT)
I20260501 14:00:34.645771 12409 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:34.648429 12406 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260501 14:00:34.653188 12017 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:34.653630 12017 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:34.654270 12409 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:34.654671 12409 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:34.654628 12017 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.599025 12395 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:34.639770  7576 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 4 to 5, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 5 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:34.659468  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.663251  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:34.666671  7825 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260501 14:00:34.668497  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:34.673261  7746 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 9: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:34.680281  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:34.681449  7747 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:34.684854  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:34.695616  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:34.695616  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.694188  7746 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:34.698515  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.699474  7672 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:34.696991  7670 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:34.700865  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.701160  7752 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:34.701854  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.702508  8375 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:34.707159  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.709834  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.667936 12017 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:34.710471  8375 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:34.708025  7675 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:34.710839  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:34.715075  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.715934  7678 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:34.715767  7675 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
W20260501 14:00:34.716377  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65785.1us
I20260501 14:00:34.717352  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.712248  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:34.713212  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:34.711655  8372 raft_consensus.cc:2393] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 6: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:34.720904  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.721705  7677 raft_consensus.cc:2376] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14. Re-sending same reply.
I20260501 14:00:34.705363  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:34.680259 12134 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:34.723963  7821 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:34.720841  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:34.725965  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.726660  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:34.728384  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:34.736692  7673 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:34.729322  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:34.729435  7679 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:34.730186  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.738776  7675 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:34.731523  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:34.740816  7827 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:34.741487 11670 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:34.741964 11670 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.742020  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.734380  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.732352  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.744069  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.746990  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:34.748870  7671 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:34.753329  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.668507 12395 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260501 14:00:34.754004  8374 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:34.749861  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:34.754967  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.767874  7678 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:34.736781  7749 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:34.684119 11854 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260501 14:00:34.771522  8375 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:34.674501 12406 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260501 14:00:34.757061  7675 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260501 14:00:34.680099 12230 consensus_queue.cc:1059] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260501 14:00:34.701473 12274 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260501 14:00:34.785953 12408 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:34.791129  7677 pending_rounds.cc:85] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 5
I20260501 14:00:34.791494  7677 pending_rounds.cc:107] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260501 14:00:34.791740  7677 raft_consensus.cc:2889] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:34.792958  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.786612  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.786502 12363 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:34.788560  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:34.783723 11670 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:34.710125 11835 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260501 14:00:34.797864  7672 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:34.798755  7671 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260501 14:00:34.806030  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:34.655787 12409 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.763299 12317 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:34.756922 12269 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:34.816422  8374 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:34.729096 12359 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260501 14:00:34.818665  7673 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:34.818146  7749 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:34.823796  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.824682  8379 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:34.746315 12368 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260501 14:00:34.830591  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 112071us
I20260501 14:00:34.832242  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.793053 12427 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260501 14:00:34.758391 12407 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260501 14:00:34.800525 12408 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:34.858245  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:34.861619  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 103984us
I20260501 14:00:34.868247  8375 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260501 14:00:34.885601  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.890316  8374 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260501 14:00:34.890236  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.908263  8376 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260501 14:00:34.848718 12408 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:34.911708  8371 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:34.892315  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:34.859259 11835 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:34.914351  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.921730  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.922190  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.922554  8374 raft_consensus.cc:2376] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11. Re-sending same reply.
I20260501 14:00:34.923807  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:34.927673  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:34.923619 12432 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260501 14:00:34.922421 12426 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260501 14:00:34.823089 12366 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.924165  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.880044 12354 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:34.881291 12409 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:34.848423 12265 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260501 14:00:34.933315  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:34.857739 12415 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:34.948101  8374 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:34.943210  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 139222us
I20260501 14:00:34.833276 12317 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:34.928833 11835 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:34.886859 12385 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260501 14:00:34.949563  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:34.952031  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 184649us
W20260501 14:00:34.932740  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48143.6us
I20260501 14:00:34.959450  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:34.939071  8377 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:34.931843 12134 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:34.965818  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:34.951084  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:34.961753  7718 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.737s (SENT)
I20260501 14:00:34.972774  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:34.972915  7821 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
W20260501 14:00:34.982285  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:34.982903  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:34.991927  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:34.992264  7670 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
W20260501 14:00:34.984964  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 92762.5us
I20260501 14:00:34.954604 12427 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:34.979310 12416 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.008261 12230 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:35.012024 12359 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:35.034324  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:35.053797  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 94456.8us
I20260501 14:00:35.063119  7643 leader_election.cc:400] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:35.063616  7643 leader_election.cc:403] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260501 14:00:35.054888 12368 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:35.028383 12416 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:35.097438  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:35.098650  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 84855.9us
I20260501 14:00:35.101815  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:35.106122 12452 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:00:35.106622 12440 log.cc:927] Time spent T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260501 14:00:35.106873 12451 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260501 14:00:35.105422  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.066004 12359 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.119342 12366 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:35.093828 12406 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:35.126538  8379 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:35.034237 11835 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.117992  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:35.056463 12446 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260501 14:00:35.146085 12460 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:35.100371 12443 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260501 14:00:35.149914 12428 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260501 14:00:35.128677 12445 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 8. Current term is 9.
I20260501 14:00:35.153258 12452 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.156003 12415 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.156806 12317 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.140954 12396 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:35.183702 12396 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:35.184298 12396 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:35.184628 12450 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260501 14:00:35.186394 12415 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:35.125221 12359 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.169374 12459 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260501 14:00:35.125435 12406 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:35.174808 12348 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.175484 12427 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:35.161389  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 43511.7us
I20260501 14:00:35.177081 11835 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:35.215128  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.215411  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.216094  7673 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:00:35.216908  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:35.217749  7672 raft_consensus.cc:2410] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260501 14:00:35.193233 12415 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:35.213475 12435 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260501 14:00:35.224884  8375 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:35.233937  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:35.223276  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:35.239959  7670 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:35.222460 12017 consensus_meta.cc:287] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260501 14:00:35.216254 12348 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.221247 12416 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.238112  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:35.186869 12452 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.207103 12406 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:35.240617  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.216368 12427 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:35.240824  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:35.262678  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.268738 11670 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:35.271215  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:35.271540  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:35.267547  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:35.319199  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:35.320978  7673 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:35.238727 12415 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:35.320432  7672 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:35.322609  7671 raft_consensus.cc:2368] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10.
I20260501 14:00:35.326617  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.242624 12230 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260501 14:00:35.329411  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:35.240532 12428 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260501 14:00:35.341693 12274 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:35.342146 12274 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:35.343031 12274 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.341503 12428 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:35.334574  7673 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:35.325601 12377 consensus_meta.cc:287] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.765s	user 0.002s	sys 0.020s
I20260501 14:00:35.321979 12443 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:35.320349 12459 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:35.351764  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 80345.1us
I20260501 14:00:35.366492  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:35.326402 12424 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260501 14:00:35.337729  7675 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:35.328387 12265 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:35.370636  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.373539  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:35.375015  7673 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260501 14:00:35.383190  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.389860  7748 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:35.399433  7671 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:35.400846  7672 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:35.364586 12377 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.408965  7675 raft_consensus.cc:1275] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260501 14:00:35.409806  7677 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260501 14:00:35.384392 12482 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:35.416893  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:35.418329  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:35.371106 12443 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.400549 12445 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.371443 12459 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.428903  8380 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260501 14:00:35.436472  7671 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260501 14:00:35.440987  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.449113  7670 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:35.453845  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.412341 12265 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260501 14:00:35.457428  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:35.420456 12359 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.419924 12484 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.469712  7670 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:35.465013  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:35.471452 12467 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260501 14:00:35.474786 12478 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260501 14:00:35.475028 12444 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.475612 12444 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.476823 12465 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.477408 12456 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:35.477346 12465 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.478108 12456 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:35.478806 12468 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260501 14:00:35.461768 12486 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:35.431900 12445 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.477736 12444 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:35.496766  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.462466 12348 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:35.480578 12128 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:35.482638 11854 raft_consensus.cc:3055] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:35.482180 12459 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.480278 12438 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
W20260501 14:00:35.516933 12474 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260501 14:00:35.526309 12452 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.480786 12377 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:35.529320 12427 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.479785 12465 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.479228 12456 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:35.544052  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 274610us
W20260501 14:00:35.546473  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 448242us
W20260501 14:00:35.551298 12409 consensus_meta.cc:287] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260501 14:00:35.523927 12128 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:35.532459 11854 raft_consensus.cc:740] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:35.536612 12438 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:35.473055 12484 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.563966  7746 raft_consensus.cc:2410] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260501 14:00:35.563865  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:35.567431  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:35.550129 12492 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:35.574090 12443 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.576886 12427 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:35.577898  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:35.578785  7748 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:35.581103 11854 consensus_queue.cc:260] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.582297 11854 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:35.584364 12438 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:35.586122 12408 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.003s
I20260501 14:00:35.586613 12408 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.587884  7751 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 16. Current term is 17. Ops: []
I20260501 14:00:35.565511 12377 consensus_queue.cc:1059] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260501 14:00:35.565680 12405 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260501 14:00:35.590274  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.591504 12484 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.591619  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.592443 12269 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:35.606539 12269 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:35.607587 12449 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.510s	user 0.003s	sys 0.000s
I20260501 14:00:35.609531 12428 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260501 14:00:35.594527 12377 raft_consensus.cc:3055] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:35.610605 12377 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:00:35.610821 12457 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.492s	user 0.000s	sys 0.002s
I20260501 14:00:35.611542 12377 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.613220 12377 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:35.592655 12464 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:35.592379 12473 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:35.607522  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:35.617544  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 160235us
I20260501 14:00:35.623463 12492 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:35.624886  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.624648 12492 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.625809 12274 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:35.596813 12472 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:35.628492 12317 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:35.629053 12317 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:35.630002 12317 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.628572 12472 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:35.654462  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:35.669799  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51381us
W20260501 14:00:35.670202  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 102901us
I20260501 14:00:35.670881  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:35.672868  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.600119 12445 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.677410  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:35.680078  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 61587.4us
I20260501 14:00:35.683262  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.617511 12464 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:35.688344  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.688903 12395 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260501 14:00:35.697407  7825 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:35.697832 12317 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:35.685567 12463 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:35.699894 12445 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:35.704538 12489 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:35.704694 12408 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.695540  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:35.727664 12489 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.728883 12473 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:35.729429 12473 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:35.729852 12473 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:35.730353 12489 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:35.680347 12409 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:35.732299 12409 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:35.732839 12396 consensus_meta.cc:287] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260501 14:00:35.732738 12438 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:35.733412 12409 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.607489 12269 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:35.736370 12485 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.367s	user 0.004s	sys 0.000s
I20260501 14:00:35.584364 12128 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.721558 12472 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.738132 12472 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:35.705721 12495 raft_consensus.cc:2764] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260501 14:00:35.690448 12464 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:35.695060 11835 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:35.733551 12396 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.737260 12128 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:35.679931 12428 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:35.707697 12415 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.716172  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:35.763022  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 74797.3us
I20260501 14:00:35.745381  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:35.763602  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48751.1us
I20260501 14:00:35.736549 12269 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:35.765372  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:35.765555  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:35.766065  7827 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:35.750165  7825 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:35.769579  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:35.770607  7828 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:35.773181  7752 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:35.766076  7826 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:35.773185  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:35.774801  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:35.740222 12427 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:35.780117  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:35.780666  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:35.780786  7754 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:35.782466  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.748903 12463 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:35.768818 12408 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.762169 12428 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:35.796491  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:35.799615  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:35.739895 11670 consensus_queue.cc:1175] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "91854d93e96c4756834efe8b2ef59fce" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260501 14:00:35.808712  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.791041 11835 raft_consensus.cc:2764] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260501 14:00:35.811571  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:35.794358 12471 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:35.794044 12483 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:35.813858  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:35.812943 12265 consensus_queue.cc:1059] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260501 14:00:35.779426 12134 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260501 14:00:35.776748 12489 consensus_queue.cc:1059] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260501 14:00:35.806324 12428 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:35.822188 12390 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:35.791374 12427 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:35.790397 12363 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260501 14:00:35.831058  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:35.831597  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.819593 12493 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:35.790056 12406 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.840839  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.815690 12471 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:35.820132 12482 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260501 14:00:35.844727  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.805724 12408 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.807346 12348 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260501 14:00:35.836974 12405 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:35.846393 12471 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:35.867623 12499 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260501 14:00:35.871129 12500 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260501 14:00:35.873037  8372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:35.851487 12465 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:35.851048 12390 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
W20260501 14:00:35.866060  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 48331.2us
I20260501 14:00:35.828246 12463 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.863404  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.881983  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:35.883299  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:35.884557  8380 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:35.884912  8379 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260501 14:00:35.883384  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:35.883628  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:35.887112  8375 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:35.896924 12427 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:35.898006 12405 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:35.898671 12405 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:35.899179 12405 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:35.904316 12415 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:35.907934 12476 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:35.877588 12390 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:35.909341 12390 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.910670 12390 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:35.912912 12406 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:35.888224 11835 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:35.914294 11835 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:35.914722 11835 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:35.917686 12494 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260501 14:00:35.921530 12408 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:35.922740 12396 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:35.924057  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:35.924151  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 43858.3us
W20260501 14:00:35.925906  7792 leader_election.cc:336] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.775s (SENT)
I20260501 14:00:35.926383  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:35.927594 12427 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:35.930370  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:35.942214  8375 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:35.854060 12486 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:35.960958 12486 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.843173 12493 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.967284 12493 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:35.967366  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:35.955016 12428 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.969869 12428 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:35.949852 12465 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:35.955072 12416 raft_consensus.cc:993] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:35.970815 12416 raft_consensus.cc:1081] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:35.943625 12476 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:35.898082 12501 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260501 14:00:35.976123  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:35.982054  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 100145us
I20260501 14:00:35.942886 12317 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:35.990947  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 1079) took 1286 ms. Trace:
I20260501 14:00:35.991552  7746 rpcz_store.cc:276] 0501 14:00:34.704924 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:34.705100 (+   176us) service_pool.cc:224] Handling call
0501 14:00:35.990655 (+1285555us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54001af254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:35.990859 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934160768}
I20260501 14:00:35.997478 12354 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260501 14:00:35.997773 12476 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:35.998502 12354 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:00:35.998864 12354 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:35.996120 12495 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260501 14:00:35.997668 12509 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:36.002171 12509 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:36.002682 12509 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:36.015401  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 251588us
I20260501 14:00:36.019366  7670 raft_consensus.cc:1275] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260501 14:00:36.021061  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:36.021164  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.021656  7673 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:36.038935  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.041720  7670 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260501 14:00:36.045045  7670 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260501 14:00:36.049683  7670 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:35.995254 12317 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:36.052376  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.056942  7676 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:36.057796  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:35.985529 12428 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260501 14:00:36.062598  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:36.060861 12317 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:36.072275  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:36.014957 12484 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:36.077246  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.075958  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:35.996897 12465 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260501 14:00:36.084764 12505 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.085573 12505 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:36.086499 12488 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.605s	user 0.003s	sys 0.001s
I20260501 14:00:36.056581 12460 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.081312 12405 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.083715 12473 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.084820 12465 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:36.079558  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:36.091032  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.089211  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:36.074080 12498 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:36.101395 12490 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:36.022828 12495 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260501 14:00:36.103051 12473 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:36.088140 12445 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 10 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:36.107453 12405 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.109035  7671 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:36.120277  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44412.6us
I20260501 14:00:35.999769 12354 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.099334 12428 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
W20260501 14:00:36.126936  7792 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.969s (SENT)
I20260501 14:00:36.087785 12505 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.136642  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.130257  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.132292  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:36.137908  7792 leader_election.cc:336] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.992s (SENT)
I20260501 14:00:36.138440  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.138445  7821 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:36.108685 12465 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:36.117496 12498 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:36.145243  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:36.129105 12377 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
I20260501 14:00:36.147377  7821 raft_consensus.cc:1240] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:36.126147 12472 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:36.153061  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.137037 12409 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:36.125062 12490 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.127348 12363 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:36.155296  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.142406 12265 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:36.155334  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.136754 12473 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:36.159956  8372 raft_consensus.cc:606] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.172698  8372 raft_consensus.cc:614] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:36.136480 12428 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:36.161383  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.089056 12460 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.165196  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.186822  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.175724  7826 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260501 14:00:36.144805 12493 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:36.181888  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.182170  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.183951  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.184541  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.184886  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.185196  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.191409  7822 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:36.187161  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.155766 12354 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:36.191851  7673 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:36.192533  8377 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:36.192718  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.187547  7748 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:36.193506  7828 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:36.147184 12505 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.156106 12515 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.158841 12409 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:36.198084  8379 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260501 14:00:36.163260 12348 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:36.199424  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 61542.4us
I20260501 14:00:36.200762  7819 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260501 14:00:36.202692  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.202775  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:36.204349  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.194820 12269 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:36.206704  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:36.209275  7673 raft_consensus.cc:2376] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12. Re-sending same reply.
I20260501 14:00:36.174662 12473 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:36.186656 12459 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.222633  8377 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260501 14:00:36.222839  7792 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.997s (SENT)
I20260501 14:00:36.201268  7823 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 10 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:36.235918  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.213678  7671 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260501 14:00:36.230820  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.232627  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:36.232671  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.237843  7675 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:36.238582  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 85332.7us
I20260501 14:00:36.240137  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:36.207698 12409 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:36.251806  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.255378  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.259733  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.260619  7670 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:36.188412 12363 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.249078 12512 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:36.232442 12269 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.272799 12483 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:36.248736 12472 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:36.245330 12493 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.263952  8377 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 10 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:36.203768 12465 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.197589 12515 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.275753 12472 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:36.247452 12459 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.275326 11835 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.279207 12406 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.280402  7819 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:36.283039 12492 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:36.283198  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.283303  7676 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:36.284164  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.208173 12505 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.325208  7819 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:36.274207  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.336364  7675 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:36.288055  8379 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:36.288555  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:36.337641  7753 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:36.335320  7819 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.338984  7819 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:36.288882  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.261971 12348 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:36.292624  7670 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:36.298501  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:36.295539 12427 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260501 14:00:36.344333  7750 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:36.297925 12482 consensus_queue.cc:1048] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260501 14:00:36.284896 12484 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260501 14:00:36.235623 12464 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:36.305953  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:36.274888  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 222840us
I20260501 14:00:36.286880 12415 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260501 14:00:36.300283 12269 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.290339 12493 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.347265  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:36.373060  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 84535.4us
W20260501 14:00:36.302613 12487 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.826s	user 0.007s	sys 0.000s
W20260501 14:00:36.356209  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 76510.9us
I20260501 14:00:36.301337 12472 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:36.327575  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44457.1us
I20260501 14:00:36.360280  7752 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:36.287386 12471 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.359862  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:36.381219  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.347482  7674 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:36.381454  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.264021 12428 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.380443  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.287376 12473 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.386009 11670 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:36.301744 12512 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260501 14:00:36.382970  7749 raft_consensus.cc:2393] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:36.389825  7672 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:36.359699 12502 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.387584 12525 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:36.389300  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.381958  7828 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:36.334203 12406 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.388585  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.386168  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.391404  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.436214  7754 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
W20260501 14:00:36.436477  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 50404.7us
I20260501 14:00:36.437078 12492 raft_consensus.cc:2764] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260501 14:00:36.437352  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:36.392472 12518 log.cc:927] Time spent T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260501 14:00:36.393035  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.437865  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.438530 12492 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:36.438621  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.437875 12521 consensus_queue.cc:1048] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260501 14:00:36.439481 12377 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:36.440023  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:36.440492 12377 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:36.394033  8376 raft_consensus.cc:1240] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:36.394284  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.442071  8375 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:36.394992  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.400638  8381 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260501 14:00:36.444133  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.444700  8379 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:36.387647  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:36.411623  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.446674  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:36.384178 12519 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260501 14:00:36.376639 12438 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:36.414112  7675 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
W20260501 14:00:36.453117  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 65561.6us
I20260501 14:00:36.434501  8380 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:36.393573  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.453958  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.454324  8373 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:36.455219  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:36.457758  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:36.445477 12487 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.003s
I20260501 14:00:36.362495 12523 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260501 14:00:36.383793 12407 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:36.441221  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:36.483686  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.461761  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.486554  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.487809  7675 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:36.488006  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.488386  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.462273  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.462976  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.389465 12460 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.415334 12525 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:36.466189  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.466604 12526 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:36.467325 12428 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:36.468278 12459 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.386795 12269 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260501 14:00:36.470111 12390 consensus_meta.cc:287] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.001s
W20260501 14:00:36.471678 12514 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260501 14:00:36.472172  7819 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260501 14:00:36.544849  7819 pending_rounds.cc:85] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 7
I20260501 14:00:36.545181  7819 pending_rounds.cc:107] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260501 14:00:36.472800  8373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789c720014934abe950ad611625f9bc9"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:36.545459  7819 raft_consensus.cc:2889] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:36.472906  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:36.473304 12493 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.492344 12407 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.416592 12502 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.494731 12536 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:36.494796 11835 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.452152 12492 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:36.496945  7822 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:36.484450  7745 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:36.498785  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.500356  7753 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:36.510340  7824 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:36.513551  7749 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:36.525048  7750 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:36.511031 12525 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:36.475155 12408 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:36.532858  7675 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:36.495711 12363 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.465339 12490 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.538995  8380 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:36.526773  8375 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:36.497907  7670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2"
dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:46596
I20260501 14:00:36.482720 12486 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.525676 12494 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.549055  8381 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:36.508368 12484 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:36.561790  7676 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:36.562289  7754 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:36.572592  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 133244us
W20260501 14:00:36.580298  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:36.580693  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 107865us
I20260501 14:00:36.582716  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:36.537734 12526 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:36.585404 12545 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:36.589165 11670 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:36.554939 12395 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.596412  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.598006  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:36.585613 12523 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:36.606601  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.607215  7745 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
W20260501 14:00:36.610210  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 232529us
I20260501 14:00:36.599852 12459 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.631215  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.592031 12484 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:36.632822  7820 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260501 14:00:36.601986 12545 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:36.607036 12464 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.602778 12471 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:36.630903 12509 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.002s
I20260501 14:00:36.634626  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.633615  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:36.640794 12545 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:36.627966 12523 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.609715 12515 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.688875  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.611428 12505 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.631980 12490 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:36.630685 12460 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:36.692999  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.600332 12486 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.591158 12494 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.633167 12269 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:36.639299 12484 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:36.641281 12354 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260501 14:00:36.640175 12459 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.700940 12416 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:36.704519  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:36.688818 12426 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260501 14:00:36.611696 12395 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.733834 12395 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.734458 12395 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:36.734890 12395 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:36.698107 12482 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:36.638319 12493 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260501 14:00:36.736948 12409 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:36.720376  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 85825.9us
W20260501 14:00:36.714111 12529 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260501 14:00:36.742169  7748 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:36.728504 12548 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260501 14:00:36.715716 12536 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:36.692793 12509 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.608217 12526 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.758853  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.759621  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:36.760496  8375 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:36.760381  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.761094  8381 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:36.762033 12377 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:36.762416 12486 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.763095  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.756699 12460 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:36.716567 12406 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:36.768505  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 131124us
I20260501 14:00:36.769829  7745 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:36.773313 12536 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.716355 12269 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.776654 12523 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.777954 12269 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.778213 12509 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.768334 12486 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.766546 12544 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:36.780207  8377 raft_consensus.cc:2368] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14.
I20260501 14:00:36.779808 12486 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.763644 12416 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260501 14:00:36.735773 12395 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.782145 12486 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:36.779634 12317 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.002s
I20260501 14:00:36.756724 12409 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.765082 12546 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.767966 12407 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.779877 12494 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.790880  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:36.797878 12464 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:36.800168 12460 raft_consensus.cc:2764] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260501 14:00:36.789531 12544 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:36.802729 12544 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.791551 12538 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260501 14:00:36.805624 12445 consensus_meta.cc:287] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.001s
I20260501 14:00:36.813815 12541 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:36.814455 12541 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.816911 12459 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.817723  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.819942 12472 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:36.820488 12134 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:36.821046 12134 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:36.822160 12472 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.822474 12538 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.822824 12472 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:36.846923  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 77084.4us
I20260501 14:00:36.847836  7821 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260501 14:00:36.848254  7821 pending_rounds.cc:85] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 10
I20260501 14:00:36.848541  7821 pending_rounds.cc:107] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260501 14:00:36.848394  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.848856  7821 raft_consensus.cc:2889] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:36.836210  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:36.822988 12538 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.856881  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.856978  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.818445 12524 raft_consensus.cc:2955] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:36.858129  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.858680 12538 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:36.857499  7822 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:36.859270 12538 raft_consensus.cc:2764] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260501 14:00:36.868378 12465 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:36.870963 12472 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.890391  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:36.896477  8374 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:36.898007  7822 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
W20260501 14:00:36.900339  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.902619  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.904340  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.893901  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.870128 12484 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.907100  8379 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:36.904286  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:36.909945  7745 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:36.788056 12317 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:36.911680  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 278156us
I20260501 14:00:36.911886  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.915203  7823 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:36.915055  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.915975  7822 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:36.916828  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.917201 12464 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:36.918056  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.918658  8376 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:36.917459  8375 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:36.874557 12502 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:36.920346  7670 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:00:36.791903 12532 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260501 14:00:36.923286  7670 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:36.930770  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.886437 12551 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:36.936384  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.937183  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:36.937192  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.937683  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:36.942018  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.888373 12482 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260501 14:00:36.942518  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.901422 12390 consensus_queue.cc:1059] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260501 14:00:36.944514  8376 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:36.921147 12265 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:36.945025  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:36.946494  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:36.940690  7670 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.892475 12368 consensus_queue.cc:1059] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260501 14:00:36.951427  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.920624 12415 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:36.951454  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.950049  7673 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:36.958716  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.959671  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.960294  7673 raft_consensus.cc:2376] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13. Re-sending same reply.
I20260501 14:00:36.961094  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:36.961756  7673 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 8: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:36.946779 12395 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:36.954579  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:36.794507 12546 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.955788  7679 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 10. Ops: []
I20260501 14:00:36.965523  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.956257  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:36.966346  7676 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:36.957063  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:36.967950  8376 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:36.956647  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.972908  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.973758  7822 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:36.975736  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.976634  7822 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:36.977744  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.982968  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.983543  7823 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:36.983879  7824 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:36.978644  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.985200  7676 raft_consensus.cc:2376] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11. Re-sending same reply.
I20260501 14:00:36.980175  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.986094  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:36.971302  7751 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:36.948221 12471 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:36.949724 12265 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:36.981871  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:36.981909  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.963052 12532 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.992483  7675 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:36.993993  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:36.963841 12359 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:36.964890 12527 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:00:36.995885  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 105684us
I20260501 14:00:36.964898 12395 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:37.011198  7673 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:37.012334  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:37.019637  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:37.014906  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:37.016511  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:36.995399  7752 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:37.021550  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:37.028595  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.995910 12265 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:37.035851  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:37.040030  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:36.945932 12551 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:36.970911 12415 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.043723  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:36.994194 12541 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.012398 12494 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:36.982061 12502 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260501 14:00:37.027681 12395 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:37.036952 12486 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:37.061065  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:36.998481 12471 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.028100 12406 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:37.057438  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:37.055444  7823 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:37.040575 12472 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:36.989658 12557 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260501 14:00:37.052641 11854 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.028254 12359 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.052628 12489 raft_consensus.cc:3055] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Stepping down as leader of term 5
I20260501 14:00:36.947425 12498 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.076277 12567 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:37.055261 12541 raft_consensus.cc:3055] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:37.058879 12486 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:37.065164 12494 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:37.065765 12445 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260501 14:00:37.124126  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 88364.2us
I20260501 14:00:37.124862  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:37.062431 12363 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:37.017730 12532 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.083938 12390 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:37.160127 12390 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:37.055231 12556 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:37.160619 12390 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:37.056595 12463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.010s	sys 0.022s
I20260501 14:00:37.168476 12556 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:37.168848 12551 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:37.168071 12463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.011s	sys 0.022s
I20260501 14:00:37.104934 12317 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.108067 12541 raft_consensus.cc:740] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:37.181183 12541 consensus_queue.cc:260] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.182521 12541 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:37.182173 12134 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.103780 11854 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.183969 12549 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:37.184505 12549 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:37.185058 12549 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:37.185911 11854 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.186098 12368 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:37.184422 12390 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.144167 12445 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:37.186566 12368 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:37.187059 12445 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:37.188544 12565 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260501 14:00:37.188333 12494 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.188917 12390 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.191720  7672 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:37.121451 12486 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:37.152860 12561 log.cc:927] Time spent T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260501 14:00:37.153698 12558 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260501 14:00:37.154639 12546 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.155632 12532 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:37.157473  7825 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:37.101053 12489 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:37.071156 12525 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.159549 12568 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:37.168953 12556 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:37.171437  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:37.174007 12569 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260501 14:00:37.174827 12563 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260501 14:00:37.193995  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:37.149411 12363 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:37.063845 12484 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:37.200367  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 139374us
I20260501 14:00:37.183588 12134 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:37.133373 12491 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.068207 12406 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:37.210455  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 85689.6us
I20260501 14:00:37.144639  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.187575 12368 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.229218 12128 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:37.213974 11854 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.271267  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:37.271437  8373 raft_consensus.cc:606] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:37.278288  8373 raft_consensus.cc:614] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:37.271711  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.961s (SENT)
W20260501 14:00:37.272887  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 379098us
I20260501 14:00:37.167536 12545 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:37.275228  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 130678us
I20260501 14:00:37.279971  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:37.280848  8381 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:37.281970  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.282754  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:37.284017  7754 raft_consensus.cc:2410] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260501 14:00:37.285018  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:37.297448  7749 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260501 14:00:37.298064  7749 pending_rounds.cc:85] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 9
I20260501 14:00:37.298403  7749 pending_rounds.cc:107] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260501 14:00:37.298753  7749 raft_consensus.cc:2889] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:37.298905  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:37.262248 12363 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:37.260486 12502 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.264802 12568 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:37.264639 12483 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:37.274659 12128 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:37.315048  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:37.325623  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:37.277995 12532 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.281375 12269 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:37.328447  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:37.343279  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:37.328706 12128 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:37.346719  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:37.347906 12269 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:37.348132  7674 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 5. Current term is 6. Ops: []
I20260501 14:00:37.348438 12269 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:37.348687 12560 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260501 14:00:37.348981 12269 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:37.350479  7674 raft_consensus.cc:1275] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:37.350857 12476 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.351399 12476 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.353986 12476 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:37.354542 12476 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:37.355020 12476 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:37.355875 12570 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260501 14:00:37.356319  7748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60268 (request call id 2184) took 1081 ms. Trace:
I20260501 14:00:37.341795  7824 raft_consensus.cc:2955] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:37.356704  7748 rpcz_store.cc:276] 0501 14:00:36.274837 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.283899 (+  9062us) service_pool.cc:224] Handling call
0501 14:00:37.356114 (+1072215us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540022c254. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:37.356249 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945235712}
I20260501 14:00:37.358208 12406 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.359333 12359 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.360587  7670 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.360802 12525 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.336014 12484 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:37.363313  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:37.363787  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.321900  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:37.331776 12571 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:37.334928 12554 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:37.314860 12557 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:37.327602 12385 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.288276 11854 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:37.337464 12497 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.082s	user 0.002s	sys 0.002s
I20260501 14:00:37.323560  7745 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:37.311897 12492 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:37.313004 12415 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.365602  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:37.368695  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:37.315514 12502 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.314502 12544 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:37.387280  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:37.394228 12476 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.401906  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:37.336820 12574 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.410506 12407 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:37.404472  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:37.405493  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:37.406383  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 84601.8us
I20260501 14:00:37.411690  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:37.425105  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2177) took 1262 ms. Trace:
I20260501 14:00:37.428699  7748 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:37.375897  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:37.430084  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 86874.9us
I20260501 14:00:37.428191 12317 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:37.270553 12491 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.382973 12571 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:37.388190 12471 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.346208 12532 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.426608 12409 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:37.501341 12515 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:00:37.431233  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:37.506409 12578 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260501 14:00:37.507689 12465 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.508226 12465 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.510492 12465 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.452697  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:37.514690  8380 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:37.515573  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:37.516299  8380 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:37.517055  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:37.517202 12502 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.517616  8380 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:37.454494  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:37.428241 12554 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:37.456269  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.449143  7746 rpcz_store.cc:276] 0501 14:00:36.145709 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.145911 (+   202us) service_pool.cc:224] Handling call
0501 14:00:36.146409 (+   498us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:36.209873 (+ 63464us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:36.209952 (+    79us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:36.211211 (+  1259us) log.cc:844] Serialized 52 byte log entry
0501 14:00:36.872985 (+661774us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b1800492e80. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:36.964201 (+ 91216us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:36.964247 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:36.964325 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:37.388830 (+424505us) raft_consensus.cc:1685] finished
0501 14:00:37.388867 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:37.408233 (+ 19366us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43037,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":7700,"spinlock_wait_cycles":14129024,"thread_start_us":137001,"threads_started":2,"wal-append.queue_time_us":807509}
I20260501 14:00:37.328629 12483 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.478111  8376 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:37.314857 12489 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.488631  7674 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260501 14:00:37.489585  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:37.464587 12574 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.493729 12395 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.446791 12581 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.496944  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:37.535583  8379 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:37.425966 12385 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:37.500178  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50228.5us
I20260501 14:00:37.538527  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.512156  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:37.512852  7745 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:37.520444  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:37.523156  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 66951.9us
I20260501 14:00:37.541455  7748 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:37.542044  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.542431  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:37.543236  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.543277  7751 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
W20260501 14:00:37.451659  7792 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.524s (SENT)
I20260501 14:00:37.526015  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:37.453924 12475 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:37.410923 12557 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.524170  7750 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
W20260501 14:00:37.544705  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 93097.4us
I20260501 14:00:37.491904 12317 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:37.493067 12571 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:37.552304  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.553316 12580 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:37.565274 12580 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.565446 12556 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.554704 12525 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:37.546288 12475 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:37.554893 12549 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.555967  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:37.556080  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:37.571097  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:37.575755  7827 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:37.533538 12502 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:37.571847  7674 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:37.583950  7821 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:37.567559 12580 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:37.573092  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 1080) took 2864 ms. Trace:
I20260501 14:00:37.573464  7678 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:37.538398 12486 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.579487 12574 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.579541 12385 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.626412  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:37.627511  7824 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 16: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:37.571359 12562 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260501 14:00:37.567773 12556 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.579979 12317 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.545977 12489 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 5 FOLLOWER]: Advancing to term 6
I20260501 14:00:37.549996 12456 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:37.581436 12525 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:37.547520 12545 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.527638 12575 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:37.583731  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:37.618953  7747 rpcz_store.cc:276] 0501 14:00:34.708654 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:34.739171 (+ 30517us) service_pool.cc:224] Handling call
0501 14:00:34.739672 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:34.783355 (+ 43683us) raft_consensus.cc:1534] Early marking committed up to index 11
0501 14:00:34.991362 (+208007us) log.cc:844] Serialized 14 byte log entry
0501 14:00:35.343713 (+352351us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18004043e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa2805da 00007fb2fa6ebe0a
0501 14:00:35.510819 (+167106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:35.520071 (+  9252us) log.cc:844] Serialized 26 byte log entry
0501 14:00:35.520227 (+   156us) raft_consensus.cc:1645] Marking committed up to 12
0501 14:00:35.525211 (+  4984us) log.cc:844] Serialized 14 byte log entry
0501 14:00:35.538166 (+ 12955us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:35.538278 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:36.073710 (+535432us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18004043e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:36.195501 (+121791us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b18004043e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:37.336651 (+1141150us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:37.572853 (+236202us) raft_consensus.cc:1685] finished
0501 14:00:37.572880 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:37.573008 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25400,"prepare.queue_time_us":224347,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":117,"raft.queue_time_us":44645,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":27373,"spinlock_wait_cycles":39602944,"thread_start_us":353929,"threads_started":2,"wal-append.queue_time_us":524656}
I20260501 14:00:37.569746 12549 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.643584  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:37.656075  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:37.568940 12428 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:37.568326 12475 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:37.727775  8373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35982 (request call id 12) took 1166 ms. Trace:
I20260501 14:00:37.572290 12415 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:00:37.758684  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:37.770305  7820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2319) took 1514 ms (client timeout 1947 ms). Trace:
I20260501 14:00:37.572631 12128 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:37.858568  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:37.872290  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:37.882372  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 336791us
W20260501 14:00:37.935448  7820 rpcz_store.cc:269] 0501 14:00:36.129071 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.129314 (+   243us) service_pool.cc:224] Handling call
0501 14:00:37.643158 (+1513844us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54002eac54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:37.643301 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109814528}
I20260501 14:00:37.978834  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:37.979321 12557 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:37.547209 12581 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:37.979734  7820 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:37.981755 12581 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:37.982293 12581 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:37.983448  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:37.984478  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:37.726730 12574 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:38.004081  7824 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:38.066183  8373 rpcz_store.cc:276] 0501 14:00:36.472333 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.472649 (+   316us) service_pool.cc:224] Handling call
0501 14:00:37.638359 (+1165710us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540060bb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6dbc33 00007fb2ff6b7cca 00007fb2f8c30934 00007fb2f8c308c2 00007fb2f8c307f1 00007fb2f8c3076c 00007fb2f8c2fa22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:37.638525 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668799744}
W20260501 14:00:38.100207  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.025s	sys 0.059s
W20260501 14:00:37.769495 12265 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.000s
W20260501 14:00:38.100629  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.025s	sys 0.059s
W20260501 14:00:38.102388  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 527107us
I20260501 14:00:37.987114 12545 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:37.534878 12568 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:38.068655 12524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.017s	sys 0.040s
I20260501 14:00:37.999692 12348 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260501 14:00:38.104167 12490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.383s	user 0.020s	sys 0.068s
I20260501 14:00:38.010967 11854 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.116654  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:38.003177 12574 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:38.116503 12524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.017s	sys 0.041s
I20260501 14:00:38.098013 12491 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.112427 12584 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:38.137475  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:38.121547 12348 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:38.127338  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 543624us
I20260501 14:00:38.142716  7749 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:38.141868  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:38.130287 12585 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.511s	user 0.001s	sys 0.000s
W20260501 14:00:38.130069 12490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.021s	sys 0.069s
I20260501 14:00:38.146994  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:38.100455 12525 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:38.130256 12463 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.155890  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:38.130345 12532 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.127503 12544 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:38.156774  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:38.154887  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:38.178776  7749 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 10
I20260501 14:00:38.161154  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:38.179837  8379 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:38.180188  8379 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:38.161566  7750 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260501 14:00:38.161947  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:37.943271 12575 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:38.149405 12445 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.957s	user 0.013s	sys 0.001s
I20260501 14:00:38.165063  8377 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 9: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:38.166585  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.146440 12580 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:38.111759 12265 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.126046 12521 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260501 14:00:38.153036 12483 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.116748 12545 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.212654  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.152714 12348 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:38.185559  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:38.166791 12269 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.001s
I20260501 14:00:38.219893 12269 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.222762 12269 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.181056  8379 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.224179  8379 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 10
I20260501 14:00:38.226704 12545 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.228849  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:38.229697  7670 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:38.188195  8372 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:38.230875  8372 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:00:38.223192  7748 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.002s
I20260501 14:00:38.156757 12395 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.241987  7819 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 8.
I20260501 14:00:38.239542  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:38.244056  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 259627us
I20260501 14:00:38.245757  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:38.194818 12580 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:38.189914  7747 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:38.162397 12490 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:37.857933 12554 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.202850  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:38.274115  8376 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:38.208693  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.208213  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.213598  7745 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:38.232796  7748 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:38.216528  7750 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:38.234386  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:38.277472  7752 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:38.195072 12491 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.190011 12486 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.251121  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:38.251019  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:38.284757  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:38.285086  8377 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:38.252226  7749 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:38.231954  8372 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.286180  8372 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:38.192945  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:38.286952  7824 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:38.248953  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:38.288065  7670 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:38.184479 12525 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.173898 12463 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.186798 12544 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:38.248796 12585 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260501 14:00:38.284555  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:38.289091  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:38.315793  7670 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:38.207201 11854 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:38.290673  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.320202  7749 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:38.235289 12456 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:38.249140 12556 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.283215  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:38.341482  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 90613.4us
W20260501 14:00:38.341686  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58621.8us
I20260501 14:00:38.295457  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.296265  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.342531  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:38.296788  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:38.242336 12492 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:38.250113 12581 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.345378 11670 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:38.200807 12445 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.298261  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:38.242796 12586 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:38.300828 12587 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
W20260501 14:00:38.304281 12592 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260501 14:00:38.304796 12363 consensus_meta.cc:287] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.003s
I20260501 14:00:38.358577 12586 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.358768 12363 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:38.360010 12589 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260501 14:00:38.362323  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:38.305323 12609 consensus_queue.cc:1059] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:38.273330 12580 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:38.272943 12483 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:38.273403 12128 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.299633  8379 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
W20260501 14:00:38.313891  7827 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.003s
W20260501 14:00:38.316836  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:38.285547 12395 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:38.312937 12593 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260501 14:00:38.337865  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:38.320268 12134 consensus_meta.cc:287] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.043s	user 0.010s	sys 0.010s
I20260501 14:00:38.418519  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:38.343680  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:38.346942  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:38.423620  8379 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:38.317849 12486 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.357074 12601 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:38.357461 12525 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.357775 12547 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.362929  7823 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:38.336440 12524 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:38.291721 12491 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.338888 11854 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.418712 12428 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.414227  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:38.480684  8377 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 15
I20260501 14:00:38.317831 12230 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:38.432969  7670 raft_consensus.cc:2468] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
W20260501 14:00:38.435228  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 92172us
I20260501 14:00:38.399142 12609 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.389223 12483 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:38.437050 12601 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.437191 12486 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.392987 12363 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.444854  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2931) took 1483 ms. Trace:
I20260501 14:00:38.496152  7673 rpcz_store.cc:276] 0501 14:00:36.961224 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.265690 (+304466us) service_pool.cc:224] Handling call
0501 14:00:37.266198 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:37.274795 (+  8597us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:37.274845 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:37.311965 (+ 37120us) log.cc:844] Serialized 26 byte log entry
0501 14:00:37.584449 (+272484us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:37.859571 (+275122us) log.cc:844] Serialized 14 byte log entry
0501 14:00:37.859900 (+   329us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:37.860020 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:38.444575 (+584555us) raft_consensus.cc:1685] finished
0501 14:00:38.444606 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:38.444781 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12479,"prepare.queue_time_us":281127,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5390,"raft.queue_time_us":33330,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":68561,"thread_start_us":201335,"threads_started":1,"wal-append.queue_time_us":595611}
I20260501 14:00:38.498585  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:38.499382  7673 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:38.444856  7826 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:38.492556 12483 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:38.470546 12574 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.347771 12456 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.546962  7752 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:38.398046  7827 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:38.349851 12492 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.350764 12581 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.547783  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:38.548907  7673 raft_consensus.cc:2410] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260501 14:00:38.469774  7753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42716 (request call id 1093) took 1976 ms (client timeout 1962 ms). Trace:
I20260501 14:00:38.349001 12269 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:38.433420 12406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.006s	sys 0.013s
W20260501 14:00:38.549459  7753 rpcz_store.cc:269] 0501 14:00:36.493145 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.582351 (+ 89206us) service_pool.cc:224] Handling call
0501 14:00:38.469517 (+1887166us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400116554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:38.469691 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862480640}
W20260501 14:00:38.560948  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 72968.6us
W20260501 14:00:38.444450 12484 consensus_meta.cc:287] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.083s	user 0.009s	sys 0.005s
I20260501 14:00:38.471887 12463 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:38.472365 12611 log.cc:927] Time spent T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260501 14:00:38.473050 12606 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.473232 12491 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:38.476246  7825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2336) took 1511 ms (client timeout 1632 ms). Trace:
I20260501 14:00:38.441566 12482 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:38.440454 12525 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:38.437716 12128 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:38.490180  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:38.440315 12602 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260501 14:00:38.420814 12395 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:38.608126  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:38.493242  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1982) took 2234 ms. Trace:
I20260501 14:00:38.443321 12575 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.487109 12230 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:38.439519 11670 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260501 14:00:38.483140 12265 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.413581 12608 consensus_queue.cc:1048] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.169s
I20260501 14:00:38.349138 12556 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.627729 11670 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:38.603902 12482 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:38.397948 12490 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.469233 12547 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.551316 12445 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.546653 12609 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:38.558234 12566 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.366s	user 0.004s	sys 0.006s
I20260501 14:00:38.567319  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:38.580716  8372 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:38.583455  8376 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:38.588429  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:38.625528 12230 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:38.653618  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:38.594798 12620 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260501 14:00:38.551309 12604 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260501 14:00:38.560726 12406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.006s	sys 0.014s
W20260501 14:00:38.601349  7825 rpcz_store.cc:269] 0501 14:00:36.964546 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.965265 (+   719us) service_pool.cc:224] Handling call
0501 14:00:38.475922 (+1510657us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540025f654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:38.476153 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439701376}
I20260501 14:00:38.488149 12428 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.606165  7670 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:38.446859 12524 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:38.684259 12524 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:38.589061 12484 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:38.611697  7677 rpcz_store.cc:276] 0501 14:00:36.258625 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.258812 (+   187us) service_pool.cc:224] Handling call
0501 14:00:36.875658 (+616846us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:36.876159 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:36.876201 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:36.892236 (+ 16035us) log.cc:844] Serialized 26 byte log entry
0501 14:00:37.058179 (+165943us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:37.058223 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:37.058296 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:37.361644 (+303348us) raft_consensus.cc:1685] finished
0501 14:00:37.361668 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:38.486838 (+1125170us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540005b4d0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:38.493152 (+  6314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12828,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11264,"spinlock_wait_cycles":1385490048,"thread_start_us":164931,"threads_started":1,"wal-append.queue_time_us":309010,"wal-append.run_cpu_time_us":2694,"wal-append.run_wall_time_us":1144436}
W20260501 14:00:38.654058 12377 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260501 14:00:38.605355  8379 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
W20260501 14:00:38.610342  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:38.546154 12134 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.628553 11670 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.592370 12363 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260501 14:00:38.611171 12610 raft_consensus.cc:2764] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260501 14:00:38.660424 12620 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:38.625029 12544 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.593750  8377 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
W20260501 14:00:38.654057  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 86883.3us
I20260501 14:00:38.654469  8376 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:38.593659  7823 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:38.667832 12463 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:38.655870 12613 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.656975 12580 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:38.657826  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 310968us
I20260501 14:00:38.715524  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:38.658187 12609 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.610329 12128 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.659387  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 784) took 1726 ms. Trace:
I20260501 14:00:38.610540 12525 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.669502  8372 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260501 14:00:38.648694 12396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.039s	sys 0.089s
I20260501 14:00:38.680583  7825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:38.727448  7678 rpcz_store.cc:276] 0501 14:00:36.932677 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.932832 (+   155us) service_pool.cc:224] Handling call
0501 14:00:36.947919 (+ 15087us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:37.621613 (+673694us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:38.659039 (+1037426us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54000c1554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:38.659290 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438125312}
I20260501 14:00:38.740656  7825 raft_consensus.cc:606] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:38.741187  7825 raft_consensus.cc:614] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:38.583395 12489 consensus_meta.cc:287] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.812s	user 0.006s	sys 0.008s
I20260501 14:00:38.701095  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2928) took 1740 ms. Trace:
W20260501 14:00:38.701663  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 363742us
I20260501 14:00:38.704123  8379 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:00:38.706909 12627 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:38.707451 12134 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.708477 12390 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.756139 12390 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.726446 12544 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:38.757329 12544 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.709079 11670 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.759305 12544 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.605007 12606 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.715986  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:38.728464  7677 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:00:38.723692  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:38.730674 12612 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.731469 12580 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.769243 12606 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:38.745325 12396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.039s	sys 0.090s
I20260501 14:00:38.761396 12574 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.770011 12612 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.770872 12574 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.731966 12128 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.733163 12556 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.733052 12483 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.734807 12395 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.734874 12348 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:38.736038 12584 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.006s
I20260501 14:00:38.736631 12581 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:38.738047 12475 consensus_meta.cc:287] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.003s
I20260501 14:00:38.738806 12482 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.753260 12627 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.742005  7675 rpcz_store.cc:276] 0501 14:00:36.960420 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.013364 (+ 52944us) service_pool.cc:224] Handling call
0501 14:00:37.039266 (+ 25902us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:37.292014 (+252748us) raft_consensus.cc:1534] Early marking committed up to index 9
0501 14:00:37.402988 (+110974us) log.cc:844] Serialized 14 byte log entry
0501 14:00:37.985035 (+582047us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b4800030cd8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2ff6191a1 00007fb2ff610237 00007fb2ff6100ca 00007fb2ff70792f 00007fb2ff7075f7 00007fb2ff71bc1c 00007fb2ff71bbc8 00007fb2ff71bb48 00007fb2ff71bb03 00007fb2ff71adac 00007fb2fe643b36
0501 14:00:38.388074 (+403039us) log.cc:844] Serialized 14 byte log entry
0501 14:00:38.473846 (+ 85772us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18003588a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:38.560802 (+ 86956us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:38.586288 (+ 25486us) log.cc:844] Serialized 26 byte log entry
0501 14:00:38.587092 (+   804us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:38.587378 (+   286us) log.cc:844] Serialized 14 byte log entry
0501 14:00:38.600939 (+ 13561us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:38.601035 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:38.700861 (+ 99826us) raft_consensus.cc:1685] finished
0501 14:00:38.700888 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:38.701031 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195592,"prepare.queue_time_us":299621,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":149,"raft.queue_time_us":152725,"raft.run_cpu_time_us":2700,"raft.run_wall_time_us":135325,"spinlock_wait_cycles":89595776,"thread_start_us":1289028,"threads_started":5,"wal-append.queue_time_us":715194}
I20260501 14:00:38.738927 12613 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:38.762038  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1999) took 1308 ms. Trace:
I20260501 14:00:38.774740 12486 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.776957  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.779587 12612 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.799582  7824 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 17: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:38.779348  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.799899  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2930) took 1839 ms. Trace:
I20260501 14:00:38.758944 12390 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.780938  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:38.714064 12620 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:38.790257  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:38.791195  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.797173  7677 rpcz_store.cc:276] 0501 14:00:37.453151 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.700568 (+1247417us) service_pool.cc:224] Handling call
0501 14:00:38.720480 (+ 19912us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:38.761670 (+ 41190us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:38.761961 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260501 14:00:38.739220 12528 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:38.779865 12609 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:38.799234 12489 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:38.800446  7672 rpcz_store.cc:276] 0501 14:00:36.960950 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.177521 (+216571us) service_pool.cc:224] Handling call
0501 14:00:37.177871 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:37.192141 (+ 14270us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:38.799555 (+1607414us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b540019c154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:38.799807 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31330176}
W20260501 14:00:38.806942 12571 consensus_meta.cc:287] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.210s	user 0.011s	sys 0.003s
W20260501 14:00:38.799499  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 83617.8us
I20260501 14:00:38.820287  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2042) took 1409 ms. Trace:
I20260501 14:00:38.809768  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:38.801373 12608 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:38.823465  7826 rpcz_store.cc:276] 0501 14:00:37.411174 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.411328 (+   154us) service_pool.cc:224] Handling call
0501 14:00:38.820057 (+1408729us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400297054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:38.820210 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290498304}
I20260501 14:00:38.809623  7748 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:38.825181  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:38.820765  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1980) took 2562 ms. Trace:
I20260501 14:00:38.826021  7671 rpcz_store.cc:276] 0501 14:00:36.257960 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.258721 (+   761us) service_pool.cc:224] Handling call
0501 14:00:37.177137 (+918416us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:37.177366 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:37.177410 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:37.177476 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0501 14:00:37.177523 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:37.177585 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:38.820566 (+1642981us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400059bd0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:38.820699 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078514944}
W20260501 14:00:38.821723  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:38.820091  7677 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:38.791738 12363 consensus_queue.cc:1059] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260501 14:00:38.830685  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 776) took 2343 ms. Trace:
I20260501 14:00:38.831159  7679 rpcz_store.cc:276] 0501 14:00:36.487221 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.488713 (+  1492us) service_pool.cc:224] Handling call
0501 14:00:36.489064 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:36.965575 (+476511us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:38.830359 (+1864784us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400037fd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:38.830605 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072930560}
W20260501 14:00:38.866689  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 57013.9us
I20260501 14:00:38.870664  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:38.871688  7746 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:38.873039  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:38.864725  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1994) took 1413 ms. Trace:
I20260501 14:00:38.876238  7673 rpcz_store.cc:276] 0501 14:00:37.451660 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.590004 (+1138344us) service_pool.cc:224] Handling call
0501 14:00:38.590461 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:38.601051 (+ 10590us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:38.601085 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:38.601132 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:38.601160 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:38.864345 (+263185us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540005aad4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:38.864419 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:38.864636 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23739776}
I20260501 14:00:38.837131  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:38.809190 12601 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:38.974758  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:38.956436  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.010423 11670 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:39.012791 11670 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:38.812253 12482 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:39.011034  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.036s	sys 0.083s
W20260501 14:00:39.010888  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 173847us
I20260501 14:00:38.815585 12609 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:39.027168  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.036s	sys 0.083s
I20260501 14:00:39.029421  7673 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:38.795884 12475 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:38.812534 12584 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260501 14:00:38.816994 12348 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.814693 12134 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:38.821473 12463 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:39.013911  7748 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:38.818137 12547 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.819844 12613 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:38.820883 12428 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:38.815361 12627 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:39.122004  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:39.169831  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:39.175531  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:39.175751  8376 raft_consensus.cc:2376] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11. Re-sending same reply.
I20260501 14:00:39.176024  8377 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:38.833424 12489 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.092746  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:39.151252 11670 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:39.095036  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.169771  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 1996) took 1717 ms. Trace:
W20260501 14:00:39.149103  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.577s (SENT) [suppressed 16 similar messages]
I20260501 14:00:38.920701 12363 raft_consensus.cc:3055] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:39.040117  8379 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260501 14:00:39.176191  7675 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:39.093115  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:38.865367 12486 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
W20260501 14:00:38.935408 12494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.013s
I20260501 14:00:38.918349 12274 raft_consensus.cc:3055] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:39.129443  8374 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:39.031623 12621 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:39.026924 12484 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.209884 12626 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:39.160060 12528 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.180727  7670 rpcz_store.cc:276] 0501 14:00:37.452203 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.697569 (+1245366us) service_pool.cc:224] Handling call
0501 14:00:38.721225 (+ 23656us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:38.721514 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 9
0501 14:00:38.738500 (+ 16986us) log.cc:844] Serialized 14 byte log entry
0501 14:00:39.169421 (+430921us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:39.169482 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:39.169531 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:39.169604 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:39.169713 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47357,"prepare.queue_time_us":17847,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":43773,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":391006,"threads_started":1}
I20260501 14:00:38.812196 12623 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:39.224083  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.224411  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:39.347383  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 60277.1us
I20260501 14:00:39.187924  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:39.339569  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.015s	sys 0.072s
I20260501 14:00:39.225405  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 707) took 1774 ms. Trace:
W20260501 14:00:39.350919  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.016s	sys 0.072s
I20260501 14:00:39.226606  7820 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:39.227320  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.037482 12609 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:39.029742 12567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.836s	user 0.060s	sys 0.041s
I20260501 14:00:38.830458 12571 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.092305 12601 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:39.214080 12494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.003s	sys 0.018s
W20260501 14:00:39.278390  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.188136 12390 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.189262 12544 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:39.209687 12363 raft_consensus.cc:740] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:39.418627  7794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.024s	sys 0.061s
I20260501 14:00:39.216570 12463 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:39.419018  7794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.024s	sys 0.061s
I20260501 14:00:39.227373 12486 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:38.862638 12608 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.226655 12348 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:39.442974  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.354444 12134 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.351050  8374 rpcz_store.cc:276] 0501 14:00:37.451085 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.452353 (+  1268us) service_pool.cc:224] Handling call
0501 14:00:39.086653 (+1634300us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b58001b6f98. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606572 00007fb3004c31d9 00007fb2ff63e5e0 00007fb2ff70776b 00007fb2ff7077f1 00007fb2ff6c9680 00007fb2ff6b3fe9 00007fb2ff6b3a92 00007fb2f8c1dd34
0501 14:00:39.129128 (+ 42475us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:39.224718 (+ 95590us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:39.225325 (+   607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2563328}
I20260501 14:00:39.351611  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:39.313578 12547 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.414145  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.456199  7671 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:39.351910 12554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.014s	sys 0.024s
I20260501 14:00:39.416662  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:39.355984 12490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.007s	sys 0.009s
I20260501 14:00:39.227391 12274 raft_consensus.cc:740] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:39.274448 12484 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.366494  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.466974  7670 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:39.361714 12483 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:39.442214  7746 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 10 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:00:39.358605 12567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.167s	user 0.064s	sys 0.050s
I20260501 14:00:39.421694 12601 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:39.413311 12472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.029s
I20260501 14:00:39.350016 12623 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:39.340271 12525 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.432489  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:39.481550  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.440076 12630 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260501 14:00:39.484351  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 51945.8us
I20260501 14:00:39.485191  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:39.436403  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.486492  7749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:39.340958  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:39.487288  8379 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:39.441824  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.444487  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.445029  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:39.452888  8376 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:39.454681  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:39.481031  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:39.452083  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:39.490664  7748 raft_consensus.cc:2368] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:39.490926  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:39.490131  8374 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:39.493028  7825 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:39.493283  7826 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:39.495441  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.501523  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.502512  7671 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:00:39.504016  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:39.504264  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:39.496364  7826 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:39.505152  8376 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:39.506948  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:39.507843  7826 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:39.511806  7820 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
W20260501 14:00:39.468954 12490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.008s	sys 0.010s
I20260501 14:00:39.519440  7678 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:39.461531 12493 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:39.485025 12472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.011s	sys 0.029s
I20260501 14:00:39.451316 12445 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:39.451296 12544 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:39.354642 12528 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.547068  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.535501  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:39.547482  7751 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:39.548341  8379 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:39.537485  7677 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260501 14:00:39.538511  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:39.538662  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.351516 12626 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.498061 12627 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260501 14:00:39.460551  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.007s	sys 0.030s
W20260501 14:00:39.565726  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.007s	sys 0.031s
W20260501 14:00:39.521541 12230 consensus_meta.cc:287] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.843s	user 0.013s	sys 0.000s
I20260501 14:00:39.520313 12630 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:39.554883  7675 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:39.558403  7826 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:39.559136  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 410047us
I20260501 14:00:39.296936 12621 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.491345 12602 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:39.491155 12567 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:39.566913  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:39.467329 12134 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.519529 12490 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:39.499013 12623 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:39.573038  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.573287  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.534320 12483 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:39.428642 12390 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.539151 12416 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:39.577179  7672 raft_consensus.cc:2368] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:39.577647  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.582233  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.582614  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.583554  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:39.467098 12348 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.568003 12472 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.440177 12363 consensus_queue.cc:260] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.572746 12406 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:39.574802 12630 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:39.601081  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.528721 12547 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.569248 12627 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:39.548943 12493 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.617755  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.562661 12544 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.592330  7671 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:39.551273 12445 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:39.629494  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.630021  7672 raft_consensus.cc:2393] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:39.630455  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.581784 12416 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:39.586367 12489 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:39.638409 12621 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.639007  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1256) took 2748 ms. Trace:
W20260501 14:00:39.639775 12618 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260501 14:00:39.599936 12509 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:39.639496  8381 rpcz_store.cc:276] 0501 14:00:36.890998 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.891121 (+   123us) service_pool.cc:224] Handling call
0501 14:00:36.891465 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:37.287413 (+395948us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:39.638725 (+2351312us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540060bb54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:39.638931 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890937728}
I20260501 14:00:39.586705 12475 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:39.605795 12622 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260501 14:00:39.632580 12390 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:39.641763  7819 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2034) took 2626 ms (client timeout 1992 ms). Trace:
W20260501 14:00:39.647735  7819 rpcz_store.cc:269] 0501 14:00:37.015132 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.015320 (+   188us) service_pool.cc:224] Handling call
0501 14:00:39.641578 (+2626258us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400012cd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:39.641688 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762113792}
I20260501 14:00:39.648330  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.576418 12230 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.617062 12627 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:39.648980  7671 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:39.572057 12274 consensus_queue.cc:260] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.606712 12630 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:39.577754 12602 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.618294  8376 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:39.656680  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:39.674422  7672 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:39.676011  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.676744  7819 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:39.571929 12463 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.677788  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.682133  7819 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
W20260501 14:00:39.677292  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:39.646013 12625 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
I20260501 14:00:39.592625 12483 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.600225 12472 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.642964 12509 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:00:39.655479 12631 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260501 14:00:39.645159 12489 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:39.590334 12486 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.654063 12632 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:39.677277 12571 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:39.685002  7670 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:39.685137  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:39.721807  7671 raft_consensus.cc:1240] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260501 14:00:39.687769  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.726227  7819 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:39.727159  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.706704  7826 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:39.719800  7672 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260501 14:00:39.739374 12638 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260501 14:00:39.738919 12509 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.739914  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.740139 12509 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:39.740746  7751 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:39.689260 12274 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:39.742726 12544 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:39.743022  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.742718  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.744042  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:39.704828 12608 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:39.748425  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:39.749140  7819 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:39.759876  7819 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:39.766920 12445 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:39.767352  7673 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260501 14:00:39.770097 12483 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:39.683626  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 164115us
I20260501 14:00:39.776270  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.776105  7671 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:39.717110 12484 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:39.699342 12416 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.728055 12354 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:39.844118  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.893923  7747 raft_consensus.cc:2410] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260501 14:00:39.889178  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:39.790818  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:39.796923  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.895026  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.906208  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.907349  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:39.894116  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.534s (SENT)
W20260501 14:00:39.904835  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 114125us
I20260501 14:00:39.723299 12632 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.910372  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.772506 12528 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:39.851961 12635 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260501 14:00:39.777597 12649 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:39.934104  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.863775 12230 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.940441  7745 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:39.850293 12602 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.953965  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.904625 12484 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:39.783633 12601 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:39.710160 12489 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.936599  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:39.931044 12626 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.686292 12567 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.949904 12630 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:39.952049 12639 log.cc:927] Time spent T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260501 14:00:39.952776 12348 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:39.983518 12317 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:39.938689 12445 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260501 14:00:39.863703 12134 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:39.781586 12608 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260501 14:00:39.965565 12484 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:39.936441  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:39.945626 12632 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:39.956451 12547 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.955875 12649 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:39.965977 12493 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:39.962374  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:39.984259 12317 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:39.976118 12416 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:40.007057  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.009971  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:40.010732  7819 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:40.011152  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:39.997148  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 60904.3us
I20260501 14:00:40.013077  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.013772  7752 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:40.014524  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:40.015592  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:40.018311  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 666759us
I20260501 14:00:40.019198  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.021162  8344 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:40.021530  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.021445 12525 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:40.022315 12525 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:40.022753 12606 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:40.019193  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 2040) took 2650 ms. Trace:
W20260501 14:00:40.003712 12620 consensus_meta.cc:287] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 1.183s	user 0.009s	sys 0.003s
W20260501 14:00:40.028995  7821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2343) took 2682 ms (client timeout 3175 ms). Trace:
W20260501 14:00:40.029495  7821 rpcz_store.cc:269] 0501 14:00:37.346283 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.364750 (+ 18467us) service_pool.cc:224] Handling call
0501 14:00:40.028790 (+2664040us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540021fcd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:40.028923 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357922560}
I20260501 14:00:40.023427 12525 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.000957 12230 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:40.004073 12626 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:40.025027  7822 rpcz_store.cc:276] 0501 14:00:37.369083 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.370694 (+  1611us) service_pool.cc:224] Handling call
0501 14:00:37.371102 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:37.573540 (+202438us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:37.573570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:37.574022 (+   452us) log.cc:844] Serialized 26 byte log entry
0501 14:00:38.069387 (+495365us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:38.069457 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:40.018682 (+1949225us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400298954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:40.018746 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:40.018805 (+    59us) raft_consensus.cc:1685] finished
0501 14:00:40.018834 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:40.019116 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10164,"spinlock_wait_cycles":464605952,"thread_start_us":486049,"threads_started":1,"wal-append.queue_time_us":816552,"wal-append.run_cpu_time_us":5920,"wal-append.run_wall_time_us":1051980}
W20260501 14:00:40.043922  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.068922  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.043430  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:40.036373 12396 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:40.042876 12493 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:40.036617 12624 raft_consensus.cc:2804] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:40.074819 12624 raft_consensus.cc:697] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:40.075048 12630 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:40.075093  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.038278 12492 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.068435 12626 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.079022 12626 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:40.040024 12612 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.070683 12230 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.035773 11854 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.055517  7821 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:40.053279 12317 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:40.057166 12482 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.020s	user 0.008s	sys 0.007s
I20260501 14:00:40.055876  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:50946 (request call id 1325) took 2621 ms. Trace:
I20260501 14:00:40.060544 12489 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:40.036535  7824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2048) took 1788 ms (client timeout 1649 ms). Trace:
W20260501 14:00:40.084147  7824 rpcz_store.cc:269] 0501 14:00:38.247767 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.287700 (+ 39933us) service_pool.cc:224] Handling call
0501 14:00:40.036278 (+1748578us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400260cd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:40.036452 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045376896}
I20260501 14:00:40.083930  7828 rpcz_store.cc:276] 0501 14:00:37.434247 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.434467 (+   220us) service_pool.cc:224] Handling call
0501 14:00:40.055232 (+2620765us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400251054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb2ff6b911e 00007fb2f8c35437 00007fb2f8c353c2 00007fb2f8c352f1 00007fb2f8c3526c 00007fb2f8c34522 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:40.055731 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346804096}
W20260501 14:00:40.065778  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.072140  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:40.055353 12659 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260501 14:00:40.015132 12472 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.074159 12493 raft_consensus.cc:697] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:40.071573 12459 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:40.094386 12493 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.098834 12317 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:40.085031 12524 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.400s	user 0.012s	sys 0.003s
I20260501 14:00:40.073036  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.083038  7749 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.079849 12612 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.027339  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:40.104326  7749 raft_consensus.cc:614] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:40.066326 12620 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.105584  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.099452 12317 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:40.114753  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 87488.1us
I20260501 14:00:40.117079  7819 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:40.121408  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.125077  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:40.113987 12269 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:40.090688 12564 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.119680 12649 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:40.102459 12459 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:40.133080  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 140770us
I20260501 14:00:40.080466 12396 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.136133  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.136579  7679 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:40.144006  7750 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:40.144902  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.137383  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:40.125546 12472 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:40.140365  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.144956  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.148866  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:40.149631  7745 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:40.141115  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:40.141419 12657 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260501 14:00:40.152125  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.152302  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:40.153142  8376 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:40.153198  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.154808  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.155534  7824 raft_consensus.cc:2393] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:40.123484 12634 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:40.142720  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.156312  7752 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:40.145972  7747 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:40.130632 11854 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:40.159447  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.159197  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.158475  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:40.173659  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.160179  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.130295 12269 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.228868  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.161549  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:40.229334  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:40.229509  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:40.230036  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 72479.2us
I20260501 14:00:40.115523 12524 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.089197 12484 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.135998 12564 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.141687 12642 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260501 14:00:40.130837 12508 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:40.075800 12624 consensus_queue.cc:237] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:40.285313  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.319342  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.320210  7750 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:40.231456  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.147008 12472 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.306599  7824 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:40.306389  7819 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:40.306914  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.232702  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.331128  7821 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
W20260501 14:00:40.297359  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.308089  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.332949  7745 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:40.308912  8374 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:40.311228 12580 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.242444 12486 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.310161  7747 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:40.345510  7747 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:00:40.248919  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:40.155678 12602 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:40.321543  7828 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:40.305831  7752 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:40.311061 12269 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:40.160825 12634 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.327836  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.328526  7753 raft_consensus.cc:3060] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
W20260501 14:00:40.312978 12657 log.cc:927] Time spent T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260501 14:00:40.334316  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.318598 12536 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.309511  7754 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260501 14:00:40.300608 12428 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.306978 11854 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.262111 12230 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.338313  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.310029  7822 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:40.370718  7747 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:40.339936  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.377102  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.378691  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:40.380656  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.335150 12612 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.386940  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.341684 12649 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:40.355712 12634 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:40.361755 12524 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:40.356033 12664 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260501 14:00:40.362545 12642 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.363004 12536 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.327142 12409 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:40.335599 12472 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:40.347893  8381 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:40.356376  7819 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:40.355502 12623 consensus_meta.cc:287] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.002s
I20260501 14:00:40.377758 12428 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.369850 11854 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:40.386410 12648 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:40.387687 12567 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:40.355623 12547 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:40.405038 12609 consensus_meta.cc:287] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.037s	user 0.013s	sys 0.002s
I20260501 14:00:40.401754  7753 raft_consensus.cc:2468] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:00:40.403170  7643 leader_election.cc:400] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
I20260501 14:00:40.423538  7643 leader_election.cc:403] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260501 14:00:40.388089 12348 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:40.386361 12608 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:40.409214 12489 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:40.407019  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.353643 12580 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.388790 12649 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.430130 12649 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:40.328029 12459 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.431869 12580 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.389024 12628 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:40.389564 12508 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:40.435380 12628 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:40.435721 12508 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.436656 12628 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.438447 12628 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:40.398420 12632 raft_consensus.cc:2764] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260501 14:00:40.439810 12508 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.396785  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.357702 12486 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:40.442281  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 45579.8us
I20260501 14:00:40.424722  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:40.443192  7792 leader_election.cc:400] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 8 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 8. Current term is 9.
I20260501 14:00:40.443233 12486 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.443737 12632 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:40.409447 12445 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:40.444471 12445 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.445365  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.446561 12445 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.447427  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.448057 12632 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:40.449604  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:40.463053  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.414948 12317 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:40.401049 12541 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260501 14:00:40.481108  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38240 (request call id 2001) took 1450 ms. Trace:
W20260501 14:00:40.481659  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:40.484920  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 60254.3us
I20260501 14:00:40.488613  7677 rpcz_store.cc:276] 0501 14:00:39.030922 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.105400 (+ 74478us) service_pool.cc:224] Handling call
0501 14:00:39.178006 (+ 72606us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:39.549725 (+371719us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:40.480771 (+931046us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54000389d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:40.481016 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819659648}
I20260501 14:00:40.492498  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:40.422084 12620 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.409826 12409 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.423205 12547 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.428746 12608 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:40.471294 12230 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13.
W20260501 14:00:40.494211 12664 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260501 14:00:40.410773 12623 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.405805 12642 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:40.493155 12667 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.136s	user 0.005s	sys 0.001s
I20260501 14:00:40.424028 12609 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.492980 12486 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:40.421893 12648 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.514882  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:40.532569  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:40.533730 12679 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:40.534226 12679 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.534614 12679 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:40.522125  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.511044 12608 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:40.536420  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:40.540247  7673 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:40.506440 12672 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:40.542308  7675 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 17: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:40.545416 12648 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.538230 12512 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260501 14:00:40.550952  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:40.554052  7673 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:40.562834  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.564996  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.536392 12230 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:40.515573 12683 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:40.592674  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:40.517091 12626 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.563594  7673 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:40.596078  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:40.598927  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 48044.2us
I20260501 14:00:40.542136 12567 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:40.597779  7672 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:40.528772 12459 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260501 14:00:40.603682 12445 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:40.609324 12623 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.610678 12498 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:40.610826  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.597255 12230 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.562615 12396 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:40.592690 12667 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260501 14:00:40.613363  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.600039  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:40.565045 12547 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.634410  7673 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:00:40.637145  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:40.637436  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.637930  7747 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:40.638649  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.638933  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:40.639470  7745 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:40.639691  7673 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:40.635782  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.642444  7819 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:40.645596  8381 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:40.647749  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.649042  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.649662  7750 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:40.649868 12672 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:40.650033  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:40.651717 12512 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.651793  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:40.655386  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:40.656034  7819 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:40.659102  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:40.659329  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:40.662667  7671 raft_consensus.cc:2393] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:40.663153  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:40.664762  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:40.664917  8381 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:00:40.612825 12536 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.666909  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:40.624101 12230 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:40.684738  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:40.685935  8379 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:40.686626  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.653885 12459 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:40.689502  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:40.684229 12445 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:40.668066  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:40.692642 12567 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.694360  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 743) took 3770 ms. Trace:
W20260501 14:00:40.694679 12582 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 3.219s	user 0.022s	sys 0.019s
I20260501 14:00:40.695209 12409 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.698153 12269 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.684612 12492 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.716905  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.724400  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:40.718024  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50036.5us
I20260501 14:00:40.718221  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.707048  8372 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:40.727241  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:40.709152  7820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2046) took 2530 ms (client timeout 2261 ms). Trace:
W20260501 14:00:40.729102  7820 rpcz_store.cc:269] 0501 14:00:38.178311 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.249870 (+ 71559us) service_pool.cc:224] Handling call
0501 14:00:40.708974 (+2459104us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400013e54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:40.709078 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164416896}
I20260501 14:00:40.718451  8374 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260501 14:00:40.720685  7672 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:40.667973  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:40.731498  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:40.705639 12673 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260501 14:00:40.729831  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:40.620159 12428 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:40.716017  8375 rpcz_store.cc:276] 0501 14:00:36.924449 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.924745 (+   296us) service_pool.cc:224] Handling call
0501 14:00:36.925106 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:36.926583 (+  1477us) raft_consensus.cc:1534] Early marking committed up to index 10
0501 14:00:39.985657 (+3059074us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b1800383b60. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fe0e4837 00007fb2fa6ebd87 00007fb2fa6fb49f 00007fb2fa6fb418
0501 14:00:40.160431 (+174774us) log.cc:844] Serialized 14 byte log entry
0501 14:00:40.400536 (+240105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:40.411513 (+ 10977us) log.cc:844] Serialized 26 byte log entry
0501 14:00:40.411735 (+   222us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:40.411786 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:40.411914 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:40.693993 (+282079us) raft_consensus.cc:1685] finished
0501 14:00:40.694131 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:40.694291 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3847,"prepare.queue_time_us":1186388,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1813,"raft.queue_time_us":1530,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":19292,"spinlock_wait_cycles":18385664,"thread_start_us":261021,"threads_started":2,"wal-append.queue_time_us":273065}
W20260501 14:00:40.707711 12670 log.cc:927] Time spent T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.311s	user 0.000s	sys 0.002s
I20260501 14:00:40.662077 12623 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:40.743721 12492 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.667086 12648 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:40.698155 12632 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:40.650714 12672 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.779235  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:40.725260 12445 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:40.734468 12683 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:40.733443 12508 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:40.785358  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:40.787837  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45535.9us
I20260501 14:00:40.791325  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:40.746110 12620 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:40.652281 12512 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.734182 12675 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:40.793551 12648 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:40.796041 12486 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:40.798980 11854 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:40.783708 12627 consensus_meta.cc:287] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.099s	user 0.013s	sys 0.000s
I20260501 14:00:40.806464  7670 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 15: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:40.806806  7673 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:40.806450  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:40.800670  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.809374 11854 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.743786 12354 consensus_queue.cc:1059] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260501 14:00:40.812340  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.814110  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.840557  7671 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
I20260501 14:00:40.842001  7819 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:40.842507  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.845000  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.789529 12445 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:40.736469 12674 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:40.854951 11854 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260501 14:00:40.881212 11854 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.881742 11854 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:40.800194 12620 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:40.876509  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.803020 12541 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:40.893738  7820 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 6.
I20260501 14:00:40.898181 11854 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:40.898706  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 713) took 3419 ms. Trace:
I20260501 14:00:40.898777  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:40.899592  7672 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:40.807971 12648 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:40.804020 12683 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:40.760882 12690 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:40.906533  7828 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260501 14:00:40.890621  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 164117us
I20260501 14:00:40.903443  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:40.899313  8380 rpcz_store.cc:276] 0501 14:00:37.479079 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.518258 (+ 39179us) service_pool.cc:224] Handling call
0501 14:00:37.518541 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:37.527238 (+  8697us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:37.752771 (+225533us) log.cc:844] Serialized 14 byte log entry
0501 14:00:40.898026 (+3145255us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b1800410bc0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa2805da
0501 14:00:40.898287 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:40.898353 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:40.898430 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:40.898515 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:40.898643 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":625208,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":434,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6934,"spinlock_wait_cycles":12948224,"thread_start_us":394401,"threads_started":2,"wal-append.queue_time_us":364130,"wal-append.run_cpu_time_us":2858,"wal-append.run_wall_time_us":1394032}
I20260501 14:00:40.840689 12609 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.910116 11854 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.804520 12675 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.917377  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:40.920944  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.805934 12557 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260501 14:00:40.924798  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:40.812520 12627 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.929596  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 2927) took 3969 ms. Trace:
I20260501 14:00:40.902659 12620 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:40.931421  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:40.902024 12606 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:40.934217  7676 rpcz_store.cc:276] 0501 14:00:36.960166 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.986237 (+ 26071us) service_pool.cc:224] Handling call
0501 14:00:37.010867 (+ 24630us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:37.011330 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:37.011357 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:37.019437 (+  8080us) log.cc:844] Serialized 26 byte log entry
0501 14:00:37.264829 (+245392us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:37.302061 (+ 37232us) log.cc:844] Serialized 14 byte log entry
0501 14:00:37.344514 (+ 42453us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:37.344714 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:40.693880 (+3349166us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:40.921515 (+227635us) raft_consensus.cc:1685] finished
0501 14:00:40.929350 (+  7835us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:40.929518 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71029,"prepare.queue_time_us":37004,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":81764,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":31075,"spinlock_wait_cycles":23561600,"thread_start_us":202951,"threads_started":1,"wal-append.queue_time_us":373063}
I20260501 14:00:40.905093 12648 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:40.926819  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:40.830478 12415 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260501 14:00:40.941805  7820 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 17: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:40.912606 12690 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:40.890621 12472 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:40.924108 12675 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:40.933110 12541 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:40.931736 12642 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:40.937558 12632 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:40.955070 12680 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:00:40.938238 12626 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.960029 12686 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:00:40.985109  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.920308 12693 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260501 14:00:40.993021  7826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50954 (request call id 2353) took 1511 ms (client timeout 1528 ms). Trace:
W20260501 14:00:41.013629  7826 rpcz_store.cc:269] 0501 14:00:39.481901 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.576998 (+ 95097us) service_pool.cc:224] Handling call
0501 14:00:40.992785 (+1415787us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400014354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:40.992949 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284945152}
I20260501 14:00:40.957793 12690 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:40.996261 12512 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:40.999722  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2211) took 1613 ms. Trace:
I20260501 14:00:41.020421  7746 rpcz_store.cc:276] 0501 14:00:39.385878 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.386969 (+  1091us) service_pool.cc:224] Handling call
0501 14:00:39.441858 (+ 54889us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:39.442092 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 12
0501 14:00:39.623498 (+181406us) log.cc:844] Serialized 14 byte log entry
0501 14:00:40.999216 (+1375718us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b1800350800. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fa6d9440 00007fb2fa6ebaf6 00007fb2fa6fc667
0501 14:00:40.999336 (+   120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:40.999394 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0501 14:00:40.999444 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:40.999519 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:40.999654 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30576,"raft.queue_time_us":149569,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":10056,"spinlock_wait_cycles":14572800,"thread_start_us":346747,"threads_started":2,"wal-append.queue_time_us":366179}
I20260501 14:00:41.001945 12489 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:41.002828  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.961962 12606 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.006722 12679 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.009086 12472 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:41.012349 12685 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260501 14:00:41.026681 12348 consensus_meta.cc:287] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
W20260501 14:00:41.070530  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:40.978399 12684 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:41.104354  7746 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260501 14:00:41.108752  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:40.984767 12680 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:41.018548 12269 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.123685 12684 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:41.175473 12687 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260501 14:00:41.101227 12348 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:41.103725 12489 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:41.161365 12492 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.159556 12680 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:00:41.191542  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 764) took 1022 ms. Trace:
I20260501 14:00:41.194602  8376 rpcz_store.cc:276] 0501 14:00:40.168949 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:40.244062 (+ 75113us) service_pool.cc:224] Handling call
0501 14:00:40.244577 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:40.396929 (+152352us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:40.396969 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:40.397492 (+   523us) log.cc:844] Serialized 26 byte log entry
0501 14:00:40.597229 (+199737us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:40.597287 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:40.597388 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:41.191308 (+593920us) raft_consensus.cc:1685] finished
0501 14:00:41.191330 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:41.191473 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89786,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15367,"thread_start_us":266275,"threads_started":2,"wal-append.queue_time_us":302268}
I20260501 14:00:41.172762 12684 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.019935 12683 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.202775 12456 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.159418 12697 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:41.162279 12672 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.159191 12512 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260501 14:00:41.219671 12649 consensus_meta.cc:287] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.001s
W20260501 14:00:41.233078 12608 consensus_meta.cc:287] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.001s
I20260501 14:00:41.241307 12649 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:41.245743  7824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.071s	sys 0.132s
W20260501 14:00:41.246354  7824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.072s	sys 0.132s
I20260501 14:00:41.247641  7824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 2068) took 1016 ms. Trace:
W20260501 14:00:41.240767 12568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.689s	user 0.018s	sys 0.053s
I20260501 14:00:41.237135 12627 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:41.244943 12689 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.311s	user 0.000s	sys 0.002s
I20260501 14:00:41.262355 12690 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:41.272647 12636 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 1.852s	user 0.003s	sys 0.000s
W20260501 14:00:41.274642 12602 consensus_meta.cc:287] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.918s	user 0.011s	sys 0.001s
I20260501 14:00:41.275206 12602 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:41.275702  7749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47166 (request call id 78) took 1789 ms. Trace:
I20260501 14:00:41.280125  7749 rpcz_store.cc:276] 0501 14:00:39.486178 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.486349 (+   171us) service_pool.cc:224] Handling call
0501 14:00:41.275374 (+1789025us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400062cd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6dbc33 00007fb2ff6b7cca 00007fb2f8c30934 00007fb2f8c308c2 00007fb2f8c307f1 00007fb2f8c3076c 00007fb2f8c2fa22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.275583 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370541440}
W20260501 14:00:41.250296 12568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.698s	user 0.019s	sys 0.054s
I20260501 14:00:41.232934 12697 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:41.259720 12628 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.005s
I20260501 14:00:41.245947 12608 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:41.297582 12230 consensus_meta.cc:287] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.008s
W20260501 14:00:41.298120 12459 consensus_meta.cc:287] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
W20260501 14:00:41.304903 12634 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.900s	user 0.005s	sys 0.009s
I20260501 14:00:41.263722 12648 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.317864 12406 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:41.318614 12406 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:41.313344 12679 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.333350 12648 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.338351 12574 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.347839 12690 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.348404 12682 raft_consensus.cc:3055] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:41.348839 12682 raft_consensus.cc:740] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:41.313118 12459 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:41.315546 12634 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.334015 12697 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.357950 12608 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.357997 12649 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.358960 12634 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.360852 12586 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.351310 12682 consensus_queue.cc:260] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.334199 12680 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.364487 12682 raft_consensus.cc:3060] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:41.356727 12675 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.368685 12680 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.382185 12675 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:41.423039  7643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.037s	sys 0.079s
W20260501 14:00:41.424224  7643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.037s	sys 0.080s
W20260501 14:00:41.424824  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 577753us
W20260501 14:00:41.444892  7675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 2951) took 1990 ms (client timeout 2167 ms). Trace:
I20260501 14:00:41.445602  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 786) took 3208 ms. Trace:
W20260501 14:00:41.445691  7679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 2003) took 2352 ms (client timeout 2952 ms). Trace:
W20260501 14:00:41.446398  7679 rpcz_store.cc:269] 0501 14:00:39.092718 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.092866 (+   148us) service_pool.cc:224] Handling call
0501 14:00:41.445130 (+2352264us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54002ba2d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.445423 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131470720}
W20260501 14:00:41.445631  7675 rpcz_store.cc:269] 0501 14:00:39.453966 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.583226 (+129260us) service_pool.cc:224] Handling call
0501 14:00:41.444317 (+1861091us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54003606d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.444663 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202814208}
W20260501 14:00:41.449445  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.446302  7678 rpcz_store.cc:276] 0501 14:00:38.236649 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.761860 (+525211us) service_pool.cc:224] Handling call
0501 14:00:38.784647 (+ 22787us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:39.519939 (+735292us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:41.444941 (+1925002us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b540024c054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:41.445396 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689291520}
I20260501 14:00:41.455149  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:41.456528  7748 raft_consensus.cc:606] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:41.457372  7748 raft_consensus.cc:614] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:41.457726  7753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3341) took 2587 ms (client timeout 2167 ms). Trace:
W20260501 14:00:41.458247  7753 rpcz_store.cc:269] 0501 14:00:38.869856 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.872704 (+  2848us) service_pool.cc:224] Handling call
0501 14:00:41.457216 (+2584512us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000af854. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.457463 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3345357184}
I20260501 14:00:41.459192  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260501 14:00:41.476665  7821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.004s
W20260501 14:00:41.477331  7821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.005s
I20260501 14:00:41.477676  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 2050) took 3202 ms. Trace:
W20260501 14:00:41.478617  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 348534us
I20260501 14:00:41.478219  7823 rpcz_store.cc:276] 0501 14:00:38.274893 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.726167 (+451274us) service_pool.cc:224] Handling call
0501 14:00:38.726465 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:38.815176 (+ 88711us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:38.815224 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:38.815276 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:38.815312 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:41.476873 (+2661561us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b54002e9354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:41.476974 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:41.477365 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203502336}
I20260501 14:00:41.484454  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:41.490595  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:41.493875  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.494256  8376 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:41.494210  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:41.494961  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.495715  7753 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:41.496686  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:41.497246  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:41.497555  7825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2052) took 2053 ms (client timeout 1805 ms). Trace:
I20260501 14:00:41.497653  7821 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 6.
W20260501 14:00:41.498027  7825 rpcz_store.cc:269] 0501 14:00:39.444052 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.444219 (+   167us) service_pool.cc:224] Handling call
0501 14:00:41.497031 (+2052812us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b54002ea754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.497272 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10652032}
I20260501 14:00:41.499272  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:41.248245  7824 rpcz_store.cc:276] 0501 14:00:40.231307 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:40.334385 (+103078us) service_pool.cc:224] Handling call
0501 14:00:40.338561 (+  4176us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:40.338905 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:40.498507 (+159602us) log.cc:844] Serialized 14 byte log entry
0501 14:00:41.247138 (+748631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:41.247230 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:41.247296 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:41.247392 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:41.247567 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286214,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":15961,"raft.queue_time_us":1107,"thread_start_us":864707,"threads_started":2}
I20260501 14:00:41.310123 12230 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.509018 12460 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.510190 12460 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.512090  7677 raft_consensus.cc:2368] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11.
I20260501 14:00:41.513612 12230 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.513988 12460 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.514993 12368 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:41.501179  7823 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:41.520136 12584 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:41.539533  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:41.541890  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.549140 12525 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.516260 12377 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.552595 12525 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.552836 12377 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.556324 12708 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.517735  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:41.562891  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.563099 12377 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:41.565491  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:41.566560  8376 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:41.571681  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:41.571990  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.572537  7822 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 6 FOLLOWER]: Advancing to term 7
I20260501 14:00:41.572955  7753 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:41.584010 12634 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:41.584275  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.585212 12634 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.585721  8380 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
W20260501 14:00:41.587263 12624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.008s	sys 0.010s
W20260501 14:00:41.587637  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.588372 12628 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:41.589354 12628 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.580111  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2214) took 1800 ms. Trace:
W20260501 14:00:41.587147 12620 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.626s	user 0.015s	sys 0.002s
I20260501 14:00:41.592756  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.593480 12620 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.594987 12642 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.595799 12642 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.594879 12706 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.592032  7751 rpcz_store.cc:276] 0501 14:00:39.778876 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.779055 (+   179us) service_pool.cc:224] Handling call
0501 14:00:39.779374 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:39.904255 (+124881us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:39.904304 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:39.917171 (+ 12867us) log.cc:844] Serialized 26 byte log entry
0501 14:00:41.456056 (+1538885us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b18002af3a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:41.540685 (+ 84629us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:41.540763 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:41.542314 (+  1551us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:41.577463 (+ 35149us) raft_consensus.cc:1685] finished
0501 14:00:41.577490 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:41.579083 (+  1593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4013,"raft.queue_time_us":126384,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":20690,"spinlock_wait_cycles":14693632,"thread_start_us":208379,"threads_started":2,"wal-append.queue_time_us":1600437}
W20260501 14:00:41.592854 12498 consensus_meta.cc:287] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.981s	user 0.007s	sys 0.009s
I20260501 14:00:41.603773  7671 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:41.604065 12597 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.604524  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:41.606799  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.606961  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:41.557633 12708 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.611845  8380 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:41.587729 12624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.008s	sys 0.010s
I20260501 14:00:41.597468 12706 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.602535 12525 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.588002 12586 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.604859 12597 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.612318 12620 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.628546 12708 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.628937  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:41.629705 12656 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.007s	sys 0.013s
I20260501 14:00:41.630201  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:41.631264  8375 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:41.607007 12584 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.635350 12606 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.638911 12586 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.638598 12584 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.608254 12377 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.641851 12586 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.644021  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 2016) took 1112 ms. Trace:
I20260501 14:00:41.644392  8379 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:41.644505  7677 rpcz_store.cc:276] 0501 14:00:40.532105 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:40.532290 (+   185us) service_pool.cc:224] Handling call
0501 14:00:41.643656 (+1111366us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b540004d3d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.643935 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249676160}
I20260501 14:00:41.646540  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.647231  8373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 751) took 3486 ms. Trace:
I20260501 14:00:41.648963 12408 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:41.647743  8373 rpcz_store.cc:276] 0501 14:00:38.160354 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.160789 (+   435us) service_pool.cc:224] Handling call
0501 14:00:38.176744 (+ 15955us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:38.329975 (+153231us) raft_consensus.cc:1534] Early marking committed up to index 10
0501 14:00:38.352952 (+ 22977us) log.cc:844] Serialized 14 byte log entry
0501 14:00:38.616710 (+263758us) log.cc:844] Serialized 14 byte log entry
0501 14:00:39.983004 (+1366294us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b18003836e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2fe5c33ef 00007fb2f7643bb1 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d
0501 14:00:41.264417 (+1281413us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b18003836e0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fa6d9440 00007fb2fa6ebaf6 00007fb2fa6fc667 00007fb2fa6fc5e8
0501 14:00:41.490562 (+226145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:41.490692 (+   130us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:41.490821 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:41.646699 (+155878us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540039b7d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:41.646771 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:41.646985 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1246501,"prepare.queue_time_us":33687,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":122,"raft.queue_time_us":124765,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":38677,"spinlock_wait_cycles":375659904,"thread_start_us":488826,"threads_started":2,"wal-append.queue_time_us":657257,"wal-append.run_cpu_time_us":3895,"wal-append.run_wall_time_us":1693607}
I20260501 14:00:41.649752 12408 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:41.630244 12656 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.270s	user 0.007s	sys 0.013s
I20260501 14:00:41.663807  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.668507  7751 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:41.641892 12377 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.677326  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.678617  8373 raft_consensus.cc:2410] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260501 14:00:41.674525  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 113941us
I20260501 14:00:41.690783 12134 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:41.692090 12134 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:41.692430  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.692612  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.693415 12134 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.694828 12134 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:41.695384  7823 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260501 14:00:41.687695  7674 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:41.696628  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.699787  8381 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:41.685220 12706 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.678366 12715 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:41.700963 12628 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.703014  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:41.704655  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:41.705204  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:41.705511  7820 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:41.706012  7824 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:41.707122  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:41.707959 12552 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:41.708467 12408 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.709131  7826 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260501 14:00:41.710319 12584 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:41.710579  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:41.715996  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.716049 12265 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.704690  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:41.718295  7821 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:41.718159 12688 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.716730  8373 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:41.718966 12688 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.722937  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.723798  7750 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:41.710768 12584 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:41.734057  7822 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:41.735675  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.717357 12265 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.737414  8380 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:41.737640  7753 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:00:41.729821  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.744762  8376 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 7.
I20260501 14:00:41.748104  7748 raft_consensus.cc:1240] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 16. Current term is 17. Ops: []
I20260501 14:00:41.741636  8375 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:41.759368  7751 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:41.759016  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:41.737496 12584 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:41.736513 12552 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.767740  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.763897  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:41.768312  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.768612  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.769721  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.770624  8376 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:41.769958  8379 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:41.700991 12715 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.775434  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.776917 12715 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:41.778024 12632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.008s	sys 0.018s
W20260501 14:00:41.778460 12632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.019s
I20260501 14:00:41.778056  8380 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:41.778733 12632 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:41.780980  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.808811  8376 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:41.782932 12688 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.783149  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.784257  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:41.785653 12406 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:41.791646 12445 consensus_meta.cc:287] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.890s	user 0.014s	sys 0.009s
I20260501 14:00:41.793043 12377 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.793926 12634 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.787235  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:41.798895  7674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 1997) took 4346 ms (client timeout 2112 ms). Trace:
I20260501 14:00:41.800307  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.801570  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:41.803105  8373 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260501 14:00:41.803395  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 796) took 1061 ms. Trace:
I20260501 14:00:41.780880  7823 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:41.820528  8375 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:41.813392  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.821684  8376 raft_consensus.cc:2410] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260501 14:00:41.819370  7674 rpcz_store.cc:269] 0501 14:00:37.452443 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:37.585488 (+133045us) service_pool.cc:224] Handling call
0501 14:00:41.798587 (+4213099us) spinlock_profiling.cc:243] Waited 3.78 s on lock 0x7b54000c0b54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:41.798780 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8698945920}
I20260501 14:00:41.820428  7671 rpcz_store.cc:276] 0501 14:00:40.741566 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:40.892441 (+150875us) service_pool.cc:224] Handling call
0501 14:00:40.892818 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:41.604404 (+711586us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:41.803119 (+198715us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54003f2d54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:41.803319 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622491904}
I20260501 14:00:41.841703  7820 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:41.841436  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:41.853856  7750 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
W20260501 14:00:41.856222  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 72099.3us
I20260501 14:00:41.856570 12688 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.857185  7792 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:41.857317 12688 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.860134 12649 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:41.861037 12649 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:41.860215 12586 raft_consensus.cc:2804] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:41.865698  8376 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:41.876370  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.844997 12634 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:41.877077  8373 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:41.879264  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:41.870184 12368 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:41.821664 12445 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.869443 12688 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:41.888957  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.890789  7748 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:41.891196  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.892109 12634 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.893862 12632 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.895519 12634 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:41.898123  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:41.898823  8375 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:41.889246 12586 raft_consensus.cc:697] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:41.904335  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.904726  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.905257  8376 raft_consensus.cc:2393] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:41.905165 12586 consensus_queue.cc:237] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:41.905987  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.906189  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.906634  8381 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:41.906734  8376 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:41.904335  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:41.908138  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:41.908165 12368 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.909631  7749 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260501 14:00:41.910408  8376 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:41.913691  8375 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:41.915628  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:41.862560 12649 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:41.923221 12368 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.924057  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:41.916600  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 83421.3us
I20260501 14:00:41.927626  7821 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:41.939522  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:41.941497  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.953619  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:41.958405  7820 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:41.963501  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.964623  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.967062  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.953097 12406 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.969065  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.960829  7750 raft_consensus.cc:2376] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17. Re-sending same reply.
I20260501 14:00:41.973198  7748 raft_consensus.cc:2410] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260501 14:00:41.974211  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:41.965216 12552 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:41.987052 12526 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:41.987486  7751 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:41.987737 12526 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:41.986783  7823 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:41.992213  7749 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:42.006966  8372 raft_consensus.cc:1240] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260501 14:00:42.018831  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.021975  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.027700  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.030495 12405 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:42.030525  7747 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:42.037216  7753 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:42.029093 12445 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:42.041956 12489 consensus_meta.cc:287] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.012s
I20260501 14:00:42.053258  7792 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.052235  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.031591 12584 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.043282 12405 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:42.070927  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.074082  7822 raft_consensus.cc:2410] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260501 14:00:42.072965 12475 raft_consensus.cc:2764] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260501 14:00:42.078734  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:42.079279  7820 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:42.070765 12719 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260501 14:00:42.080811  7819 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:42.075277 12526 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.080824  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.087352  8381 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:42.090062  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:42.095346  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.102602  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.102620  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.106236  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.066270 12489 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.108633  7748 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:42.111840 12482 raft_consensus.cc:2804] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:42.112046 12615 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260501 14:00:42.112066  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.114734  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.115736  7751 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:42.118324 12564 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:42.149161  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:41.778637  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:42.188982  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.097517 12368 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260501 14:00:42.196359  7823 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:42.193279  7821 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:42.193833 12482 raft_consensus.cc:697] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:42.201056  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.201985  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.207921  7819 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:42.209065  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.210177  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.212183  7821 raft_consensus.cc:2393] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:42.211979 12597 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:42.220058  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 472051us
I20260501 14:00:42.250891  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.091928 12405 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.286011  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:42.286253 12576 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 14:00:42.273689  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69382.1us
I20260501 14:00:42.291225  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:42.292273  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.297097 12265 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:42.298403 12613 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:42.301837  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.302626  7748 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:42.302937  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:42.304124 12317 raft_consensus.cc:2764] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260501 14:00:42.305459 12134 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:42.306527 12489 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:42.307291  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:42.214466 12498 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:42.303478  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 91661.8us
I20260501 14:00:42.308605 12498 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.310369  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.311020 12498 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.307052 12564 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:42.313365 12406 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:42.314240 12317 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:42.314077 12406 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.314596  7748 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:42.314775 12317 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:42.315034  7748 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:42.315217 12317 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:42.318236  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.325132  7820 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:42.334214  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:42.293922 12584 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:42.328127  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:42.338201  7749 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:42.308634 12576 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.343664 12576 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:42.344312  7821 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:42.345247 12564 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:42.334090  7748 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.345950 12406 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.346652  7748 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:42.355808 12552 consensus_queue.cc:1059] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:00:42.381356  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:42.383852  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 47405.3us
I20260501 14:00:42.385512 12495 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:42.386127  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:42.399976  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58461.4us
I20260501 14:00:42.337182 12632 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260501 14:00:42.403373  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.415132 12521 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:42.415807 12521 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:42.415884 12642 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.416430 12521 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:42.399319 12634 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:42.286572 12482 consensus_queue.cc:237] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.408166 12632 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:42.404747 12406 raft_consensus.cc:3055] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:00:42.443315  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.426930 12634 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:42.440933 12632 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:42.467499 12584 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.440212 12406 raft_consensus.cc:740] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:42.474462  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.439522 12642 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260501 14:00:42.475556 12473 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:42.485466  7748 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:42.468257 12584 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.497901 12538 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:42.511468 12495 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:42.512734 12642 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.513578 12538 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:42.495289 12489 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260501 14:00:42.532625 12584 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:42.535741  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 238144us
I20260501 14:00:42.527549 12495 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:42.506424 12317 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.533829 12538 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:42.544114  7827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2047) took 4323 ms (client timeout 2762 ms). Trace:
I20260501 14:00:42.553929  7748 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260501 14:00:42.547595  7827 rpcz_store.cc:269] 0501 14:00:38.217959 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:38.588022 (+370063us) service_pool.cc:224] Handling call
0501 14:00:42.536208 (+3948186us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b5400133654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:42.541009 (+  4801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7116643200}
I20260501 14:00:42.566731 12274 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:42.524889 12406 consensus_queue.cc:260] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:42.570269  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 219076us
I20260501 14:00:42.550591 12642 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.539459 12634 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.569747 12609 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.002s
W20260501 14:00:42.624653  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.562157 12615 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260501 14:00:42.671489  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 47389.7us
I20260501 14:00:42.669683 12406 raft_consensus.cc:3060] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:42.695772 12584 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.729038  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:42.720578 12495 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.732836  7746 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:42.737270 12584 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.740123 12584 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:42.740736 12521 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.720993 12634 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
W20260501 14:00:42.752796  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.754719  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.755491  7751 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:42.743618 12521 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:42.774240  8346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:42.780119  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49633.6us
I20260501 14:00:42.764317  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:42.782011  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.787731 12733 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:42.788038 12732 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.788569 12733 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.790920 12733 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:42.779798 12727 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260501 14:00:42.792550  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.787569 12630 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:42.798346 12630 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.801185 12630 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:42.801632 12642 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:42.753877 12597 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:42.804385  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.755837 12615 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260501 14:00:42.793066 12317 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.792881 12489 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:42.788584 12732 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.829995 12732 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.803349 12733 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.835559  7749 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:42.839561  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:42.792608 12584 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.822448 12489 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:42.831338 12632 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:42.854645  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:42.852305  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 409098us
I20260501 14:00:42.859510 12598 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.859956 12584 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.860203 12598 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.862393 12584 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:42.867913  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.868914 12737 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:42.868888  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.869663 12737 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:42.870112 12737 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:42.870075  7754 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:42.845189 12597 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.880033  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:42.881611 12265 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:42.881973  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:42.882261 12265 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.882956 12730 raft_consensus.cc:2764] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260501 14:00:42.884052  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:42.884764 12265 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:42.884995 12523 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:42.850275 12489 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:42.888988  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:42.889653 12523 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:42.890355 12612 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:42.895182 12564 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:42.896034 12564 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:42.875604 12597 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.847563 12732 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:42.901357 12737 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:42.903918 12733 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:42.904553 12426 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:42.904698 12737 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.905025 12426 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:42.906674 12733 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.911203 12363 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:42.912231  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:42.915181  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:42.881963 12613 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:42.919958 12744 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:42.944533  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:42.920610 12699 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:42.922024 12632 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:42.941509 12737 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:00:42.941042  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 179885us
I20260501 14:00:42.951666  7822 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:42.952565  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.947240  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:42.941852 12612 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:42.971171  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:42.939332 12732 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:42.944237 12613 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:42.980688  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:42.983577  7749 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:42.987040  7827 raft_consensus.cc:2393] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:42.992249  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45135.1us
I20260501 14:00:42.985677 12613 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:42.982990 12598 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:42.998685  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:43.003127  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.005110  7747 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:43.005465  7747 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:43.014923  8371 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:42.998211 12538 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.024359  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.025652 12538 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.027961 12509 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:43.028405 12746 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:43.029271 12746 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.039398 12598 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:42.998106 12445 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:43.019004 12489 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.048010  7749 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:43.028429 12509 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:42.994649 12426 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.073138  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.077061 12547 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:43.077813 12547 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.079126  7745 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.082481 12746 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.000135 12744 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.066506  7747 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:43.069976 12731 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260501 14:00:43.077086  7820 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 16: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:43.074000 12509 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:43.086073  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 87513.3us
I20260501 14:00:43.090330  7677 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
W20260501 14:00:43.085302  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 95594.9us
I20260501 14:00:43.091562  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:43.094735  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.095741  7678 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:43.096429 12729 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.527s	user 0.010s	sys 0.005s
I20260501 14:00:43.103076 12732 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.104463  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.105165  7670 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:00:43.105309 12489 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:43.105585  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:43.106703 12482 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:43.107071  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.107214 12482 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.108033 12634 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:43.108791  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.108786 12634 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:43.107031 12744 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.094894 12426 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:43.110601  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.111479  7679 raft_consensus.cc:2393] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.085356 12445 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.112568  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.113382  7679 raft_consensus.cc:2410] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260501 14:00:43.113788 12445 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.114140  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.114564  7827 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 17. Current term is 18. Ops: []
I20260501 14:00:43.115329  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.103386  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.120945  7675 raft_consensus.cc:2393] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 17: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.122422  7673 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:00:43.123618  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.124430  7672 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.124249  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.126999  7678 raft_consensus.cc:3060] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:43.128316  7822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 1073) took 1041 ms. Trace:
I20260501 14:00:43.127578  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.130060  7820 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:43.128782  7822 rpcz_store.cc:276] 0501 14:00:42.086794 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:42.087593 (+   799us) service_pool.cc:224] Handling call
0501 14:00:42.095093 (+  7500us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:42.952876 (+857783us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:43.127962 (+175086us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400250654. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:43.128228 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969324416}
I20260501 14:00:43.132696  7747 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:43.134495  7745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3376) took 1254 ms (client timeout 1549 ms). Trace:
W20260501 14:00:43.135012  7745 rpcz_store.cc:269] 0501 14:00:41.880411 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:41.880585 (+   174us) service_pool.cc:224] Handling call
0501 14:00:43.134216 (+1253631us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540012d4d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:43.134388 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692473728}
I20260501 14:00:43.140127 12495 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:43.140420  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.141104 12552 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:43.141719 12552 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.144654  7819 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260501 14:00:43.144371 12564 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.145839  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.147207 12564 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.147492  7824 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:43.143669 12552 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.148579  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:43.152410  7822 raft_consensus.cc:2393] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.154326  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.155171 12584 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:43.155591 12584 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.155953 12584 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:43.157298  7745 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260501 14:00:43.158502  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.159226  7679 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:43.160113  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.160619  7673 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:43.161274  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.161393  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.161947  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.162539  7673 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:43.161967  7679 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.138724 12547 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.164485 12489 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:43.165316 12489 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.164381  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.166441  7675 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:43.166383 12489 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.164270 12405 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:43.109355 12482 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.168093 12405 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:43.169163 12405 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.170686 12405 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:43.160744  7676 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:43.164289  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.185802  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.186769  7820 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:43.188647  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.189306  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:43.190075  7748 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:43.191275  7672 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:43.189356  7751 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:43.192806  7678 raft_consensus.cc:2468] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:43.193567  7677 raft_consensus.cc:1275] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260501 14:00:43.193830  7823 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:43.195521  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.196619  7828 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:43.196758  7825 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
W20260501 14:00:43.196965  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:43.197665  8371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51744 (request call id 1252) took 6805 ms (client timeout 1524 ms). Trace:
I20260501 14:00:43.197901 12509 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.198633  8377 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:43.203076  7745 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260501 14:00:43.205493  7671 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 15: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.205823  7673 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.208843  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.209597  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.210103  7574 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 15 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:43.190726 12460 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:43.212679  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 109381us
I20260501 14:00:43.215492  7670 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:00:43.223145  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.223604  7825 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:43.208451  8371 rpcz_store.cc:269] 0501 14:00:36.392190 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:36.392776 (+   586us) service_pool.cc:224] Handling call
0501 14:00:43.190774 (+6797998us) spinlock_profiling.cc:243] Waited 6.43 s on lock 0x7b540060d454. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:43.197571 (+  6797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14777978752}
I20260501 14:00:43.224925  7747 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:43.200608  7826 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:43.233508  7821 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:43.238842  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:43.240437  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.236675  7675 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:43.248337  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:43.241312 12475 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260501 14:00:43.263480  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.243779 12630 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:43.223961 12426 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260501 14:00:43.293465  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.259112 12538 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:43.223176 12584 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.298278  7678 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:43.292966 12630 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.309415  7828 pending_rounds.cc:85] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 8
I20260501 14:00:43.313313  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:43.311847  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.306501  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1264) took 4116 ms. Trace:
I20260501 14:00:43.314343  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.261487 12598 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:43.309986  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:43.316344  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.317471  7824 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 13. Ops: []
I20260501 14:00:43.317505  7820 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:43.315882 12630 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:43.313197  7828 pending_rounds.cc:107] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260501 14:00:43.320353  7828 raft_consensus.cc:2889] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:43.321489  7753 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260501 14:00:43.322850  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:43.325517  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.325716  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:43.314877  8377 rpcz_store.cc:276] 0501 14:00:39.182153 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:39.182316 (+   163us) service_pool.cc:224] Handling call
0501 14:00:43.198096 (+4015780us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:43.227622 (+ 29526us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:43.298385 (+ 70763us) spinlock_profiling.cc:243] Waited 3.93 s on lock 0x7b540060d450. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:43.298521 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9032578304}
I20260501 14:00:43.326571  7674 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:43.327658  7747 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:43.330303  7820 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
W20260501 14:00:43.315686  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 102764us
W20260501 14:00:43.335956  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.335706  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.336514  7675 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 15
I20260501 14:00:43.340088  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:43.344092  7827 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:43.344990  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 11, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 11 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:43.346014  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 315) took 11144 ms. Trace:
W20260501 14:00:43.348421  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.260795 12688 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260501 14:00:43.327046 12598 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.352089 12598 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:43.355924  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:43.356299  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.341614 12460 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:43.357362  7820 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:43.356976 12460 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.358533  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:43.364912  7825 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:43.362993  7751 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:43.358553 12649 raft_consensus.cc:2764] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260501 14:00:43.266270 12482 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260501 14:00:43.358528  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:43.332463  7718 connection.cc:254] RPC call timeout handler was delayed by -2.7341236130000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260501 14:00:43.369105  7675 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
W20260501 14:00:43.369325  7718 connection.cc:254] RPC call timeout handler was delayed by -2.7117803170000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2952s for a response
I20260501 14:00:43.370887  7574 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:00:43.369859  7718 connection.cc:254] RPC call timeout handler was delayed by -2.5110803170000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3175s for a response
I20260501 14:00:43.375347  7675 raft_consensus.cc:1275] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260501 14:00:43.377628  7718 connection.cc:254] RPC call timeout handler was delayed by -2.4947236130000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260501 14:00:43.378337  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:43.379359  7718 connection.cc:254] RPC call timeout handler was delayed by -2.3716084039999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260501 14:00:43.379913  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:43.379914  7718 connection.cc:254] RPC call timeout handler was delayed by -2.365123613000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260501 14:00:43.380265  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:43.380520  7718 connection.cc:254] RPC call timeout handler was delayed by -2.3570236130000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260501 14:00:43.380594  8375 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:43.380870  7819 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:43.380887  7718 connection.cc:254] RPC call timeout handler was delayed by -2.2564084039998988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260501 14:00:43.381489  7718 connection.cc:254] RPC call timeout handler was delayed by -1.7192418759999555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260501 14:00:43.375154  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.384796  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.385533  8377 raft_consensus.cc:2368] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 15. Current term is 16.
I20260501 14:00:43.386880  8371 raft_consensus.cc:2410] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260501 14:00:43.389940  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46490us
I20260501 14:00:43.389462  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.391728  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.390585  8379 raft_consensus.cc:2376] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11. Re-sending same reply.
I20260501 14:00:43.389549  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.397680 12584 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.385974 12649 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260501 14:00:43.401101  8372 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:43.401635  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.402163  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.403010  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.412832  8380 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:43.404630  8379 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260501 14:00:43.406303  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.413583  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.402238  8377 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15. Re-sending same reply.
I20260501 14:00:43.407193  7792 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.406339  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.408265  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:43.414283  8371 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:43.413945  7674 raft_consensus.cc:3060] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:43.414857  7678 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.402956  8373 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:43.415746  8381 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:43.416095  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.417279  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.417609  8373 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260501 14:00:43.417827  8381 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:43.403765  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.418609 12732 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:43.419325  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:43.420089  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.420921  8380 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:43.421208  7825 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:43.422569  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:43.417752  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.423385  7675 raft_consensus.cc:2376] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17. Re-sending same reply.
I20260501 14:00:43.424198  7574 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:43.426625  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.428643  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.429231  7751 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:43.429689  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.430151  8380 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.425690 12732 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:43.431350  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.431454 12732 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:43.432129  8372 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:43.432536 12732 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.432834 12613 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.433951  7754 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:43.436064 12613 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.437351  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.437940  8377 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.439154  7574 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:43.441049 12460 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.441143  7674 raft_consensus.cc:2468] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:43.439960  8374 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:43.429865  7792 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.443998  7751 raft_consensus.cc:2468] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:43.420037 12265 raft_consensus.cc:2804] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:43.452596  7792 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.453493  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.413004 12509 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.455281  8371 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:43.458758  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.461295  7819 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
W20260501 14:00:43.463219  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.430233 12688 raft_consensus.cc:2764] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260501 14:00:43.441879  7574 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:43.465178  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.468899  8381 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.454174 12632 raft_consensus.cc:2804] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:43.470929  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.479249  8371 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:43.467314  7574 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 13, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:43.477962  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.481630  8381 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:43.346385  7576 rpcz_store.cc:276] 0501 14:00:32.202679 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:32.204227 (+  1548us) service_pool.cc:224] Handling call
0501 14:00:43.345785 (+11141558us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:35.213320 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:35.384272 (+170952us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:35.389348 (+  5076us) write_op.cc:435] Acquired schema lock
0501 14:00:35.392638 (+  3290us) tablet.cc:662] Decoding operations
0501 14:00:35.528815 (+136177us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:35.528901 (+    86us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:35.528936 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0501 14:00:35.529770 (+   834us) tablet.cc:701] Row locks acquired
0501 14:00:35.529790 (+    20us) write_op.cc:260] PREPARE: finished
0501 14:00:35.529959 (+   169us) write_op.cc:270] Start()
0501 14:00:35.530095 (+   136us) write_op.cc:276] Timestamp: P: 1777644035529900 usec, L: 0
0501 14:00:35.530119 (+    24us) op_driver.cc:348] REPLICATION: starting
0501 14:00:35.530846 (+   727us) log.cc:844] Serialized 3618 byte log entry
0501 14:00:36.196400 (+665554us) op_driver.cc:464] REPLICATION: finished
0501 14:00:37.580447 (+1384047us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18003ad260. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:37.580596 (+   149us) write_op.cc:301] APPLY: starting
0501 14:00:37.580690 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:38.556472 (+975782us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:38.556505 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:38.804571 (+248066us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:38.804934 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0501 14:00:38.805034 (+   100us) write_op.cc:312] APPLY: finished
0501 14:00:38.805463 (+   429us) log.cc:844] Serialized 89 byte log entry
0501 14:00:38.956354 (+150891us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:39.037046 (+ 80692us) write_op.cc:454] Released schema lock
0501 14:00:39.093560 (+ 56514us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:39.270150 (+176590us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:39.274005 (+  3855us) write_op.cc:454] Released schema lock
0501 14:00:41.272064 (+1998059us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
Metrics: {"mutex_wait_us":135651,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":179330,"apply.run_cpu_time_us":23854,"apply.run_wall_time_us":1601043,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":388365,"prepare.run_cpu_time_us":74223,"prepare.run_wall_time_us":501523,"raft.queue_time_us":274369,"raft.run_cpu_time_us":49074,"raft.run_wall_time_us":230922,"replication_time_us":630008,"spinlock_wait_cycles":55359616,"thread_start_us":655322,"threads_started":5,"wal-append.queue_time_us":776617,"wal-append.run_cpu_time_us":106242,"wal-append.run_wall_time_us":4191206}]]}
I20260501 14:00:43.466362 12265 raft_consensus.cc:697] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.495146  8374 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:43.497409  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.469416 12482 raft_consensus.cc:2804] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:43.496387  8374 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:43.502552 12482 raft_consensus.cc:697] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.503659  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.503708 12482 consensus_queue.cc:237] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.507953 12475 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:43.500453 12426 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260501 14:00:43.515115 12426 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:43.517402 12265 consensus_queue.cc:237] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.518174  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.519992  8374 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.469444 12613 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260501 14:00:43.483851 12406 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:43.521292  8374 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:43.488077 12632 raft_consensus.cc:697] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.523161 12632 consensus_queue.cc:237] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.520021 12509 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:43.528426  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:43.530556  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 84911.6us
I20260501 14:00:43.515611 12426 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.533752  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:43.523947 12495 consensus_queue.cc:1175] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca8dd10afb304b4c96cfcec7e2309947" responder_term: 15 status { last_received { term: 15 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260501 14:00:43.545573  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.544231  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:43.546569  8371 raft_consensus.cc:2393] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 7: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:43.533308 12612 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:43.544211 12509 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:43.563326 12538 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:43.573055 12634 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:43.579849  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.523s (SENT)
I20260501 14:00:43.591988  8376 raft_consensus.cc:1240] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:43.592326  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:43.583384 12737 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:43.586783 12612 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:43.583619 12598 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.610165 12649 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:00:43.612537  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 78919.8us
I20260501 14:00:43.609112 12630 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.622643  7826 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:43.620471 12509 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.607532 12426 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.623754 12630 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:43.604395 12737 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:43.591981 12634 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.639834  8374 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260501 14:00:43.642763  8374 pending_rounds.cc:85] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Aborting all ops after (but not including) 10
I20260501 14:00:43.643632  8374 pending_rounds.cc:107] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Aborting uncommitted NO_OP operation due to leader change: 14.11
W20260501 14:00:43.643476  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 63718.8us
I20260501 14:00:43.629129 12426 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:43.645738  7792 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Timed out: RequestConsensusVote RPC to 127.6.77.132:40155 timed out after 1.593s (SENT)
I20260501 14:00:43.648588  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.649318  7749 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:43.644178  8374 raft_consensus.cc:2889] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:43.633550  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:43.671380  7792 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.167s (SENT)
I20260501 14:00:43.625705 12406 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260501 14:00:43.678033  7749 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:43.678113  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.679313  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.620757 12612 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.673897  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.681387  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:43.682152  7825 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:43.683224  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.685082  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:43.687290  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:43.690204  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 83883.4us
I20260501 14:00:43.691731  7819 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:00:43.691640  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.672139 12475 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:43.692852 12597 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260501 14:00:43.689162  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.695577  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.698002  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.690773 12509 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:43.716660 12615 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:43.671417 12737 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.688768 12773 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:43.722013  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.734472  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:43.734763  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:43.693954 12475 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:43.735606 12475 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:43.738732 12615 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.739224 12615 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:43.697490 12495 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:43.740039 12495 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.740454 12495 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:43.744092 12649 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:43.744656 12649 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:43.745136 12649 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:43.746845  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:43.747915 12406 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:43.748314 12406 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:43.748685 12406 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:43.751242  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.752388 12584 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:43.753783 12489 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260501 14:00:43.756668 12489 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:43.757064 12489 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.757930 12489 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:43.759217 12489 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:43.761324  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.762487 12426 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:43.763031 12426 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.763556 12426 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:43.769224  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 70754.6us
I20260501 14:00:43.782774 12597 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:43.789464 12406 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:43.790199  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:43.791631 12482 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:43.728127  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:43.792400 12482 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:43.792974 12482 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:43.793088  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 77329.7us
I20260501 14:00:43.795401  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:43.789486  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:43.699923 12732 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260501 14:00:43.796370 12523 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:43.796931 12732 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:43.797147 12523 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:43.797335 12732 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:43.797823 12732 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:43.797169  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.729099 12538 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:43.729761 12509 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:43.700423 12630 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:43.695708 12632 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260501 14:00:43.732019 12460 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:43.733131 12598 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:43.791771 12406 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:43.808755  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:43.727561 12634 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:43.813529  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.816135  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:43.824018  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:43.825683  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:43.826467  7747 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:43.814841 12509 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:43.814692 12597 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:43.838037 12265 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:43.849939  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50292.2us
I20260501 14:00:43.835673 12630 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:43.799752 12615 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:43.856227  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:43.987468  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.802299 12495 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:43.874282  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:43.990553  7747 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:43.840938 12405 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:43.839702 12406 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260501 14:00:43.977622  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 164549us
W20260501 14:00:44.001214  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 192575us
I20260501 14:00:43.999307  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:44.003636  7718 leader_election.cc:400] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 15. Current term is 16.
I20260501 14:00:44.012719 12495 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:44.005939 12613 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:44.015980 12613 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:44.016398 12613 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:44.018839 12509 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.004297 12523 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260501 14:00:44.022594  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:44.025216  8374 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:43.998557 12405 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:44.009305 12426 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.031975  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:44.040024 12630 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.046696 12482 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.049629 12732 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.050093 12265 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:44.051297 12615 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.053612 12782 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:44.034798 12405 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:44.057313 12613 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.025271 12649 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.067600  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.042574 12426 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:44.063241  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 60584.9us
I20260501 14:00:44.064976 12612 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:44.021158 12475 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.076232  7819 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.081835  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:44.092465  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.093317  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:44.051700 12732 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:44.106086  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:44.101661  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 98275.2us
I20260501 14:00:44.106964  7747 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:44.111982  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 89563.6us
I20260501 14:00:44.097512 12612 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:44.101455 12632 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:44.107908 12613 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.115689  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:44.117166  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:44.106379 12786 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:44.123174 12732 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Leader election won for term 7
I20260501 14:00:44.123765 12482 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.124142  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:44.136651 12732 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:44.125548  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:44.137259 12613 raft_consensus.cc:2764] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260501 14:00:44.137982  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:44.137768 12732 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.138361 12613 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:44.123271  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:44.138911  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:44.137203  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.142791  7747 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:44.143193  7747 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:44.124992 12475 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.144107 12475 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:44.143978  7747 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.144516 12475 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:44.125942 12612 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.144985 12475 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:44.140033  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:44.135986 12509 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:44.140440 12632 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:44.141229  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:44.141656 12406 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:44.146030  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:44.145155  7747 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:44.145332 12613 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:44.156756 12613 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:44.163925 12630 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.163902 12584 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:44.164812 12630 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.167074 12630 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:44.115522 12523 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:44.168040 12523 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:44.155578 12482 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:44.169303 12632 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:44.170401 12632 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.169528 12523 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.176805 12406 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:44.178251 12406 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.180411 12784 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:44.180647  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:44.181036 12784 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:44.181378  7750 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:44.182226  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.182901  7828 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:44.187747  7749 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260501 14:00:44.190901  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 44988.6us
I20260501 14:00:44.197530  7747 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260501 14:00:44.197620  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:44.198421  7747 pending_rounds.cc:85] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 12
I20260501 14:00:44.198967  7747 pending_rounds.cc:107] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260501 14:00:44.199231  7749 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:44.199874  7747 raft_consensus.cc:2889] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260501 14:00:44.201831  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.204929  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.200976  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:44.211432  7823 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260501 14:00:44.213946  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 71390.9us
I20260501 14:00:44.187311 12482 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.194314 12460 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:44.192060 12426 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:44.201406 12649 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.228104  7754 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:00:44.232517  8373 raft_consensus.cc:3060] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:44.235582  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.242571  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:44.243453  8375 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:44.218536 12509 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.254405  8380 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260501 14:00:44.217031 12792 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:44.251513  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:44.248368  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.264282  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:44.207325 12405 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:44.286556  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.280959  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:44.244858 12523 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:44.281701  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:44.294569  7750 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:44.290150  8379 raft_consensus.cc:2393] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:44.297632  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.299523  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.291460  7828 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:44.291460  8375 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:44.292529  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 75643.5us
I20260501 14:00:44.278185  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:44.312028  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.313024  7828 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.315090  8380 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:44.222672 12482 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.315253  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.318974  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.321187  8377 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:44.228402 12426 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.321336 12475 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.322889  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:44.285923 12786 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.307618  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:44.256878 12265 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260501 14:00:44.322230  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:44.331611  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.325994  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.325579  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.325830  7748 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:44.332942  7747 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:00:44.323693  8371 raft_consensus.cc:2368] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 14. Current term is 15.
W20260501 14:00:44.335960  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.332254  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.338471  8373 raft_consensus.cc:1275] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:00:44.234517 12634 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260501 14:00:44.201699 12784 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.339691  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:44.341651  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.342720  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.285961 12737 consensus_queue.cc:1059] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260501 14:00:44.344942  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:44.349547  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:44.351437  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.262256 12509 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:44.324501 12795 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260501 14:00:44.262718 12792 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:44.269116 12796 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.105s
I20260501 14:00:44.260491 12317 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260501 14:00:44.367302  7819 raft_consensus.cc:2368] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:44.365212  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.366869  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.368657  8373 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.364768  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.374550  7753 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.368544  8371 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:44.365868  7823 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260501 14:00:44.370417  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.355687  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.371243  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:44.376278  8375 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:44.323722 12475 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.362661  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.378089  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:44.381820  8373 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260501 14:00:44.382560  8379 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.390479  7752 raft_consensus.cc:2393] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:44.391775  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.395082  7821 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:44.364224 12797 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.323712 12786 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.419312  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.367606 12482 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:44.420560  8377 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:44.342362 12649 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260501 14:00:44.421434  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.377610 12265 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:44.424101 12789 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.372712 12792 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:44.344236 12688 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
W20260501 14:00:44.426729  7643 connection.cc:254] RPC call timeout handler was delayed by -1.374828080000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260501 14:00:44.436334  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:44.438903  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:44.451678  7643 connection.cc:254] RPC call timeout handler was delayed by -1.3127280799999426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260501 14:00:44.444128  7749 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:44.397239 12800 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:44.461546  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:44.444550  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.462380  7674 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.462589  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.460604  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.465639  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.460333  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:44.468521  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:44.439702  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.808s (SENT) [suppressed 35 similar messages]
I20260501 14:00:44.469347  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:44.470741  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.468745 12800 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:44.473870  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.474098  7678 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:44.434971 12406 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.478583  7823 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260501 14:00:44.420343 12460 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260501 14:00:44.480366  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.493590  7671 raft_consensus.cc:2368] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
W20260501 14:00:44.498366  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.496662  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:44.503870  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.509546  7826 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260501 14:00:44.512725  7826 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:44.496519 12615 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.005s
I20260501 14:00:44.488499 12482 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:44.505925  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.449704 12785 consensus_queue.cc:1048] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260501 14:00:44.524701  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 146629us
I20260501 14:00:44.527230  7671 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:44.523286  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.422096 12788 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:44.533362  7823 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260501 14:00:44.528882  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.534646  7675 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 17: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.530021  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.486642 12406 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.540235  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.475555 12789 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.543879  7678 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.520866 12405 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.552030  7821 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:44.525774 12489 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260501 14:00:44.546039 12810 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260501 14:00:44.564231 12788 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.553148  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.474275 12800 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.577565 12509 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:44.578413 12612 raft_consensus.cc:3055] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:44.578814 12612 raft_consensus.cc:740] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:44.571012  7678 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:44.574167  7675 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260501 14:00:44.582456  7819 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:44.436623 12797 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.594668 12797 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:44.559453 12806 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260501 14:00:44.568286 12789 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.598285 12406 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:44.600788  7750 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:44.612287  7678 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:44.614619  7677 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:44.616114 12613 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.617434  7747 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:44.625211  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.626230  7678 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:44.633502  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.580986 12489 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:44.653293  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:44.649029  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 209343us
W20260501 14:00:44.650101  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.650437  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.560725 12786 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:44.655736  7675 raft_consensus.cc:1240] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 17. Current term is 18. Ops: [15.11-17.12]
I20260501 14:00:44.655874  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:44.685899  7678 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:44.686786  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.687515  7673 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:44.688427  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.690938  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.693804  7819 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: [11.13-11.13]
W20260501 14:00:44.694742  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.703774  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.692596  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.707105  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:44.708464  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 211888us
I20260501 14:00:44.708725  7678 raft_consensus.cc:2410] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260501 14:00:44.709733  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.685922 12489 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:44.716123  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:44.720521  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.720805  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.721676  7672 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:44.712283  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.714003  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.580087 12612 consensus_queue.cc:260] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:44.730244  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.759624  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.723861  7677 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.771615  7673 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:44.772716  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.713702 12265 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:44.803845  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 48757.1us
I20260501 14:00:44.808681  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.809976  7673 raft_consensus.cc:2410] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260501 14:00:44.812304  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.759044 12632 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:44.826478  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:44.821810  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.722553 12630 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260501 14:00:44.823192 12265 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:44.833364  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.828786 12495 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:44.834473 12584 consensus_queue.cc:1048] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:44.835270 12317 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:44.721344 12787 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260501 14:00:44.836037  7670 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:44.723714 12785 consensus_queue.cc:1048] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260501 14:00:44.838912  7675 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:44.779740 12613 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.865762  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.869277  7676 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:00:44.867707  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:44.868502  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.823552 12632 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:44.882177  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.883522  7679 raft_consensus.cc:2410] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 13 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260501 14:00:44.877447  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 71876.6us
I20260501 14:00:44.896875  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:44.897679  7747 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:44.900313  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.902616  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:44.908051  7675 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:44.911154  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.875883 12612 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:44.921974  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:44.927719  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:44.929703  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.932212  7749 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:44.897891 12814 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:44.938083  7749 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:44.897704 12632 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:44.935024  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.866544 12495 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.872763 12317 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:44.948393  7748 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260501 14:00:44.954996  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.962415  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.964547  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.969694  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.974646  7825 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.973718  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:44.981053  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:44.983346  7823 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 9: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:44.977214  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:44.958956 12788 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:44.955214 12821 consensus_queue.cc:1059] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260501 14:00:44.998479 12821 consensus_queue.cc:1243] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260501 14:00:44.999085 12821 raft_consensus.cc:3055] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Stepping down as leader of term 17
I20260501 14:00:44.999419 12821 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:45.000373 12821 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.001725 12821 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:00:44.973340 12613 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
W20260501 14:00:45.005335  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 52185.8us
I20260501 14:00:45.007784  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.009416  7676 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:45.021605  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.022637  7673 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:45.022871 12816 log.cc:927] Time spent T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260501 14:00:45.020126  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.032660 12495 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:45.033763 12426 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:45.035897 12523 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.011s
I20260501 14:00:45.017542 12265 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:45.046377  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.047562 12788 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260501 14:00:45.049225  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:45.050071 12824 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260501 14:00:45.051172  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:45.053146  7673 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:45.053561  7673 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:45.054347  7673 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.055298  7673 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:45.050128 12799 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.693s	user 0.005s	sys 0.002s
I20260501 14:00:45.012243 12489 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.061834  7754 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:45.063206  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:45.076339  7826 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:45.026145 12317 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:45.086274  7821 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:45.107120 12829 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:45.107852 12829 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:45.108860 12829 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:45.089012  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:45.098321 12823 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260501 14:00:45.087545  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:45.115692  7747 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:45.107141  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.120065  7676 raft_consensus.cc:2376] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11. Re-sending same reply.
I20260501 14:00:45.061851 12489 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:45.124415  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 61299.3us
W20260501 14:00:45.104866 12792 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.001s
W20260501 14:00:45.126704  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 53115.8us
I20260501 14:00:45.103365 12796 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:45.140538  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:45.133859 12796 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:45.153020 12796 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.154433 12796 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:45.127337 12475 consensus_queue.cc:1059] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260501 14:00:45.151415  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:45.164629 12833 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:45.168074  7821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:45.168707  7821 raft_consensus.cc:606] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:45.169027  7821 raft_consensus.cc:614] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:45.169762  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 472349us
I20260501 14:00:45.172415  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:45.173923  7826 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260501 14:00:45.175552  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:45.166657 12814 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:45.162313 12489 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:45.182914  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:45.184872  7828 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 7.
I20260501 14:00:45.183341  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:45.186009  7748 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:45.165153 12833 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:45.161556 12789 raft_consensus.cc:2764] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260501 14:00:45.134150 12792 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.187759  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:45.191216  7826 raft_consensus.cc:1240] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:45.161903 12615 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260501 14:00:45.184991  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:45.191710  8374 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:45.156905 12405 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260501 14:00:45.197412  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:45.198297  7828 raft_consensus.cc:2410] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260501 14:00:45.192253  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 66906.5us
I20260501 14:00:45.160514 12475 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260501 14:00:45.199292  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:45.200121  8372 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:45.184299 12489 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:45.203398  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:45.205370  7754 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:45.204682  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:45.192395 12523 raft_consensus.cc:2764] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260501 14:00:45.209110  7673 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 13. (term mismatch)
I20260501 14:00:45.209619  8381 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:45.209839  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:45.164640 12831 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260501 14:00:45.211267  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:45.211498  7673 pending_rounds.cc:85] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 12
I20260501 14:00:45.211949  7673 pending_rounds.cc:107] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 11.13
I20260501 14:00:45.212267  7673 raft_consensus.cc:2889] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:45.217717  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:45.228559 12817 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:45.229991 12538 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260501 14:00:45.230439 12538 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:45.230772 12538 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:45.233438  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:45.234992 12821 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:45.236140 12812 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260501 14:00:45.237295  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:45.250737  7820 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:45.253273  7827 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260501 14:00:45.257390  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:45.208468 12489 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:45.258447  8374 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:45.255347  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:45.281601  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46366.9us
I20260501 14:00:45.299347  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:45.302675  7825 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
W20260501 14:00:45.284477  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:45.305529  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2258) took 1006 ms. Trace:
W20260501 14:00:45.302547  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 47322.2us
I20260501 14:00:45.309062  7643 leader_election.cc:400] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 14. Current term is 15.
I20260501 14:00:45.309478  7643 leader_election.cc:403] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260501 14:00:45.205116 12634 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260501 14:00:45.314000  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:45.257584 12523 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260501 14:00:45.375614  8371 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:45.406243  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
W20260501 14:00:45.405406  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58999.3us
W20260501 14:00:45.348773  7792 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.749s (SENT)
I20260501 14:00:45.407676  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:45.345386  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:45.408134  7828 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:45.306142  7751 rpcz_store.cc:276] 0501 14:00:44.298694 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:44.299240 (+   546us) service_pool.cc:224] Handling call
0501 14:00:44.325949 (+ 26709us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:44.326194 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0501 14:00:45.085279 (+759085us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b180013a4a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2fa28885c 00007fb2f7626c0b 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7640a95 00007fb2fe0e4837 00007fb2fa6ebd87 00007fb2fa6fb49f
0501 14:00:45.085455 (+   176us) log.cc:844] Serialized 14 byte log entry
0501 14:00:45.305040 (+219585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:45.305138 (+    98us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:45.305209 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:45.305302 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:45.305450 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22229,"prepare.queue_time_us":64260,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":66,"raft.queue_time_us":42577,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":169791744,"thread_start_us":290093,"threads_started":3,"wal-append.queue_time_us":113493}
I20260501 14:00:45.316536  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:45.410363  8380 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:45.405408  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:45.407030  7746 raft_consensus.cc:606] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:45.412830  7746 raft_consensus.cc:614] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:45.260596 12317 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.405959  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:45.422387  8372 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:45.447997  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:45.216060 12649 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.106s
W20260501 14:00:45.432276  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 84983.7us
I20260501 14:00:45.314373 12825 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:45.310508 12406 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:45.383955 12821 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:45.310669 12265 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.345705 12829 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 14. Current term is 15.
W20260501 14:00:45.486584  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 137845us
W20260501 14:00:45.500195  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:45.502887  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.939s (SENT)
I20260501 14:00:45.304157 12814 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.173s
I20260501 14:00:45.468545 12787 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.299744 12800 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.174s
I20260501 14:00:45.469738 12732 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:45.487426 12406 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:45.509289  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 104020us
I20260501 14:00:45.468863 12812 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.521591  7751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:45.503535  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:45.531769  7751 raft_consensus.cc:606] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:45.532222  7751 raft_consensus.cc:614] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:45.532941  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:45.470252 12317 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.543273  8380 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
W20260501 14:00:45.528749 12850 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.087s	user 0.003s	sys 0.004s
I20260501 14:00:45.550753  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 14:00:45.520126 12792 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:45.480228 12584 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260501 14:00:45.516067 12815 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260501 14:00:45.524506 12732 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:45.310794 12833 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.533223 12406 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:45.563078  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:45.545724 12632 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.000s
I20260501 14:00:45.573952 12632 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.574424 12317 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:45.576103 12632 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:45.569033  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:45.576030 12538 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.578655 12538 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:45.581226 12836 log.cc:927] Time spent T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260501 14:00:45.509032 12842 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260501 14:00:45.516934 12265 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.595671  7828 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
W20260501 14:00:45.567948 12612 consensus_meta.cc:287] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
I20260501 14:00:45.595999  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:45.641381  7826 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 16: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:45.571059 12732 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:45.525369 12787 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.650130  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:45.651837  7751 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
I20260501 14:00:45.654256  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:45.568414 12844 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:45.655737  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:45.636255 12849 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.179s	user 0.002s	sys 0.010s
I20260501 14:00:45.540931 12812 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.682158  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:45.683142  7821 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
I20260501 14:00:45.690335  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:45.698627  7828 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 7 FOLLOWER]: Advancing to term 8
I20260501 14:00:45.641954 12815 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:45.651578 12632 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260501 14:00:45.703673  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
W20260501 14:00:45.711383  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 208546us
I20260501 14:00:45.680899 12833 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:45.714526  7828 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:45.716624  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:45.717147  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:45.727126 12839 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:45.712761 12612 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:45.727918 12839 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:45.656368 12821 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.709949 12815 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.733098 12737 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Leader election won for term 8
W20260501 14:00:45.763985 12838 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.270s	user 0.000s	sys 0.002s
I20260501 14:00:45.764472 12851 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:45.765163 12851 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:45.767650  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 290882us
W20260501 14:00:45.772579  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 136907us
W20260501 14:00:45.792793  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:45.795622  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 76280.1us
I20260501 14:00:45.803848  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.770731 12634 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.831434  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.870254  7673 raft_consensus.cc:2376] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18. Re-sending same reply.
I20260501 14:00:45.796079 12737 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:45.875595  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:45.863998 12809 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.999s	user 0.008s	sys 0.000s
I20260501 14:00:45.824702 12789 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.882094  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.883299  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.884006  7673 raft_consensus.cc:2376] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15. Re-sending same reply.
I20260501 14:00:45.891613  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.900372  7671 raft_consensus.cc:1275] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:45.877779 12475 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:45.766206 12839 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.907204  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.913044  7670 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:45.903626 12615 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.920046 12475 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.889423 12851 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.910768 12812 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:45.926910  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:45.915434  7673 raft_consensus.cc:1275] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260501 14:00:45.919981 12615 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.890969 12265 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:45.889004 12858 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:45.878556 12634 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.902174 12787 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:45.892701 12789 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.948011 12860 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:45.949232 12866 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260501 14:00:45.949985 12845 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:45.950659 12858 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:45.951942 12737 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:45.948086  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.956022 12861 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260501 14:00:45.957144 12612 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:45.961668  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:45.947460  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:45.936337  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:45.970422  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 203013us
I20260501 14:00:45.935189 12797 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260501 14:00:45.977533  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:46.015120  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:46.018090 12634 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:45.977676  7676 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:46.023940 12523 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:46.024515  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:46.024709 12523 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:46.026039 12523 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.027179 12834 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:46.027637 12834 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:45.968657 12845 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:45.978778 12405 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:46.031040  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 94892.4us
I20260501 14:00:46.037238  7821 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:46.045339  7670 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
W20260501 14:00:46.048014  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.710s (SENT)
I20260501 14:00:46.048599  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:46.048923  7671 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260501 14:00:46.051765  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:46.055598  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:45.969252 12475 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:45.968806 12860 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:46.022257 12612 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:45.976328 12825 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:46.070063  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:46.071444  7828 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:46.071545  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:46.074025  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:46.076035  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:46.029733 12845 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:46.078251  7825 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:46.016597 12847 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:46.036880 12815 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:46.030941 12876 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:46.075853 12796 consensus_meta.cc:287] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.921s	user 0.016s	sys 0.001s
I20260501 14:00:46.102535  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:46.107319  7827 raft_consensus.cc:2410] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260501 14:00:46.111255  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:46.116624  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 68672.8us
W20260501 14:00:46.117379  8344 leader_election.cc:336] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.744s (SENT)
I20260501 14:00:46.117839  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:46.120127  8344 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.793s (SENT)
I20260501 14:00:46.120697  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:46.122823  7675 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:46.045878 12405 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.046593 12844 consensus_queue.cc:1059] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260501 14:00:46.110020 12538 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:46.155560  7679 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260501 14:00:46.124894 12634 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:46.132978  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:46.191238  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:46.192111  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:46.192942  7675 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:46.193730  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:46.102210 12825 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.204967  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:46.113750 12876 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.208734 12858 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:46.132733  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:46.177611 12878 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
W20260501 14:00:46.178885 12872 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260501 14:00:46.180419 12870 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260501 14:00:46.129319 12882 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:46.185681 12860 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:46.190338 12832 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:46.219717  7672 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
W20260501 14:00:46.229161  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:46.250129  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:46.213227  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 80577.6us
I20260501 14:00:46.112854 12847 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.336508  7748 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260501 14:00:46.705654  7748 pending_rounds.cc:85] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 8
I20260501 14:00:46.705947  7748 pending_rounds.cc:107] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260501 14:00:46.706197  7748 raft_consensus.cc:2889] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:46.339607  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:46.341085  7820 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260501 14:00:46.340937  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 461623us
I20260501 14:00:46.354466  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:46.443491  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:46.669039  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:46.488679 12831 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:46.357023 12406 consensus_meta.cc:287] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.003s
I20260501 14:00:46.673775  7825 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
W20260501 14:00:46.360126 12732 consensus_meta.cc:287] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.000s
I20260501 14:00:46.439491 12825 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:46.402266  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:46.407577 12789 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:46.147432 12538 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.136482 12834 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:46.436254  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:46.356148 12615 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:46.147183 12867 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:46.146427 12877 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:46.681962  8374 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260501 14:00:46.583310  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:46.685529  7819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 1106) took 1468 ms. Trace:
I20260501 14:00:46.813133  7819 rpcz_store.cc:276] 0501 14:00:45.200650 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.201195 (+   545us) service_pool.cc:224] Handling call
0501 14:00:45.201493 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:45.214692 (+ 13199us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:45.214744 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:45.215510 (+   766us) log.cc:844] Serialized 26 byte log entry
0501 14:00:45.763783 (+548273us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:45.763855 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:45.763946 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:46.668607 (+904661us) raft_consensus.cc:1685] finished
0501 14:00:46.668630 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:46.668814 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26165,"raft.queue_time_us":5931,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4713,"thread_start_us":396279,"threads_started":1,"wal-append.queue_time_us":633942}
W20260501 14:00:46.677862  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.004s
W20260501 14:00:46.815598  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.012s	sys 0.004s
I20260501 14:00:46.713694  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:46.724361  8375 raft_consensus.cc:1240] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260501 14:00:46.724910  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3460) took 1463 ms. Trace:
I20260501 14:00:46.726851  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:46.713557  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:46.703054 12860 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:46.752107  8376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.017s	sys 0.022s
I20260501 14:00:46.758863  7824 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260501 14:00:46.764901  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.016s	sys 0.024s
W20260501 14:00:46.766321 12833 consensus_meta.cc:287] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.051s	user 0.010s	sys 0.014s
I20260501 14:00:46.836684  8377 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:46.788552  7748 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:46.837741  7748 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:46.788564  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:46.789362  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:46.806910  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:46.713085 12824 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:46.818506  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 104899us
I20260501 14:00:46.817080  7754 rpcz_store.cc:276] 0501 14:00:45.261096 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.261247 (+   151us) service_pool.cc:224] Handling call
0501 14:00:45.314398 (+ 53151us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:45.679639 (+365241us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:45.679673 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:45.699060 (+ 19387us) log.cc:844] Serialized 26 byte log entry
0501 14:00:45.878012 (+178952us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:45.878049 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:45.878113 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:45.949919 (+ 71806us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b48000f1a58. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2ff6191a1 00007fb2ff610237 00007fb2ff6100ca 00007fb2ff70792f 00007fb2ff7075f7 00007fb2ff71bc1c 00007fb2ff71bbc8 00007fb2ff71bb48 00007fb2ff71bb03 00007fb2ff71adac 00007fb2fe643b36
0501 14:00:46.710872 (+760953us) raft_consensus.cc:1685] finished
0501 14:00:46.710926 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:46.724836 (+ 13910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53722,"raft.queue_time_us":214397,"raft.run_cpu_time_us":3827,"raft.run_wall_time_us":417534,"spinlock_wait_cycles":5082368,"thread_start_us":448321,"threads_started":2,"wal-append.queue_time_us":292575}
W20260501 14:00:46.825850  8376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.018s	sys 0.023s
W20260501 14:00:46.826094  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.025s
I20260501 14:00:46.743523 12817 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:46.858158  8344 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.897s (SENT)
I20260501 14:00:46.858879  8344 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:46.870826  7748 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.861189  7746 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:46.818077 12482 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:46.941751  7748 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:46.845923 12834 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:46.735405 12831 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.747440 12732 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.749722 12406 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.704288 12832 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:46.872522 12405 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:46.997717  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 139606us
W20260501 14:00:47.128139  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.942s (SENT)
I20260501 14:00:47.128695  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:46.965624 12876 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:46.943332 12821 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:46.957134 12833 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:46.843772 12860 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:47.000381 12612 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.910s	user 0.009s	sys 0.005s
I20260501 14:00:46.855907 12824 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.980149 12475 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:46.996372  8375 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:47.000335 12858 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:47.032158  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 321995us
W20260501 14:00:47.033516  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 306751us
I20260501 14:00:47.002938 12877 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:46.957748 12482 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:47.038497  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 231655us
I20260501 14:00:46.813849 12615 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:47.041821  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:46.996373 12879 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:47.075508 12839 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:46.844869 12867 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:46.889534 12817 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.205665 12855 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:47.206271 12855 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.207453 12817 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:47.208339 12910 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260501 14:00:47.136278 12489 consensus_meta.cc:287] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 1.773s	user 0.026s	sys 0.002s
W20260501 14:00:47.154688  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:47.174147 12880 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.482s	user 0.001s	sys 0.001s
I20260501 14:00:47.136862 12405 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:47.190426  7748 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
W20260501 14:00:47.190963  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:47.137727 12891 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:47.139320 12847 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.203712  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.204372  7821 raft_consensus.cc:1240] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:47.146303 12833 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.204217 12839 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.204977 12615 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.206579 12867 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.140609  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.975s (SENT)
I20260501 14:00:47.257647  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:47.128139 12898 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260501 14:00:47.145849  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:47.175592 12475 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.175069 12877 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:47.234350  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:47.216974 12906 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.473s	user 0.002s	sys 0.000s
I20260501 14:00:47.208369 12900 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:47.158548 12612 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.146044 12821 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.234243  7748 pending_rounds.cc:85] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 9
I20260501 14:00:47.241777  7827 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260501 14:00:47.302548  7748 pending_rounds.cc:107] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260501 14:00:47.250976  7718 connection.cc:254] RPC call timeout handler was delayed by -1.046950769000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260501 14:00:47.236227  7825 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:47.302914  7748 raft_consensus.cc:2889] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:47.234108 12881 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:47.257891  7819 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:47.208009 12914 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260501 14:00:47.193275 12858 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.176889  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:47.244654 12405 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.332613  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.218156 12912 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:47.301802 12817 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:47.290378  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 149823us
W20260501 14:00:47.342908  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.975s (SENT)
I20260501 14:00:47.343482  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:47.209028 12489 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.255275  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.354420  7754 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:47.240173 12885 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:47.263957  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.310529  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.261986 12891 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:47.317096  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 140292us
W20260501 14:00:47.370479  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.979s (SENT)
I20260501 14:00:47.292608 12426 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.230700 12538 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:47.288254 12877 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:00:47.359356  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 160099us
I20260501 14:00:47.337384 12789 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:47.373435  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.340936 12406 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.383344  7792 connection.cc:254] RPC call timeout handler was delayed by -1.3069226140000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260501 14:00:47.383860  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.981s (SENT)
W20260501 14:00:47.384567  7792 connection.cc:254] RPC call timeout handler was delayed by -1.1980226140000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260501 14:00:47.290030 12732 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.353720 12918 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:47.380563 12901 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260501 14:00:47.353421 12831 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.354310 12826 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.369448 12847 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:47.385138  7792 connection.cc:254] RPC call timeout handler was delayed by -1.189922614000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260501 14:00:47.387059  7677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.002s	sys 0.018s
W20260501 14:00:47.393743  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.051s (SENT)
W20260501 14:00:47.416996  7792 connection.cc:254] RPC call timeout handler was delayed by -1.1323226140000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260501 14:00:47.404852  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:47.422827  7677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.002s	sys 0.019s
W20260501 14:00:47.387338 12886 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260501 14:00:47.430514 12875 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.433665  7677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3019) took 1347 ms. Trace:
I20260501 14:00:47.352905 12912 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.456758 12839 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.456980 12489 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:47.394371 12921 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260501 14:00:47.398124 12918 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.458654 12912 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.398294 12789 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260501 14:00:47.460222 12615 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.460711 12864 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 1.537s	user 0.000s	sys 0.010s
I20260501 14:00:47.387521 12817 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:47.461315 12612 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.446696 12913 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:47.395845 12821 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.447190 12907 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260501 14:00:47.448309 12475 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.448467 12919 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.400696 12832 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:47.449424 12905 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260501 14:00:47.449674 12405 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.428499 12847 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.449973 12891 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:47.451370 12845 consensus_meta.cc:287] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 1.348s	user 0.013s	sys 0.003s
W20260501 14:00:47.451587 12926 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260501 14:00:47.438706 12897 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:47.451894 12482 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:47.452564 12649 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:47.452994 12613 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:47.453547 12858 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.420621 12406 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260501 14:00:47.456094  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1323) took 1740 ms. Trace:
I20260501 14:00:47.456447 12861 raft_consensus.cc:3055] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:47.384438 12426 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.456576 12896 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.401680 12860 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.462091  7745 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:47.462268  7823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45436 (request call id 1108) took 1919 ms. Trace:
I20260501 14:00:47.550597  7823 rpcz_store.cc:276] 0501 14:00:45.542759 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.542972 (+   213us) service_pool.cc:224] Handling call
0501 14:00:45.543506 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:45.562187 (+ 18681us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:45.562242 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:45.573367 (+ 11125us) log.cc:844] Serialized 26 byte log entry
0501 14:00:45.749454 (+176087us) raft_consensus.cc:1645] Marking committed up to 12
0501 14:00:45.749501 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:45.749590 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.459929 (+1710339us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:47.461941 (+  2012us) raft_consensus.cc:1685] finished
0501 14:00:47.461966 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.462193 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30378,"raft.queue_time_us":43703,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":46422,"spinlock_wait_cycles":10870656,"thread_start_us":97877,"threads_started":1,"wal-append.queue_time_us":244619}
I20260501 14:00:47.440181  7677 rpcz_store.cc:276] 0501 14:00:46.076324 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.076501 (+   177us) service_pool.cc:224] Handling call
0501 14:00:46.102807 (+ 26306us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:46.108539 (+  5732us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:46.108574 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:46.125308 (+ 16734us) log.cc:844] Serialized 26 byte log entry
0501 14:00:46.345496 (+220188us) raft_consensus.cc:1645] Marking committed up to 7
0501 14:00:46.862117 (+516621us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.423509 (+561392us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.423632 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.423701 (+    69us) raft_consensus.cc:1685] finished
0501 14:00:47.423724 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.423949 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2097,"raft.queue_time_us":274339,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":11094,"thread_start_us":930911,"threads_started":3,"wal-append.queue_time_us":303609}
I20260501 14:00:47.476116  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:47.429023 12824 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.478313  7678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.000s	sys 0.046s
W20260501 14:00:47.555394  7678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.000s	sys 0.046s
I20260501 14:00:47.378492 12885 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.459671 12918 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.462342 12875 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.422784 12732 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260501 14:00:47.561460 12732 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:47.561892 12732 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:47.562774 12875 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.562860 12732 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.564612 12732 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:47.565907  7676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38226 (request call id 3005) took 1697 ms (client timeout 2052 ms). Trace:
W20260501 14:00:47.566359  7676 rpcz_store.cc:269] 0501 14:00:45.868956 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.869099 (+   143us) service_pool.cc:224] Handling call
0501 14:00:47.565666 (+1696567us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54003ffcd4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:47.565837 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217061632}
I20260501 14:00:47.567764 12426 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:47.545879 12861 raft_consensus.cc:740] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:47.569510 12885 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.477756 12913 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.569588 12861 consensus_queue.cc:260] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.571281 12861 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:47.572127 12913 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.488765 12919 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.574690 12919 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.574709 12874 log.cc:927] Time spent T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260501 14:00:47.579787  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42716 (request call id 1139) took 2406 ms. Trace:
I20260501 14:00:47.580193  7747 rpcz_store.cc:276] 0501 14:00:45.173255 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.173483 (+   228us) service_pool.cc:224] Handling call
0501 14:00:45.173887 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:45.184928 (+ 11041us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:45.184980 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:45.185508 (+   528us) log.cc:844] Serialized 26 byte log entry
0501 14:00:45.763299 (+577791us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b1800500f80. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:45.798835 (+ 35536us) raft_consensus.cc:1645] Marking committed up to 12
0501 14:00:45.798889 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:45.798991 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.579389 (+1780398us) raft_consensus.cc:1685] finished
0501 14:00:47.579415 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.579690 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26129,"raft.queue_time_us":16788,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":14793,"spinlock_wait_cycles":18752384,"thread_start_us":35289,"threads_started":1,"wal-append.queue_time_us":2245999}
I20260501 14:00:47.583659 12847 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.585184  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1324) took 1453 ms. Trace:
I20260501 14:00:47.585582  8376 rpcz_store.cc:276] 0501 14:00:46.131358 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.131529 (+   171us) service_pool.cc:224] Handling call
0501 14:00:46.150773 (+ 19244us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:46.844049 (+693276us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:46.844082 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:46.856459 (+ 12377us) log.cc:844] Serialized 52 byte log entry
0501 14:00:47.139012 (+282553us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:47.139085 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.139211 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.584909 (+445698us) raft_consensus.cc:1685] finished
0501 14:00:47.584933 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.585109 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":575376,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":16950,"thread_start_us":834215,"threads_started":2,"wal-append.queue_time_us":379039}
I20260501 14:00:47.555985 12896 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.590307 12896 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.593060 12925 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.593761 12925 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.560273 12833 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.604581  7750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3469) took 1735 ms. Trace:
I20260501 14:00:47.605252  7750 rpcz_store.cc:276] 0501 14:00:45.869008 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.877981 (+  8973us) service_pool.cc:224] Handling call
0501 14:00:45.878322 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:45.921230 (+ 42908us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:45.921294 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:45.921343 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:45.921375 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.604185 (+1682810us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54000aee54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:47.604260 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.604495 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98133888}
I20260501 14:00:47.525365 12845 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.610482 12845 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.434311 12826 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.616850 12826 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.629484 12925 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:47.541764  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 125610us
I20260501 14:00:47.485402 12879 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:47.649780 12879 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:47.536774  8379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.028s	sys 0.040s
I20260501 14:00:47.520828 12405 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:47.654327 12855 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.654557 12405 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.656723 12405 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.545027  8381 rpcz_store.cc:276] 0501 14:00:45.715867 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.715994 (+   127us) service_pool.cc:224] Handling call
0501 14:00:45.732352 (+ 16358us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:45.758424 (+ 26072us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:45.758459 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:45.766669 (+  8210us) log.cc:844] Serialized 52 byte log entry
0501 14:00:46.009715 (+243046us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:46.060353 (+ 50638us) log.cc:844] Serialized 14 byte log entry
0501 14:00:46.060882 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:46.061038 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.455793 (+1394755us) raft_consensus.cc:1685] finished
0501 14:00:47.455844 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.456009 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53968,"prepare.queue_time_us":49980,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":28248,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":16775,"thread_start_us":170856,"threads_started":1,"wal-append.queue_time_us":1166593}
I20260501 14:00:47.530131 12649 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.658895 12649 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.530148 12613 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:47.659940 12613 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.660964 12613 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:47.478832 12843 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260501 14:00:47.517379  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 124345us
I20260501 14:00:47.664469  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:47.632033  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:50946 (request call id 1417) took 1952 ms. Trace:
I20260501 14:00:47.665266  7826 rpcz_store.cc:276] 0501 14:00:45.679716 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:45.681703 (+  1987us) service_pool.cc:224] Handling call
0501 14:00:47.630714 (+1949011us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b58000d3598. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f76066c1 00007fb2f7606a3e 000000000035a3c9 00007fb2ff63e8e0 00007fb2ff707711 00007fb2ff7078d0 00007fb2ff6b9002 00007fb2f8c35437 00007fb2f8c353c2 00007fb2f8c352f1
0501 14:00:47.631907 (+  1193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533184}
W20260501 14:00:47.637043 12888 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.953s	user 0.002s	sys 0.000s
I20260501 14:00:47.644161 12858 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:47.673813 12858 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:47.672685 12877 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:47.674856  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:47.647327 12834 consensus_meta.cc:287] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.005s
I20260501 14:00:47.676796  7751 raft_consensus.cc:1275] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260501 14:00:47.679185  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2276) took 1299 ms. Trace:
I20260501 14:00:47.680083 12821 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.680627 12821 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.683337 12821 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.679649  7751 rpcz_store.cc:276] 0501 14:00:46.379714 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.684382 (+304668us) service_pool.cc:224] Handling call
0501 14:00:46.684742 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:47.677103 (+992361us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.678937 (+  1834us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54000631d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:47.679122 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2280693504}
I20260501 14:00:47.674849 12858 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.685701 12858 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:47.692140  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:45.577517  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 14:00:47.700659  8379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.029s	sys 0.040s
I20260501 14:00:47.713552 12877 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.716923  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3017) took 1678 ms. Trace:
W20260501 14:00:47.718624  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 54249.5us
I20260501 14:00:47.721514  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:47.722697 12824 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:47.723137  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.723291 12824 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:47.723721 12406 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:47.723860 12789 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:47.724493 12824 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.717453  7673 rpcz_store.cc:276] 0501 14:00:46.038630 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.044230 (+  5600us) service_pool.cc:224] Handling call
0501 14:00:46.044743 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:46.067555 (+ 22812us) raft_consensus.cc:1534] Early marking committed up to index 10
0501 14:00:46.155649 (+ 88094us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.599466 (+1443817us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b180024e4a0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f75b7e1a 00007fb300c505c9 00007fb2f74761f0 00007fb2f7640b24 00007fb2f7640a95 00007fb2fe0e4837 00007fb2fa6ebd87 00007fb2fa6fb49f 00007fb2fa6fb418
0501 14:00:47.599725 (+   259us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.716451 (+116726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:47.716579 (+   128us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:47.716646 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.716724 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.716859 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96387,"prepare.queue_time_us":2459581,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":217637,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":20003,"spinlock_wait_cycles":41536256,"thread_start_us":245338,"threads_started":2,"wal-append.queue_time_us":976801}
I20260501 14:00:47.726564 12944 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:47.726977 12944 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:47.727198  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3023) took 1612 ms. Trace:
I20260501 14:00:47.727298 12944 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:47.727944 12909 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:47.727567 12860 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:47.730531  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.730713  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3021) took 1629 ms. Trace:
I20260501 14:00:47.527576  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:47.727612  7678 rpcz_store.cc:276] 0501 14:00:46.115019 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.115198 (+   179us) service_pool.cc:224] Handling call
0501 14:00:46.115521 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:46.668321 (+552800us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:46.668371 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:46.689306 (+ 20935us) log.cc:844] Serialized 26 byte log entry
0501 14:00:47.556001 (+866695us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:47.726591 (+170590us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.726833 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.726913 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.726974 (+    61us) raft_consensus.cc:1685] finished
0501 14:00:47.726986 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.727127 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177003,"prepare.queue_time_us":172688,"raft.queue_time_us":22387,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":11364,"spinlock_wait_cycles":103296,"thread_start_us":1197973,"threads_started":2,"wal-append.queue_time_us":862255}
I20260501 14:00:47.735198  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3018) took 1676 ms. Trace:
I20260501 14:00:47.732251  7674 rpcz_store.cc:276] 0501 14:00:46.101795 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.101933 (+   138us) service_pool.cc:224] Handling call
0501 14:00:46.111992 (+ 10059us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:46.668321 (+556329us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:46.668364 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:46.684436 (+ 16072us) log.cc:844] Serialized 26 byte log entry
0501 14:00:47.126368 (+441932us) raft_consensus.cc:1645] Marking committed up to 11
0501 14:00:47.723206 (+596838us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.730370 (+  7164us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.730452 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.730493 (+    41us) raft_consensus.cc:1685] finished
0501 14:00:47.730505 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.730632 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605292,"prepare.queue_time_us":596850,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":45,"raft.queue_time_us":11663,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8117,"thread_start_us":616251,"threads_started":2,"wal-append.queue_time_us":774192}
W20260501 14:00:47.734194 12785 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.774s	user 0.011s	sys 0.014s
I20260501 14:00:47.741739  7671 rpcz_store.cc:276] 0501 14:00:46.058699 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.058853 (+   154us) service_pool.cc:224] Handling call
0501 14:00:46.078456 (+ 19603us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:46.107785 (+ 29329us) raft_consensus.cc:1534] Early marking committed up to index 9
0501 14:00:46.347699 (+239914us) log.cc:844] Serialized 14 byte log entry
0501 14:00:46.806304 (+458605us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:46.833729 (+ 27425us) log.cc:844] Serialized 26 byte log entry
0501 14:00:46.833962 (+   233us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:47.725562 (+891600us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.729125 (+  3563us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.729220 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.729259 (+    39us) raft_consensus.cc:1685] finished
0501 14:00:47.729274 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.735118 (+  5844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":927331,"prepare.queue_time_us":2386644,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":228502,"raft.run_cpu_time_us":2195,"raft.run_wall_time_us":107551,"thread_start_us":277810,"threads_started":2,"wal-append.queue_time_us":190207}
I20260501 14:00:47.749562  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:47.753060  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.117s (SENT)
I20260501 14:00:47.755270  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:47.763023  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:47.745904 12934 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:00:47.772826  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 296834us
I20260501 14:00:47.774981  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:47.762753 12785 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.805s	user 0.011s	sys 0.014s
I20260501 14:00:47.783934 12939 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260501 14:00:47.758883 12900 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.788609 12900 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:47.790082  7574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 199) took 14677 ms (client timeout 15000 ms). Trace:
I20260501 14:00:47.791267 12900 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.792032 12832 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:47.792837 12832 consensus_queue.cc:1048] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:47.794864 12832 consensus_queue.cc:1048] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:00:47.772065 12406 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:47.798743  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:47.798775  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 752) took 1113 ms. Trace:
W20260501 14:00:47.803777  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48603.6us
I20260501 14:00:47.805028  8372 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 7. Current term is 8. Ops: []
I20260501 14:00:47.805785  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:47.799886  8379 rpcz_store.cc:276] 0501 14:00:46.685498 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.685984 (+   486us) service_pool.cc:224] Handling call
0501 14:00:46.734350 (+ 48366us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:46.734655 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 9
0501 14:00:47.016535 (+281880us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.798259 (+781724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:47.798343 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:47.798411 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.798527 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.798692 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96535,"prepare.queue_time_us":407927,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":9881,"thread_start_us":856213,"threads_started":2,"wal-append.queue_time_us":695593}
I20260501 14:00:47.752791 12792 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:47.795022 12944 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.808564 12495 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:00:47.790548  7574 rpcz_store.cc:269] 0501 14:00:33.152151 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:33.152364 (+   213us) service_pool.cc:224] Handling call
0501 14:00:47.790008 (+14637644us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:43.643063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:43.652612 (+  9549us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:43.652676 (+    64us) write_op.cc:435] Acquired schema lock
0501 14:00:43.652697 (+    21us) tablet.cc:662] Decoding operations
0501 14:00:43.653688 (+   991us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:43.653797 (+   109us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:43.653844 (+    47us) tablet.cc:685] Acquiring locks for 7 operations
0501 14:00:43.654649 (+   805us) tablet.cc:701] Row locks acquired
0501 14:00:43.654666 (+    17us) write_op.cc:260] PREPARE: finished
0501 14:00:43.654860 (+   194us) write_op.cc:270] Start()
0501 14:00:43.654995 (+   135us) write_op.cc:276] Timestamp: P: 1777644043654784 usec, L: 0
0501 14:00:43.655046 (+    51us) op_driver.cc:348] REPLICATION: starting
0501 14:00:43.658438 (+  3392us) log.cc:844] Serialized 2876 byte log entry
0501 14:00:44.144260 (+485822us) op_driver.cc:464] REPLICATION: finished
0501 14:00:44.340983 (+196723us) write_op.cc:301] APPLY: starting
0501 14:00:44.341139 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:44.588902 (+247763us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:44.589076 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:44.835260 (+246184us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:44.835625 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0501 14:00:44.835694 (+    69us) write_op.cc:312] APPLY: finished
0501 14:00:44.836351 (+   657us) log.cc:844] Serialized 73 byte log entry
0501 14:00:44.865803 (+ 29452us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:44.884829 (+ 19026us) write_op.cc:454] Released schema lock
0501 14:00:44.903033 (+ 18204us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:44.954935 (+ 51902us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:44.964647 (+  9712us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":279952,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":144298,"apply.run_cpu_time_us":16932,"apply.run_wall_time_us":626616,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":99965,"prepare.run_cpu_time_us":39929,"prepare.run_wall_time_us":371228,"raft.queue_time_us":100083,"raft.run_cpu_time_us":27094,"raft.run_wall_time_us":66641,"replication_time_us":489014,"thread_start_us":344713,"threads_started":4,"wal-append.queue_time_us":373256,"wal-append.run_cpu_time_us":15960,"wal-append.run_wall_time_us":1865825}]]}
I20260501 14:00:47.817900  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.802173  7576 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 11, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:47.829285  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.830138  7823 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:47.830780  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:47.825278  7576 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 4 to 9, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:47.827278  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:47.808857 12934 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:47.839126  8372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51750 (request call id 794) took 1492 ms. Trace:
I20260501 14:00:47.805166 12800 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:47.841825  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.839689  8372 rpcz_store.cc:276] 0501 14:00:46.346611 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.346805 (+   194us) service_pool.cc:224] Handling call
0501 14:00:46.676768 (+329963us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:47.805469 (+1128701us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.838846 (+ 33377us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54006801d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:47.839045 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592406912}
I20260501 14:00:47.808305 12883 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:47.849293  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:47.815339 12460 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:47.865000  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:47.850857  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 75974.9us
I20260501 14:00:47.832876  7576 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 6 to 7, term changed from 7 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to <none>, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:47.866427  7643 leader_election.cc:400] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 election: Vote denied by peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015) with higher term. Message: Invalid argument: T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10.
I20260501 14:00:47.838310 12649 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:47.855737  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.870577  7826 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 9.
I20260501 14:00:47.870448  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:47.871435  7819 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:47.869381  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:47.814419 12792 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.866963  7576 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:47.853873  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:47.844583 12885 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:47.872345  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:47.879099  8381 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 15: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:47.878480  7576 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:47.863202  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3020) took 1772 ms. Trace:
I20260501 14:00:47.872700  8372 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:47.881502  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.881636  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:47.844440 12817 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:47.875320  7822 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:47.875650  8371 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:00:47.829540 12877 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260501 14:00:47.877884  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:47.873817  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:47.882449  7826 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:47.880198  7576 catalog_manager.cc:5671] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 12 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:47.881529  7670 rpcz_store.cc:276] 0501 14:00:46.090628 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:46.092695 (+  2067us) service_pool.cc:224] Handling call
0501 14:00:46.093095 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:46.093486 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:46.093517 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:46.103537 (+ 10020us) log.cc:844] Serialized 26 byte log entry
0501 14:00:46.422911 (+319374us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:47.862348 (+1439437us) log.cc:844] Serialized 14 byte log entry
0501 14:00:47.862758 (+   410us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:47.862866 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:47.862923 (+    57us) raft_consensus.cc:1685] finished
0501 14:00:47.862943 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:47.863125 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1178277,"prepare.queue_time_us":1172171,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":298,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":20241,"thread_start_us":499348,"threads_started":2,"wal-append.queue_time_us":1230063}
I20260501 14:00:47.905992  8376 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260501 14:00:47.907420  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:47.908246  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:47.903697  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:47.908284 12876 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:47.910086 12876 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:47.910507 12876 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:47.902666 12817 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:47.904762  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:47.913496  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:47.871534 12875 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:47.911686  7576 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 10 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:47.915164  7576 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 11 to 13, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:47.916841 12460 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:47.926851 12919 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:47.929047  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.926587  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:47.930912  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.875394 12482 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:47.933521  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:47.917245  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 50964.4us
I20260501 14:00:47.931820  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:47.848654 12800 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.937234  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:47.942698  7819 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:47.927676 12879 raft_consensus.cc:3055] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:47.935343  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.854705 12832 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260501 14:00:47.904865 12613 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:47.934679  7752 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:47.878527 12632 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260501 14:00:47.947454  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:47.928222 12460 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:47.916323  7576 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:47.960278  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:47.958859  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 431392us
I20260501 14:00:47.913120 12913 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:47.928427 12919 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:47.961552  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:47.924463 12949 log.cc:927] Time spent T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260501 14:00:47.960278  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:47.936897 12817 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:47.963164  7754 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:47.945719 12879 raft_consensus.cc:740] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:47.967610  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.963644  7745 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:47.969954  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.962666  7576 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 14, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:47.958205 12909 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:48.009413 12934 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:48.020028  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 50107us
I20260501 14:00:47.963722 12613 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.988507 12879 consensus_queue.cc:260] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:47.989315 12792 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.933518 12875 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.965886 12913 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:48.032243 12913 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:48.033154 12800 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:47.964546 12831 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:47.974267 12820 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:47.991907 12918 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:00:47.961819 12460 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:48.036917 12817 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:47.905890 12916 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260501 14:00:47.961476 12919 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:48.045884 12875 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:48.022361  8344 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.751s (SENT)
I20260501 14:00:47.975924 12824 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260501 14:00:48.049343  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.868s (SENT)
I20260501 14:00:48.049430 12824 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:48.049887 12824 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:48.049847  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:47.980901  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.024171  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:48.059969  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.060510 12732 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:48.061796  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 81012.8us
I20260501 14:00:48.063336  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.065238  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.027796 12883 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:48.028615 12613 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:48.028975 12825 consensus_queue.cc:1059] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:48.032155 12944 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:47.996363  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:47.997205 12821 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:48.025153  7576 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 10 to 13, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:48.109687  7576 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:48.070334  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.076102  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.109680  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.113591  7824 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:48.117240  7576 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:48.121389  7576 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:48.072697 12934 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:48.059628  7822 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 17.
W20260501 14:00:48.102105  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53464.6us
W20260501 14:00:48.126852  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.883s (SENT)
I20260501 14:00:48.127486  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.102696  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.059005 12919 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:48.106884  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 110623us
I20260501 14:00:48.072535 12732 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:48.125101  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.124533  7576 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 6 to 9, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 9 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:48.101387 12883 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:48.121119 12789 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:48.128182  7827 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:00:48.138217  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.090077  7754 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:48.108614 12317 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:48.141160  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:48.162523  7576 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:48.164973  7576 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 13 to 16, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 16 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:48.142112 12784 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260501 14:00:48.126456 12944 consensus_queue.cc:1059] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260501 14:00:48.167233 12784 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:48.166669  7576 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 8 to 9, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 9 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:48.167644 12784 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:48.168408 12800 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:48.168306  7576 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 10, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:48.168697 12784 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.148624  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:48.169838  8372 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:48.135015  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.175350  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.117915 12875 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:48.169842  7576 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 11, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:48.100378 12406 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260501 14:00:48.155077  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.176877  7823 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.177189  8379 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:48.157496  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.100927 12860 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260501 14:00:48.180783  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:48.190258  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.247s (SENT)
W20260501 14:00:48.191195  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.588s (SENT)
I20260501 14:00:48.192198  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:48.192454  8372 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.167460 12944 raft_consensus.cc:3055] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:48.168952 12800 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:48.100680 12909 consensus_queue.cc:1059] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260501 14:00:48.151736  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.150626  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.157953  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.201047  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.201913  7751 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:48.177357  7576 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:48.203302  7576 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 9 to 13, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 13 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:48.180045  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:48.181296 12732 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:48.181445  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.183799 12892 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:48.184334  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.184600 12891 consensus_queue.cc:1059] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:48.177989 12875 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:48.185518 12817 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:48.152537 12883 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:48.186669  8381 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:48.122915 12908 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:48.191565  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.199048  8373 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:48.232803  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.233654  7746 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:48.207386  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.208952  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.234534  7824 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:48.215297  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:48.226629  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.197932 12944 raft_consensus.cc:740] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:48.205348  7826 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:48.241129  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49946.3us
W20260501 14:00:48.242058  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.002s (SENT)
I20260501 14:00:48.243606  7824 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260501 14:00:48.222482 12934 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:48.222527 12784 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:48.222426 12875 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:48.184368 12921 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260501 14:00:48.269259  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.269771  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.272604  7824 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:48.270989  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:48.246354 12861 consensus_meta.cc:287] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.674s	user 0.014s	sys 0.000s
I20260501 14:00:48.274581  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.278004  7746 raft_consensus.cc:2410] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260501 14:00:48.277865  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.275516  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:48.279563  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 72263.5us
I20260501 14:00:48.280171  7750 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:48.282586  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.253260 12812 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:48.284092 12944 consensus_queue.cc:260] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.286671  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.288215  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.288867  7671 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:48.289947  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.293064 12858 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:48.293520 12858 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:48.294381 12858 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.296614 12891 consensus_queue.cc:1048] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:48.297559 12800 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:48.299490  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.302135  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.302826  7676 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:48.252866 12860 raft_consensus.cc:3055] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:48.303931 12860 raft_consensus.cc:740] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:48.304337  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.304999 12860 consensus_queue.cc:260] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.305785 12876 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.306568 12860 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:48.305655  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.308538  7677 raft_consensus.cc:2393] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 17: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:48.308871 12876 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:48.310516 12879 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:48.316295  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.323412 12892 raft_consensus.cc:3055] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Stepping down as leader of term 7
I20260501 14:00:48.323988 12892 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:48.324909  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.324885 12892 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.325837  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.326630  8373 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:48.240676 12908 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.328048  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.328205  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.328519 12908 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:48.271785 12919 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:48.327729  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.330843 12944 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:48.331898  7672 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260501 14:00:48.332410 12913 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.333799  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.334522  7677 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:48.335469  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.335765  7748 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260501 14:00:48.337581  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.343215  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.346860  7677 raft_consensus.cc:2368] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
I20260501 14:00:48.349496  7670 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:48.350189  7751 raft_consensus.cc:2468] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:48.355190  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.357225 12858 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:48.358506  7671 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:00:48.361371  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.338260 12909 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:48.362865 12896 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:48.363265  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.363530 12896 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.364661  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.365495  7677 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
W20260501 14:00:48.351663  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.366272  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.351140  7674 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.366894  8379 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:48.368274  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.368830  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.369086  7679 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:48.369022 12908 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:48.365669 12896 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:48.352046  7676 raft_consensus.cc:2393] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:48.370205  7678 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:48.372030  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.373353  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.373912  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.373157  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.334940 12913 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:48.375026  7826 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.313148 12460 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.326306 12892 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 7 FOLLOWER]: Advancing to term 8
W20260501 14:00:48.389801  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 305561us
I20260501 14:00:48.390116  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.392302  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.394326  8379 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:48.396302  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.397114  7671 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
W20260501 14:00:48.395860  7718 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.808s (SENT)
I20260501 14:00:48.399201  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.400933  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.401902  7677 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:00:48.408595  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.409348  7670 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:48.421725  8371 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
W20260501 14:00:48.423725  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:48.424338  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.433879  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.446785 12843 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:48.452277  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.452744  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.453177  7677 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.453527  7679 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.454161  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.454448  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.455331  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.384111 12908 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.456207  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.457371  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.458104  7671 raft_consensus.cc:2393] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:48.458141  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:48.458967  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.459277  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:48.459944  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.423655 12824 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:48.460197  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.461387  7674 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:48.455335  7679 raft_consensus.cc:2410] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260501 14:00:48.461889 12824 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:48.462720  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.463095  7676 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:48.461787  7673 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:48.466732  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.467677 12475 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:48.468389 12475 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.471349 12475 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:48.475010 12820 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:48.413676 12861 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:48.478971 12820 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:48.439710 12876 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:48.477798 12896 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:48.489300  7826 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260501 14:00:48.491336  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 55849.9us
I20260501 14:00:48.492147  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.492401  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.492970  7750 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:48.493052  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.499260  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.510344  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.511183  7670 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:48.509545  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:48.512205  7819 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:48.515451  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:48.481081 12460 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:48.523028 12820 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.528277  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.529544  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.527330 12913 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260501 14:00:48.530460  7676 raft_consensus.cc:2393] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:48.532972  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.536273  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.536450  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.537050  7679 raft_consensus.cc:2376] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11. Re-sending same reply.
I20260501 14:00:48.537295  7678 raft_consensus.cc:2393] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:48.539351  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.539568  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.540050 12475 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:48.540272  7678 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:48.540480 12475 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:48.540858 12475 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:48.541388  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.544255  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:48.535526  7704 heartbeater.cc:646] Failed to heartbeat to 127.6.77.190:38503 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.77.190:38503 timed out after 15.000s (SENT)
I20260501 14:00:48.549981  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.550767  7679 raft_consensus.cc:3060] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:48.551052  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.551290 12908 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:48.485059 12876 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.554296 12876 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:48.554800  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.556496 12875 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:48.557216  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.558713 12875 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:48.560541  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.565110  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:48.566179  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 50840.8us
I20260501 14:00:48.471580 12883 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.570214  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.571517  7822 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:48.571720  7824 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:48.512615 12896 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:48.580915  7750 raft_consensus.cc:1240] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:48.582428  8376 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:48.584075  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.588025  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.588346  7822 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260501 14:00:48.588424  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.588707  7750 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:48.590471  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.591801  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.563105  7676 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:48.594625  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:48.597178  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.509481 12861 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.069s
I20260501 14:00:48.609477  8373 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:48.611189  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:48.613695  7821 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:48.629674  8372 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:48.616602  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:48.618752  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.630615  7820 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:48.634284  8372 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260501 14:00:48.617127  7679 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:48.621424  7828 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260501 14:00:48.622138  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.641515  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:48.622748  7819 raft_consensus.cc:2468] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:48.641911  7827 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17. Ops: []
I20260501 14:00:48.643857  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.644740  7747 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:48.649864  7748 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:48.650751  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:48.650916  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:48.651432  8376 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:48.652688  7670 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:48.653012  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:48.654309  7718 leader_election.cc:336] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.952s (SENT)
I20260501 14:00:48.649663  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:48.656903  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 428776us
W20260501 14:00:48.658864  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 152081us
I20260501 14:00:48.655562  8375 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:48.661065  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:48.662117  7825 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:48.657963  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.052s (SENT)
I20260501 14:00:48.666658  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:48.711473  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.748193  7754 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260501 14:00:48.751747  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.752609  7670 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 15: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:48.753597  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.753839  7825 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260501 14:00:48.755180  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.756269  7679 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:48.756139  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.756902  7676 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:48.757697  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.758447  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.759730  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.762660  8373 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:48.764670  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.765486  7827 raft_consensus.cc:1217] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
I20260501 14:00:48.765902  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.766604  7676 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:00:48.767621  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.770071  7747 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:48.773818  7820 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
W20260501 14:00:48.780236  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:48.791124  7676 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:48.791772  7827 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260501 14:00:48.796548  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.798833  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:48.799401  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:48.808740  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:48.765756 12932 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.105s	user 0.000s	sys 0.004s
W20260501 14:00:48.813684  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 159371us
I20260501 14:00:48.815985  8376 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:48.810446  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.813872  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.819257  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:48.820542  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:48.822450  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:48.825886  7674 raft_consensus.cc:2393] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:48.826341  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 168403us
I20260501 14:00:48.836974  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:48.792757 12495 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:48.801062 12824 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:48.838738  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:48.796661 12971 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:48.841606  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:48.805095 12821 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:48.820513 12460 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:48.814019 12875 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:48.847074  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:48.836410 12913 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:48.850483 12405 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260501 14:00:48.850565 12825 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:48.854225 12876 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:48.854408 12879 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:48.840375 12829 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260501 14:00:48.804064 12896 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.853724 12495 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:48.873574 12460 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:48.797689  7750 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:48.906411  7670 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:48.880152 12405 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:49.084525 12969 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.124s	user 0.003s	sys 0.000s
I20260501 14:00:48.884644 12883 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:49.065943  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 205777us
I20260501 14:00:48.883574 12876 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:48.868515 12971 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:49.096534  7678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.007s
W20260501 14:00:49.128156  7678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.006s	sys 0.007s
I20260501 14:00:49.045220  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:48.863668 12821 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:48.979511  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:49.009968  8381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.057s
W20260501 14:00:48.976594 12967 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260501 14:00:48.991642 12944 consensus_meta.cc:287] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.002s
I20260501 14:00:48.886435 12825 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:48.883363 12913 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:49.137758  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 315421us
W20260501 14:00:49.143595  8381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.003s	sys 0.058s
W20260501 14:00:49.158318 12970 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260501 14:00:49.159850 12972 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260501 14:00:49.111920 12405 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:00:49.112828 12843 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:00:49.145273 12860 consensus_meta.cc:287] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.008s
I20260501 14:00:49.177450  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:49.178524  8344 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.971s (SENT)
I20260501 14:00:49.134707 12876 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:49.184753  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 342785us
I20260501 14:00:49.181162  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:49.196792  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:49.186029 12858 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.007s
I20260501 14:00:49.200846  7677 raft_consensus.cc:2410] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260501 14:00:49.206768  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:49.144053 12460 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:49.194121 12969 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260501 14:00:49.209227  7827 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:49.213316  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:49.209961 12883 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:49.207790  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:49.219719  7675 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260501 14:00:49.220245  7675 pending_rounds.cc:85] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:49.220525  7675 pending_rounds.cc:107] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260501 14:00:49.220814  7675 raft_consensus.cc:2889] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:49.221225  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:49.224712 12992 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260501 14:00:49.226878 12892 consensus_meta.cc:287] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.001s
I20260501 14:00:49.227908  7671 raft_consensus.cc:2410] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260501 14:00:49.228631 12821 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:49.229254 12821 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:49.229717 12821 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:49.237434  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:49.232765  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:49.247362  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:49.233619 12821 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:49.288957 12908 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:49.291021 12908 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:49.291124  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:49.292410 12883 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:49.292732  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:49.293915 12976 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260501 14:00:49.295030  8344 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:00:49.295327 12975 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260501 14:00:49.296020 12883 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:49.296695 12883 raft_consensus.cc:2804] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:49.297132 12883 raft_consensus.cc:697] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:49.299271 12883 consensus_queue.cc:237] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.213811 12812 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:49.300511 12812 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.303181 12812 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:49.304126  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:49.307485  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:49.308478  8373 raft_consensus.cc:2368] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11.
I20260501 14:00:49.308996 12913 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:49.310042  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:49.219105 12944 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:49.343313  7745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3485) took 1186 ms. Trace:
W20260501 14:00:49.336470 12475 consensus_meta.cc:287] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.002s
I20260501 14:00:49.212801 12860 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.128s
I20260501 14:00:49.291751 12908 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:49.314687 12892 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election won for term 10
I20260501 14:00:49.247385 12829 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:49.343937  7745 rpcz_store.cc:276] 0501 14:00:48.156836 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.156994 (+   158us) service_pool.cc:224] Handling call
0501 14:00:48.181498 (+ 24504us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:48.181918 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:48.181950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:48.182675 (+   725us) log.cc:844] Serialized 52 byte log entry
0501 14:00:48.390547 (+207872us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:48.390589 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:48.390662 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:49.342953 (+952291us) raft_consensus.cc:1685] finished
0501 14:00:49.342988 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.343223 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1850,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":114,"thread_start_us":207452,"threads_started":1,"wal-append.queue_time_us":469311}
W20260501 14:00:49.345992  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 504407us
W20260501 14:00:49.365342  7828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.010s	sys 0.012s
W20260501 14:00:49.366756  7828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.011s	sys 0.012s
I20260501 14:00:49.342334 12944 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:49.369426  7746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.006s	sys 0.015s
W20260501 14:00:49.369858  7746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.015s
W20260501 14:00:49.365077  7749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.017s
W20260501 14:00:49.370612  7749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.005s	sys 0.017s
W20260501 14:00:49.363284  7819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.005s	sys 0.016s
W20260501 14:00:49.371688  7819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.016s
W20260501 14:00:49.373754  7679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.015s
W20260501 14:00:49.374107  7679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.007s	sys 0.016s
W20260501 14:00:49.370186 12584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.017s	sys 0.011s
W20260501 14:00:49.388119  7826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.004s	sys 0.020s
W20260501 14:00:49.388715  7826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.005s	sys 0.020s
I20260501 14:00:49.351588 12812 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260501 14:00:49.370795 12944 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:49.351979 12475 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.363909 12892 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:49.393385 12984 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260501 14:00:49.389828 12584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.018s	sys 0.011s
I20260501 14:00:49.371503 12829 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:49.383370 12495 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:49.394488 12885 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:49.421139 12885 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:49.421623 12885 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:49.422621 12885 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:49.405489  8379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.025s	sys 0.040s
W20260501 14:00:49.424029  8379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.025s	sys 0.040s
I20260501 14:00:49.424871  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1338) took 1012 ms. Trace:
I20260501 14:00:49.425277  8379 rpcz_store.cc:276] 0501 14:00:48.412913 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.413059 (+   146us) service_pool.cc:224] Handling call
0501 14:00:48.446601 (+ 33542us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:48.446827 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 10
0501 14:00:48.447191 (+   364us) log.cc:844] Serialized 14 byte log entry
0501 14:00:48.831282 (+384091us) log.cc:844] Serialized 14 byte log entry
0501 14:00:49.424417 (+593135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0501 14:00:49.424488 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:49.424543 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.424630 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.424797 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651,"prepare.queue_time_us":10206,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"raft.queue_time_us":19702,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4927,"thread_start_us":965411,"threads_started":2,"wal-append.queue_time_us":604782}
I20260501 14:00:49.419284 12829 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.433115  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:49.433836 12885 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:49.440671  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:49.441977  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:49.443517  7748 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:00:49.457785  7748 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:49.458895  7748 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.460208  7748 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:49.402040 12971 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:49.401798 12825 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:49.476992  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.665s (SENT) [suppressed 31 similar messages]
W20260501 14:00:49.440074 12820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.008s	sys 0.019s
I20260501 14:00:49.502174  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:49.405509 12916 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:49.505136  7754 raft_consensus.cc:2410] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260501 14:00:49.506827  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:49.454453 12861 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260501 14:00:49.512794  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:49.506505 12820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.008s	sys 0.020s
I20260501 14:00:49.518705  8376 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17. Ops: []
W20260501 14:00:49.526072 12983 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260501 14:00:49.579217  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:49.589274 12475 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:49.594486  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 833) took 1144 ms. Trace:
I20260501 14:00:49.520505 12892 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.602053 12460 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:49.595168  7675 rpcz_store.cc:276] 0501 14:00:48.449890 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.451923 (+  2033us) service_pool.cc:224] Handling call
0501 14:00:48.452282 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:00:49.221344 (+769062us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.594035 (+372691us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54000c1054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:49.594383 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763862912}
I20260501 14:00:49.634071  7672 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:49.665271  7678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 850) took 1119 ms. Trace:
I20260501 14:00:49.666095  7678 rpcz_store.cc:276] 0501 14:00:48.545880 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.546672 (+   792us) service_pool.cc:224] Handling call
0501 14:00:48.547019 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:48.547277 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:48.547303 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:48.547884 (+   581us) log.cc:844] Serialized 26 byte log entry
0501 14:00:49.128881 (+580997us) raft_consensus.cc:1645] Marking committed up to 9
0501 14:00:49.641136 (+512255us) log.cc:844] Serialized 14 byte log entry
0501 14:00:49.664672 (+ 23536us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.664856 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:49.664919 (+    63us) raft_consensus.cc:1685] finished
0501 14:00:49.664958 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.665182 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35415,"thread_start_us":1032980,"threads_started":2,"wal-append.queue_time_us":819120}
W20260501 14:00:49.692610  7673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.040s
W20260501 14:00:49.693441  7673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.041s
I20260501 14:00:49.697333 12991 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:49.698053 12991 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.699745  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2290) took 1072 ms. Trace:
I20260501 14:00:49.701988  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38240 (request call id 2062) took 1340 ms. Trace:
I20260501 14:00:49.669190 12784 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:49.709355  7672 rpcz_store.cc:276] 0501 14:00:48.361518 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.361669 (+   151us) service_pool.cc:224] Handling call
0501 14:00:49.701802 (+1340133us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54003f4154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:49.701925 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839825792}
I20260501 14:00:49.708964  7751 rpcz_store.cc:276] 0501 14:00:48.627516 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.627627 (+   111us) service_pool.cc:224] Handling call
0501 14:00:48.627986 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:48.629484 (+  1498us) raft_consensus.cc:1534] Early marking committed up to index 8
0501 14:00:48.689818 (+ 60334us) log.cc:844] Serialized 14 byte log entry
0501 14:00:49.417860 (+728042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:49.418548 (+   688us) log.cc:844] Serialized 26 byte log entry
0501 14:00:49.418716 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:49.418751 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.418828 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:49.699516 (+280688us) raft_consensus.cc:1685] finished
0501 14:00:49.699539 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.699681 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120974,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":162,"raft.queue_time_us":30122,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":46558,"thread_start_us":497262,"threads_started":1,"wal-append.queue_time_us":896550}
I20260501 14:00:49.721158  7826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2426) took 1151 ms. Trace:
I20260501 14:00:49.721804  7826 rpcz_store.cc:276] 0501 14:00:48.569785 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.570000 (+   215us) service_pool.cc:224] Handling call
0501 14:00:48.570430 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:48.570871 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:48.570911 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:48.572995 (+  2084us) log.cc:844] Serialized 26 byte log entry
0501 14:00:49.402457 (+829462us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:49.402500 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.405040 (+  2540us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:49.720852 (+315812us) raft_consensus.cc:1685] finished
0501 14:00:49.720886 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.721073 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1820,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3178,"thread_start_us":829082,"threads_started":1,"wal-append.queue_time_us":1064907}
I20260501 14:00:49.725785 12584 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:49.708037 12987 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:49.700368 12991 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:49.703842 12861 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:49.731532  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:49.732661  7672 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:49.703395 12843 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 14:00:49.730626 12876 consensus_meta.cc:287] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.001s
I20260501 14:00:49.728943 12995 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:49.737001  7673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46596 (request call id 849) took 1191 ms. Trace:
I20260501 14:00:49.735529 12843 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:49.734807 12861 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:49.749476 12843 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:49.751838  7828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 2129) took 1096 ms. Trace:
I20260501 14:00:49.751986 12843 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:49.752280  7828 rpcz_store.cc:276] 0501 14:00:48.654972 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.655100 (+   128us) service_pool.cc:224] Handling call
0501 14:00:48.655443 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:48.667192 (+ 11749us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:48.667227 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:48.672706 (+  5479us) log.cc:844] Serialized 52 byte log entry
0501 14:00:49.368288 (+695582us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:49.401162 (+ 32874us) log.cc:844] Serialized 14 byte log entry
0501 14:00:49.401385 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.401466 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:49.751583 (+350117us) raft_consensus.cc:1685] finished
0501 14:00:49.751607 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.751759 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22566,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":11667,"raft.queue_time_us":25993,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":23276,"thread_start_us":576986,"threads_started":1,"wal-append.queue_time_us":952531}
I20260501 14:00:49.737998  7673 rpcz_store.cc:276] 0501 14:00:48.545559 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.548597 (+  3038us) service_pool.cc:224] Handling call
0501 14:00:48.593430 (+ 44833us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:48.593904 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:48.593948 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:48.608320 (+ 14372us) log.cc:844] Serialized 26 byte log entry
0501 14:00:49.108719 (+500399us) raft_consensus.cc:1645] Marking committed up to 13
0501 14:00:49.693934 (+585215us) log.cc:844] Serialized 14 byte log entry
0501 14:00:49.694445 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:49.694662 (+   217us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:49.694727 (+    65us) raft_consensus.cc:1685] finished
0501 14:00:49.694746 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:49.736749 (+ 42003us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54000c1550. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e0c8d 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:49.736920 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85989,"raft.queue_time_us":867,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":21733,"spinlock_wait_cycles":102213376,"thread_start_us":964807,"threads_started":2,"wal-append.queue_time_us":746785}
I20260501 14:00:49.761650  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:49.762624  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:49.763109  7670 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.030s
W20260501 14:00:49.768239  7670 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.003s	sys 0.030s
I20260501 14:00:49.730020 12584 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:49.769529  7718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.012s	sys 0.018s
W20260501 14:00:49.769963  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.012s	sys 0.018s
W20260501 14:00:49.770459  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 643338us
I20260501 14:00:49.771497  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:49.775328  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:49.783699  7671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 839) took 1332 ms. Trace:
I20260501 14:00:49.784298  7671 rpcz_store.cc:276] 0501 14:00:48.451587 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.458721 (+  7134us) service_pool.cc:224] Handling call
0501 14:00:49.775148 (+1316427us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540024c554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:49.783628 (+  8480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766035200}
I20260501 14:00:49.783742  7678 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260501 14:00:49.786084  7678 pending_rounds.cc:85] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:49.786370  7678 pending_rounds.cc:107] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260501 14:00:49.786681  7678 raft_consensus.cc:2889] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:49.791733  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:49.796257  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:49.796730  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:49.739264 12876 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.735080 12987 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.815384  7673 raft_consensus.cc:1240] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:49.798174 12405 consensus_meta.cc:287] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.000s
I20260501 14:00:49.818457  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:49.783269 12460 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:49.799978 12934 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:49.798744 12824 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260501 14:00:49.817732  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:49.793933 12843 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:49.823729  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:49.755365 12995 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:49.826581  7677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 840) took 1374 ms (client timeout 1751 ms). Trace:
W20260501 14:00:49.835539  7677 rpcz_store.cc:269] 0501 14:00:48.464280 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.527903 (+ 63623us) service_pool.cc:224] Handling call
0501 14:00:49.818343 (+1290440us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540024b154. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:49.826495 (+  8152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543979904}
I20260501 14:00:49.834010 12825 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260501 14:00:49.832156  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 355207us
I20260501 14:00:49.822237 12879 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:49.842226  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:49.825196 12860 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:49.848264  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:49.850363  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:49.852237  7826 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:49.855072  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:49.855862  7828 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
W20260501 14:00:49.857170  7718 connection.cc:254] RPC call timeout handler was delayed by -1.2705777669999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260501 14:00:49.858008  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.545s (SENT)
W20260501 14:00:49.858385  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:49.858420  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:49.859697  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:49.862005  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:49.864845  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:49.865816  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:49.834183 12989 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260501 14:00:49.835218 12843 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:49.837610 12825 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:49.837597 12971 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election won for term 15
W20260501 14:00:49.909883  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51898us
I20260501 14:00:49.869468 12909 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:49.871217 12995 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:49.873068 12876 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:49.874213  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:49.921000  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 46876.8us
I20260501 14:00:49.922919  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:49.884075 12892 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:00:49.845091 12916 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:49.832062 12858 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260501 14:00:49.889742 12987 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:49.892012 12584 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:49.892732 12988 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:49.837741 12475 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260501 14:00:49.832868 12405 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:49.910295 12977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.019s
I20260501 14:00:49.939568  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:49.907482  7826 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:49.909718 12992 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:00:49.910384 12825 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:49.910503 12843 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:49.910622  7718 connection.cc:254] RPC call timeout handler was delayed by -1.0986777669999128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260501 14:00:49.928403 12829 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:49.834877 12460 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:49.941288  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:49.928138 12916 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:49.926678 12800 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260501 14:00:49.946161  7718 connection.cc:254] RPC call timeout handler was delayed by -1.0329777669999203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260501 14:00:49.926545 12885 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:00:49.946506  7679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.040s	sys 0.072s
W20260501 14:00:49.993059  7679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.040s	sys 0.072s
I20260501 14:00:49.928210 12971 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:49.994098  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52884.3us
I20260501 14:00:49.994688 12971 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:49.995230  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:49.939956 12977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.007s	sys 0.019s
W20260501 14:00:49.990797  8344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.025s	sys 0.006s
W20260501 14:00:50.006134  8344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.026s	sys 0.006s
W20260501 14:00:50.006762  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 692364us
I20260501 14:00:49.943725 12584 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260501 14:00:49.993223 12800 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:50.012292 12800 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:50.008906  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:49.947440 12829 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:50.043993  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 182769us
I20260501 14:00:49.940053 12988 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.017678 12495 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:00:50.080003  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:50.042735 12584 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260501 14:00:50.007217 12991 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:00:50.085597 12944 consensus_meta.cc:287] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.005s
W20260501 14:00:50.118341  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 109552us
I20260501 14:00:50.120739  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:50.091195 13008 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.062s	user 0.005s	sys 0.000s
W20260501 14:00:50.085783 12883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.013s	sys 0.018s
W20260501 14:00:50.135941 12883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.014s	sys 0.018s
I20260501 14:00:50.138685 12988 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.142172  7676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3047) took 1387 ms. Trace:
I20260501 14:00:50.142709  7676 rpcz_store.cc:276] 0501 14:00:48.754756 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.817847 (+ 63091us) service_pool.cc:224] Handling call
0501 14:00:48.818197 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:49.173509 (+355312us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:49.173558 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:49.174201 (+   643us) log.cc:844] Serialized 26 byte log entry
0501 14:00:49.831227 (+657026us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b1800401ec0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7626587 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab 00007fb2fa2800c3 00007fb2fa280471 00007fb2fa69cdef
0501 14:00:50.018994 (+187767us) raft_consensus.cc:1645] Marking committed up to 11
0501 14:00:50.019038 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:50.114137 (+ 95099us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540019b754. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:50.114218 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:50.141853 (+ 27635us) raft_consensus.cc:1685] finished
0501 14:00:50.141883 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:50.142066 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8288,"raft.queue_time_us":12489,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":15284,"spinlock_wait_cycles":809749632,"thread_start_us":187558,"threads_started":1,"wal-append.queue_time_us":942180}
I20260501 14:00:50.144865  7679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3046) took 1390 ms. Trace:
I20260501 14:00:50.145339  7679 rpcz_store.cc:276] 0501 14:00:48.754510 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.819311 (+ 64801us) service_pool.cc:224] Handling call
0501 14:00:48.841243 (+ 21932us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:49.374497 (+533254us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:49.374531 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0501 14:00:49.384999 (+ 10468us) log.cc:844] Serialized 52 byte log entry
0501 14:00:49.993568 (+608569us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:50.046715 (+ 53147us) log.cc:844] Serialized 14 byte log entry
0501 14:00:50.077118 (+ 30403us) log.cc:844] Serialized 14 byte log entry
0501 14:00:50.085096 (+  7978us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:50.085203 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:50.144610 (+ 59407us) raft_consensus.cc:1685] finished
0501 14:00:50.144633 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:50.144798 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59997,"prepare.queue_time_us":71051,"prepare.run_cpu_time_us":4028,"prepare.run_wall_time_us":20608,"raft.queue_time_us":31499,"raft.run_cpu_time_us":727,"raft.run_wall_time_us":49474,"thread_start_us":1120972,"threads_started":2,"wal-append.queue_time_us":724145}
W20260501 14:00:50.115864  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 120735us
I20260501 14:00:50.148761  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.150450  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.152110  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.085983 12876 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.109628 12584 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:50.122546 12944 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:50.128963 13014 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260501 14:00:50.103857 12475 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260501 14:00:50.132426 13021 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:50.089154 12879 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:50.104187  7674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3048) took 1349 ms. Trace:
I20260501 14:00:50.086043 13002 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:50.156843  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.107177 12824 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.107688 12990 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.163350 12858 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:50.167239  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 83878.2us
I20260501 14:00:50.189596  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.190264  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:50.170451 13010 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260501 14:00:50.088084 12989 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:50.175688  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 67614.8us
I20260501 14:00:50.091120 12861 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.178375  7674 rpcz_store.cc:276] 0501 14:00:48.755004 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:48.849834 (+ 94830us) service_pool.cc:224] Handling call
0501 14:00:48.866549 (+ 16715us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:48.867041 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:48.867096 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:48.867690 (+   594us) log.cc:844] Serialized 26 byte log entry
0501 14:00:49.398733 (+531043us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b180050bf60. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643a33 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:49.441097 (+ 42364us) raft_consensus.cc:1645] Marking committed up to 11
0501 14:00:49.858638 (+417541us) log.cc:844] Serialized 14 byte log entry
0501 14:00:50.085296 (+226658us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:50.085387 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:50.085432 (+    45us) raft_consensus.cc:1685] finished
0501 14:00:50.102058 (+ 16626us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:50.104071 (+  2013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320,"prepare.queue_time_us":427679,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":93940,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":216,"spinlock_wait_cycles":3551616,"thread_start_us":1117325,"threads_started":3,"wal-append.queue_time_us":783547}
I20260501 14:00:50.198994  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.224993  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.200003  7819 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260501 14:00:50.160656 12584 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:00:50.160907 12995 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260501 14:00:50.161926 12876 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.117271 12829 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.253957  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.237406  7828 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:50.356904  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 204914us
I20260501 14:00:50.357813  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.258426 12460 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.163009 12988 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260501 14:00:50.365152  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 174995us
I20260501 14:00:50.365612  7749 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:50.217379  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:50.367465  7748 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:50.202201  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.369340  7751 raft_consensus.cc:2393] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:50.194264  7671 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:50.257050  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.366446  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.239727 12405 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 19 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.377846 12800 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.378598 12843 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.356027 12784 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:50.277223 13011 log.cc:927] Time spent T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260501 14:00:50.271883 13018 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260501 14:00:50.381569  7718 leader_election.cc:400] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
W20260501 14:00:50.276641 13015 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260501 14:00:50.236722 12475 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:50.305315 12892 raft_consensus.cc:3055] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:50.265113 12909 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.387137  7748 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:50.389791  7718 leader_election.cc:403] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260501 14:00:50.398962 12405 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443) with higher term. Message: Invalid argument: T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
I20260501 14:00:50.399205  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.193653 12858 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.400490 12913 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:00:50.273880 13027 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.401734 13027 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.402339 12858 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.283092 13031 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:50.404228 13031 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.404846 12843 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.327335 12825 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.406911  7825 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:50.267876 13028 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:50.236166 12883 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:50.408411 12909 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.410746 12909 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.237079 13021 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.412273 12876 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.413249  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3051) took 1657 ms. Trace:
I20260501 14:00:50.413681  7675 rpcz_store.cc:276] 0501 14:00:48.755669 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:49.627757 (+872088us) service_pool.cc:224] Handling call
0501 14:00:49.628303 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:49.632447 (+  4144us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:49.633517 (+  1070us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:49.639151 (+  5634us) log.cc:844] Serialized 26 byte log entry
0501 14:00:50.078664 (+439513us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:50.078730 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:50.078836 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:50.412997 (+334161us) raft_consensus.cc:1685] finished
0501 14:00:50.413026 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:50.413177 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2474,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2467,"thread_start_us":403652,"threads_started":1,"wal-append.queue_time_us":426174}
I20260501 14:00:50.414888 12800 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:50.252255 12989 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.383644 13037 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.417364 13037 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.418380 12989 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.256894 13007 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:50.321792 13029 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.395459 12475 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.420425 12475 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:50.420236 13029 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.272123 13026 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.424141 12829 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:50.423739 13026 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.425758 12825 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.393345 12784 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.426477 12825 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:00:50.192814 12824 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.428032  7752 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:50.189353 13002 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.394191  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:50.429445 12824 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.431160  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.323278 12944 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.282651 12861 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.322296 12879 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.193864 12990 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.363904 13000 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:50.407055 13031 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:50.447355  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:50.416783  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.431547  7670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38226 (request call id 3049) took 1676 ms. Trace:
I20260501 14:00:50.451002  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.454267  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.453372  7670 rpcz_store.cc:276] 0501 14:00:48.755220 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:49.135506 (+380286us) service_pool.cc:224] Handling call
0501 14:00:49.136028 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:49.136546 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 9
0501 14:00:49.768746 (+632200us) log.cc:844] Serialized 14 byte log entry
0501 14:00:50.020572 (+251826us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:50.091378 (+ 70806us) log.cc:844] Serialized 26 byte log entry
0501 14:00:50.091553 (+   175us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:50.093646 (+  2093us) log.cc:844] Serialized 14 byte log entry
0501 14:00:50.104591 (+ 10945us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:50.104802 (+   211us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:50.143568 (+ 38766us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b18004c9cc0. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb3004aa251 00007fb3004b6ab1 00007fb2f7643b62 00007fb2f7645e01 00007fb2f7645db9 00007fb2f7645d49 00007fb2f7645d11 00007fb2f764500d 0000000000379254 0000000000379099 00007fb2f7626fba
0501 14:00:50.431316 (+287748us) raft_consensus.cc:1685] finished
0501 14:00:50.431342 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:50.431486 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69751,"prepare.queue_time_us":732088,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":5771,"raft.queue_time_us":32204,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":55425,"spinlock_wait_cycles":44580608,"thread_start_us":774333,"threads_started":2,"wal-append.queue_time_us":344405}
I20260501 14:00:50.381959 13034 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:50.380936 13032 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.443516 13037 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.460114  7751 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:50.433748 13027 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:50.431437 13002 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.451733 13000 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:50.440286 12885 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:50.397029 12892 raft_consensus.cc:740] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:50.436488 13029 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.432053 13036 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:50.461597 12820 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:50.471916 13039 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:50.472584  8379 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:50.473112  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.498245  8381 raft_consensus.cc:2410] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260501 14:00:50.434764 13005 consensus_queue.cc:1059] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260501 14:00:50.419593 13007 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.530541 12944 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.531153 12944 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.461849 13034 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.534335  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:50.535566  7671 raft_consensus.cc:2410] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260501 14:00:50.475226 13026 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.476133 13000 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:50.482827 13033 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260501 14:00:50.456024 12995 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:50.468592  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.471284  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:50.489740  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:50.491413  7752 raft_consensus.cc:1240] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:50.470010  8344 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:50.493189  8371 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:00:50.495141  7748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:50.496393  7750 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:00:50.556324  7748 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.496950  7751 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:50.556923  7748 raft_consensus.cc:614] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:50.557206  7751 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:50.500366  8373 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:50.501536  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:50.503293  7746 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260501 14:00:50.504899  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.560990  7754 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:50.510949  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.562285  7747 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
W20260501 14:00:50.511670  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:50.512120 12784 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.514139  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.519989 13036 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:50.468413 13040 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:50.527976 12829 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.528936 13005 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.529713 12971 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.529968 12990 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.474256  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.537402  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:50.566385  7747 raft_consensus.cc:1240] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
W20260501 14:00:50.582062  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 112125us
I20260501 14:00:50.569281  7745 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
W20260501 14:00:50.569645  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 101137us
W20260501 14:00:50.570873  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 99664.2us
I20260501 14:00:50.592432  7792 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.592793  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.577049 13034 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:50.578473 12584 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.580163  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:50.596972  7674 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 13: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:50.580020 13036 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:50.601722  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 61482.2us
I20260501 14:00:50.580809  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:50.582391  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.584288  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.585243  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:50.595353  7675 raft_consensus.cc:2393] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:50.594144  7751 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.609748  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:50.611505  7751 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:50.554190 12824 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.612219  8380 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 10: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:50.569000 12995 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.541167 13007 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:50.603025  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.613188  8373 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:50.613665  8379 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:50.588337 13031 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.616290  8377 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:50.610291  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.621052  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.622210  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.647320  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:50.654124  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:50.634764 12995 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:50.541914 12475 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.658135  7819 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:50.657668  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.661697  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.594095 13039 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:50.594274 12829 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.609609 13034 raft_consensus.cc:2804] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:50.669492  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:50.674573  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.670145  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.602255 12992 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.673844  7751 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260501 14:00:50.634117  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.679883  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.680101  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.680644  7822 raft_consensus.cc:2410] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260501 14:00:50.678582  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "962840f0434049bbb395d330e010962d"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:50.681559  7746 raft_consensus.cc:606] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.681188  7820 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:50.681963  7746 raft_consensus.cc:614] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:50.633598 12879 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:50.633643 12934 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.686143  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:50.620313 13042 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:50.666368 13002 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:50.701228  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:50.702955  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:50.703397 12916 consensus_meta.cc:287] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.002s
I20260501 14:00:50.703809 12843 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:50.704229 13034 raft_consensus.cc:697] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:50.704358 12989 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.597466 12971 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.707937  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.678639 12861 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:50.711172  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.650574 12495 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260501 14:00:50.695799 12993 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260501 14:00:50.633451 12824 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.597051 13005 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.697122 13026 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:50.699229 12883 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:50.706192 12934 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:50.722127  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 85561us
I20260501 14:00:50.752936 12934 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.675153 12860 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260501 14:00:50.754745 13000 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
I20260501 14:00:50.708967 13002 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.695591 12405 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260501 14:00:50.712852 12843 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:50.718004 12825 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:50.712121 13042 raft_consensus.cc:697] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:50.675956 12858 consensus_queue.cc:1059] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260501 14:00:50.700634 13025 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260501 14:00:50.718266 13040 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.766767  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.798931  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:50.800693  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:50.790390 13044 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260501 14:00:50.693127 12992 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.718176 13030 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260501 14:00:50.724094 12861 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.740523 13021 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.870330 12861 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:50.874166 12934 raft_consensus.cc:3055] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:50.874788 12934 raft_consensus.cc:740] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:50.709331 12987 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260501 14:00:50.877094 12987 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:50.877516 12987 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:50.877776 12995 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.784613  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.882555  7826 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:50.883543  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:50.884871  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:50.786801  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 91103.4us
I20260501 14:00:50.763273 13026 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:50.797622  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.775432 13002 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:50.770054  8379 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:50.897579  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.805121  7823 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 19: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:50.804865  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:50.744633 12879 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260501 14:00:50.779615 12843 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:50.716988 12916 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.808393  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.804822 12820 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:50.815696 12992 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.808739 13027 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:50.782383 12825 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.725531 12989 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.927145 12995 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.927508 13021 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:50.927980 13021 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:50.928375  7821 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:50.928732 12989 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.789992 12990 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.928877 13021 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.929591 12990 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.930354 13021 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:50.931560 12990 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.932119 12990 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.932525 12990 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.774432 13029 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.028s
I20260501 14:00:50.934120 13029 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:50.934482 13029 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:50.829911  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:50.832685 12829 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.797807 12584 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:50.803078 12876 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:50.937975 12876 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.840096  8375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:50.939786  8375 raft_consensus.cc:606] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:50.940267  8375 raft_consensus.cc:614] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:50.841001 12883 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:50.841961 12475 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.842780  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:50.941424 12883 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.942505 13029 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.845800 13005 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.807272 13040 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.848882 12824 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.818985 13034 consensus_queue.cc:237] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.945370 13029 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:50.853807 12971 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:50.795251 12944 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.862003 13039 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260501 14:00:50.864166 13045 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260501 14:00:50.867481 12892 consensus_queue.cc:260] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.878509 12934 consensus_queue.cc:260] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.878459 12987 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.784124  7820 raft_consensus.cc:1240] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260501 14:00:50.893616  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:50.894632  7749 pending_rounds.cc:85] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 12
I20260501 14:00:50.975694  7749 pending_rounds.cc:107] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260501 14:00:50.976145  7749 raft_consensus.cc:2889] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:50.894857  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:50.895294  7752 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:50.898938  8374 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:50.911238  7746 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:50.911461  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:50.911849  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:50.980355  7823 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:50.884615 12909 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.981535 12909 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.893570 13026 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:50.988050 12944 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:50.988834 12944 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.991452 12944 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:50.916215  7819 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:50.907619 12858 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:50.997920 12858 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:50.919704 12820 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.001746 12820 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:50.926355 12825 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:50.935711  7821 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:50.941985  7754 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:50.843042 13042 consensus_queue.cc:237] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:50.952044  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:51.013463  7747 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:51.013998  7747 raft_consensus.cc:614] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:50.911883  8380 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:50.915637 12916 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:51.021657  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.027920  7747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:51.028795  7747 raft_consensus.cc:606] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:51.029261  7747 raft_consensus.cc:614] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:51.031302 12858 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.034696  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 14:00:51.037413  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:51.039016  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:50.984230 12909 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.052778 12820 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:51.053725 12820 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:51.070628  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 241770us
I20260501 14:00:51.075800  7746 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:50.963079 13039 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:51.083114  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 285931us
I20260501 14:00:51.085923  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:51.090168  7746 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 19: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.089998  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:51.086863  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:51.091964  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:51.094547  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.097878  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:51.098394  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 444305us
I20260501 14:00:51.101027  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.101827  7671 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:51.102499  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:51.103633  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.104761  7671 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.100000  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.071157 12892 raft_consensus.cc:3060] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:51.107643  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.109516  7676 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:51.098163 12987 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:51.106446  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.111438  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.112290  7678 raft_consensus.cc:2393] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:51.111469  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.087781 13007 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:51.115140  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.093284 13039 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:51.089267 12988 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:51.097401 12475 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:51.128049  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.129221  7677 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:51.131526  7675 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 8.
I20260501 14:00:51.104206 12992 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:51.103967 12934 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:51.140197  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:51.130497 12405 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:51.148070  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.106098 12879 consensus_queue.cc:1059] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260501 14:00:51.149834  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.151492  7675 raft_consensus.cc:2376] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14. Re-sending same reply.
I20260501 14:00:51.124724 12876 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:51.116025 13040 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:51.133630 12475 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:51.155268  7677 raft_consensus.cc:2376] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11. Re-sending same reply.
I20260501 14:00:51.158592  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:51.159201  8374 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:00:51.160176  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.136511 12992 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:51.201222 12971 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:51.232743  8374 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:51.130440 13027 consensus_queue.cc:1059] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260501 14:00:51.241701  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 133243us
I20260501 14:00:51.135172 12995 consensus_queue.cc:1059] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260501 14:00:51.141652 12800 consensus_queue.cc:1059] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.091s
I20260501 14:00:51.151237 12405 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:51.275486  7718 leader_election.cc:400] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11.
I20260501 14:00:51.287602  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.137008 12988 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:51.289425  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 64260.3us
W20260501 14:00:51.290264  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 134155us
I20260501 14:00:51.289661  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.300242  7677 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:51.263849 13057 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260501 14:00:51.297297  7675 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:51.296989  7718 leader_election.cc:403] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260501 14:00:51.300927  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:51.160176 12475 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.308969  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:51.221246 12992 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:51.312054 12995 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11.
I20260501 14:00:51.313517 12995 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:51.316859  8344 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:51.302166 12405 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:51.232266 12971 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.296676 12820 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.336583  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.337778  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:00:51.342625 13061 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260501 14:00:51.343443 13000 raft_consensus.cc:3055] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:51.344732 13007 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:51.345623 12913 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:51.303427 12883 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:51.393343  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 55646.1us
I20260501 14:00:51.321841 12885 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:51.353319 13002 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.269467 12879 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260501 14:00:51.360517  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.336583  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.307528 12990 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.378583  7677 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:51.387250  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.299141 12876 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260501 14:00:51.325135 12460 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.324844 12909 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:51.400044  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 72892.3us
I20260501 14:00:51.394882  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.402834  7675 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:51.445842 12824 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:51.446559 12824 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.449764 12824 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.452037 12971 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:51.409387 13063 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260501 14:00:51.459259 12909 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.461576 12909 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.321924 13026 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.463577 13026 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.464540  7674 raft_consensus.cc:2368] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12.
I20260501 14:00:51.393353 12913 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:51.466845 12843 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260501 14:00:51.467140 12988 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.467347 12843 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.468343 12475 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:51.469262  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.469761 12843 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.470330 12475 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.470551  7748 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:51.394791 13007 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:00:51.472325 12861 consensus_meta.cc:287] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.001s
I20260501 14:00:51.472728 12861 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.473733  7752 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:51.366194 12800 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260501 14:00:51.480964  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.481590  7675 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 18 FOLLOWER]: Advancing to term 19
W20260501 14:00:51.486145  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 175538us
I20260501 14:00:51.486328  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.385905 13000 raft_consensus.cc:740] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:51.487726  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:51.463317 12825 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.419389 12820 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:51.500663 13000 consensus_queue.cc:260] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.496063 12879 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:51.504609  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.499419 12992 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.516275  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.552824  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.523741  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.526491  7747 raft_consensus.cc:1240] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:51.527211  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.530081  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:51.532824  7750 raft_consensus.cc:1240] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:51.560850  8372 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:51.560927 13002 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.561846  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.562398  7750 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260501 14:00:51.562526  7824 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:51.563390  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.564174  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.564458  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.565304  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.565482  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.565806 12913 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.566510  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.542672  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.551420  7751 raft_consensus.cc:1240] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:51.552019  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.552002  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:51.521245 13021 consensus_meta.cc:287] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.001s
I20260501 14:00:51.555591 13035 raft_consensus.cc:3055] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:51.556625 13000 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:51.579653  7747 raft_consensus.cc:2393] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:51.558866 13029 consensus_meta.cc:287] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.006s
I20260501 14:00:51.566761  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.586030  7746 raft_consensus.cc:2393] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.565869  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.586860  7677 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.572695  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.588178  7748 raft_consensus.cc:2393] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.575963  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.567318 12913 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:51.554244  7822 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:51.569447  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.591019  7673 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:51.577298  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:51.578030  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.594131  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.596122  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:51.581113  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.581212  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:51.582134  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:51.531894 12820 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:51.584002  7750 raft_consensus.cc:2393] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.584201  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.584259  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:51.587329  7821 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260501 14:00:51.580111  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:51.539453  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.600404  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:51.624341  8376 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:51.626123  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.626830  7674 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:51.626946  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:51.619544  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:51.628094  8375 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 10.
I20260501 14:00:51.626979  7751 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 19: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.630263  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.630501  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:51.631158  7679 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.632697 12992 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.633697 12858 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:51.635732  8373 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 12
I20260501 14:00:51.636905 12825 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.637813 12824 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:51.641276  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:51.644199  7825 raft_consensus.cc:1240] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260501 14:00:51.507548 13007 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.585036 13035 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:51.650355  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.652856  7677 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:51.653942  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.500s (SENT)
I20260501 14:00:51.654513  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:51.619552 12861 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.626523 12820 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:51.663266  7678 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:51.658773  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:51.508455 13069 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:51.585839 13039 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.667742  7675 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19.
I20260501 14:00:51.646284 12584 raft_consensus.cc:3055] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:51.670243  7825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 2138) took 1071 ms. Trace:
I20260501 14:00:51.690089  7825 rpcz_store.cc:276] 0501 14:00:50.599244 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:50.599433 (+   189us) service_pool.cc:224] Handling call
0501 14:00:50.628713 (+ 29280us) raft_consensus.cc:1471] Updating replica for 2 ops
0501 14:00:51.644717 (+1016004us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:51.669966 (+ 25249us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400134054. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:51.670179 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334438784}
I20260501 14:00:51.695676  8381 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:51.677320  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:51.569586 13059 raft_consensus.cc:3055] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:51.660540  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.685135  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.702069  7678 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:51.688292  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:51.687245  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.687672  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:51.703999  7750 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:51.690425  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.676033  7679 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:51.705248  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.597766  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:51.700031 13026 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:51.662355 12843 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:51.708405  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.656885 13021 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:51.712486  7754 raft_consensus.cc:2393] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:51.722970  7746 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:51.723253 13021 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.724702  7674 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:51.689225 13058 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:51.736814  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.727917  7673 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:51.728400 12460 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:51.729719  8373 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:51.668430 12892 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:51.735178 13035 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.741163 12892 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.743072 12892 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.744664 13007 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:51.701529 12584 raft_consensus.cc:740] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:51.707156 12990 raft_consensus.cc:2764] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260501 14:00:51.751603  7671 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:51.737215  7746 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:51.747208  8372 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:51.747581  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.719133 12825 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:51.749191  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.701002 13059 raft_consensus.cc:740] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:51.753261  7821 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 19: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:51.739744  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.748284  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.754621  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:51.726153 13021 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:51.764755  7828 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:51.760172  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:51.767230  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.768074  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:51.768690  7828 raft_consensus.cc:3060] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.767987  7825 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:51.765640  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:51.703152  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:51.737181 13058 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:51.701182 13069 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.753196 12909 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:51.714298 12824 consensus_queue.cc:1059] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260501 14:00:51.778465  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75436.8us
I20260501 14:00:51.745985 12584 consensus_queue.cc:260] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.735553 13037 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260501 14:00:51.797967  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:51.756585 12825 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:51.736542 12934 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260501 14:00:51.781003 12988 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Stepping down as leader of term 15
W20260501 14:00:51.806681  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.522s (SENT)
I20260501 14:00:51.777631 13021 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:51.781018 13058 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:51.772394 13039 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.812165  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:51.807245  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:51.809871  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 415734us
I20260501 14:00:51.804579 12825 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.808566 13026 raft_consensus.cc:3055] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:51.828945  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:51.831212  7825 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:51.806807 12988 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:51.833578  7828 raft_consensus.cc:2468] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:51.789673 12909 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.804157 12405 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.829830 13026 raft_consensus.cc:740] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:51.804435 13059 consensus_queue.cc:260] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.866228 13069 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:51.866106 13026 consensus_queue.cc:260] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.868244 13026 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.884294 12584 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:51.880836 13059 raft_consensus.cc:3060] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:51.872450 12988 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:51.913480 12988 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:51.925447 13078 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260501 14:00:51.877842 13035 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:51.937947 13058 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:51.941614 13058 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:51.983182  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.989472  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:51.996467  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:51.999195  7749 raft_consensus.cc:2393] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:52.003172  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.003206  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.008903  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.010305  7751 raft_consensus.cc:2468] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:52.015738  7822 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
W20260501 14:00:52.016023  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 209254us
I20260501 14:00:52.020826  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.024196  7821 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:52.025117  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.028687  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.029865  7819 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:52.037735  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.039590 12800 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:52.040696  7718 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.044576 12990 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:52.044873 12987 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:52.046061 12909 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.045825 12990 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.048307 12883 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:52.049511 12883 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.050782 12990 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.037755 12876 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:52.052536 12876 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.055377 12876 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:52.038466 12405 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.056855 12995 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.061847 13039 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:52.064500  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.059530 13058 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:00:52.070762  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.072844  7822 raft_consensus.cc:2393] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:52.071712 12995 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.081970  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.082306 12995 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.083050  7749 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:52.084456  7747 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
I20260501 14:00:52.088542 12883 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:52.100378  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.101594  7822 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:52.103276  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.108610 12883 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:52.109040 12883 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:52.109485 12883 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:52.141276  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.071786 13039 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:52.152688  7820 raft_consensus.cc:2410] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260501 14:00:52.153115  7822 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
W20260501 14:00:52.160398  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53537.8us
W20260501 14:00:52.166218  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.166529  7754 raft_consensus.cc:1240] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:52.169083  7750 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:52.167177 12820 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.172206  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:52.172868 13000 consensus_meta.cc:287] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.010s
I20260501 14:00:52.172816 12820 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:52.176272  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:52.177523  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 147054us
I20260501 14:00:52.180636  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:52.182356  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:52.178756  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 479447us
I20260501 14:00:52.188480  7747 raft_consensus.cc:1240] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 13. Current term is 14. Ops: []
W20260501 14:00:52.192701  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:52.193564  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.195331 12971 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.196324 12971 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.198911 13039 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.203917 12876 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:52.202183 12971 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:52.211881  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.211740  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:52.213529  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 67674.9us
I20260501 14:00:52.217672 13082 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.221259  7820 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:52.221925 13082 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:52.222970  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.217653 13089 consensus_queue.cc:1059] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260501 14:00:52.225135 13089 raft_consensus.cc:3055] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:52.225584 13089 raft_consensus.cc:740] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:52.226657 13089 consensus_queue.cc:260] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.217159 12987 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:52.233685 13089 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:52.239995 12825 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:52.241124 13101 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260501 14:00:52.231751  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.024s (SENT)
I20260501 14:00:52.269510  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:52.253190  7825 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:52.259861 13000 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:52.270754  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51525.2us
I20260501 14:00:52.270843 13035 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:52.271478  7826 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260501 14:00:52.271256 13000 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.271696 13035 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.272840 13035 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.273524 13000 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.264235 13082 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.229446  7824 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:00:52.274960 13035 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.275873 13000 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.276783  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:52.276501 13000 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.279052 13000 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.282339 13082 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.283196  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:52.283038 13082 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.285218 13065 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:00:52.285763 13082 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:52.286476  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 106096us
I20260501 14:00:52.287464  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.270768 12825 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.293570 13028 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.294220 13028 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.287504  7792 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:52.296025  7823 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
I20260501 14:00:52.297566 13035 raft_consensus.cc:2804] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:52.298142 13035 raft_consensus.cc:697] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:52.299214 13028 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.299453 13035 consensus_queue.cc:237] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.302009 12883 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.312064 13082 consensus_queue.cc:1059] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:52.232679  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.322387  7820 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:52.313787 13051 raft_consensus.cc:3055] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:52.314596 13007 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:52.338896 13089 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:52.339429 13089 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:52.340143 13089 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:52.333544 13051 raft_consensus.cc:740] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:52.345060 13051 consensus_queue.cc:260] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.346622 13051 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:52.337025 13007 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:52.350080 13007 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:52.354663  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 136465us
I20260501 14:00:52.362833 12971 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:52.364691 12987 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:52.366043 12460 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:52.366427 12460 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:52.367416 12460 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.368644 12460 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:52.378186  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45243.4us
I20260501 14:00:52.380766  7718 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.313436 12988 consensus_queue.cc:1059] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260501 14:00:52.376011 12883 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.388100 12825 raft_consensus.cc:2804] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:52.388020  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:52.390512 12825 raft_consensus.cc:697] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:52.390910 12988 consensus_queue.cc:1059] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260501 14:00:52.392019 13028 raft_consensus.cc:3055] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:52.391848 12825 consensus_queue.cc:237] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.392364 12988 raft_consensus.cc:3055] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:52.392952 12988 raft_consensus.cc:740] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:52.397960  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.398511 13007 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.400286 13089 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.400789 13039 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:52.401494  7827 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:52.402621 13089 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.392429 13028 raft_consensus.cc:740] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:52.405736  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.405508 13028 consensus_queue.cc:260] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.407327 13028 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:52.400974  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.411937  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.412209  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.412495  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.413066  7820 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:52.413347 13000 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:52.413286  7823 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:52.406965  7573 catalog_manager.cc:5671] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.413825 13000 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:52.416814 13000 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:52.419358 13007 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.418323  7573 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:52.422327  7573 catalog_manager.cc:5671] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:52.393942 12988 consensus_queue.cc:260] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.424680 12988 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:52.424057  7573 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 15, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:52.426131  7573 catalog_manager.cc:5671] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 16 to 17, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 17 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.416313  7718 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.428510 13039 raft_consensus.cc:2804] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:52.429425 13039 raft_consensus.cc:697] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:52.430452 13039 consensus_queue.cc:237] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.434934  7718 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.437784 13089 consensus_queue.cc:1059] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:52.439018 12971 raft_consensus.cc:3055] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:52.439424 12971 raft_consensus.cc:740] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:52.440536 13021 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:52.440383 12971 consensus_queue.cc:260] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.441076 13021 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:52.442252 13021 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.444796 12971 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:52.446421  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58505.2us
I20260501 14:00:52.448750 12460 raft_consensus.cc:2764] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260501 14:00:52.455607  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 67196.4us
I20260501 14:00:52.428455  7573 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 11, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.457130  7718 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.449875 12883 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:52.461266  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:52.468968  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.468989 12913 raft_consensus.cc:2804] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:52.470247 12913 raft_consensus.cc:697] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:52.471930  7625 auto_rebalancer.cc:786] Removing replace marker failed: Couldn't find leader for tablet c445f628c10d40b5a232bb391c4c92de
I20260501 14:00:52.459924 12883 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:52.472263  7625 auto_rebalancer.cc:814] Could not move replica: Not found: Couldn't find leader for tablet c445f628c10d40b5a232bb391c4c92de
W20260501 14:00:52.476172  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet c445f628c10d40b5a232bb391c4c92de
I20260501 14:00:52.468992  7573 catalog_manager.cc:5671] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 17, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 17 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:00:52.478804  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.471290 12913 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.480873 12995 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.482708 12460 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:52.480870 13007 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260501 14:00:52.483239 12460 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:52.483670 12460 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:52.483260 12995 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.485476  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.485653 12995 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.486999  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:52.487756  8374 raft_consensus.cc:3060] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:52.488284  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:52.488657  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.489537  8373 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:52.479573 13035 consensus_queue.cc:1059] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260501 14:00:52.491011  8373 raft_consensus.cc:1240] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:52.491050 13035 raft_consensus.cc:3055] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:52.491537 13035 raft_consensus.cc:740] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:52.492868  8371 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:52.492601 13035 consensus_queue.cc:260] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.493043  8373 raft_consensus.cc:1240] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:52.494150  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:52.494967  8373 raft_consensus.cc:1240] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:52.501231 12883 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:52.501739 13035 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:52.501618  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:52.510831  8374 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:52.512318  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.512705  8372 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:52.514909 12995 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:52.515293 12995 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:52.515612 12995 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:52.529066  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50310.7us
I20260501 14:00:52.530032  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:52.529227 12584 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:52.532511  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.534423  7750 raft_consensus.cc:1275] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260501 14:00:52.534792  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.536362  7749 raft_consensus.cc:1240] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:52.540561  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:52.543721  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:52.545228  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.545969 12913 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:52.546638 12913 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:52.547267 12913 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:52.551656  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:52.549737  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:52.552951  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.555614  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.556660  7823 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:00:52.523337 12995 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.567186 12584 consensus_queue.cc:1048] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260501 14:00:52.567513  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.570267  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.579037  7573 catalog_manager.cc:5671] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:52.583904  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.592190  8372 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:52.594192 12825 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:00:52.594802 12825 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.595261 12825 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:00:52.605321  7573 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.581756 13000 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.607689  7573 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.586555 13051 consensus_queue.cc:1059] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260501 14:00:52.622735  8374 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260501 14:00:52.627055  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.627480  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.618911 12971 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:52.632879  8373 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:52.634003  7745 raft_consensus.cc:606] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.622118 12460 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.640633  8372 raft_consensus.cc:1240] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:52.648236 13021 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.663772  8380 raft_consensus.cc:2368] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
I20260501 14:00:52.650331 12995 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.665268  8374 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
W20260501 14:00:52.661758 13108 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260501 14:00:52.635294 12971 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.670925  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.671150  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.671756  7823 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:52.670605 13021 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.674422  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.675254 13021 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.688722  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3031b746c62f413a9da6fed211d638da"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:52.689047 13082 raft_consensus.cc:3055] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:52.689850  7745 raft_consensus.cc:606] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:52.689908  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.690333  7745 raft_consensus.cc:614] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:52.695470  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 285) took 8887 ms. Trace:
I20260501 14:00:52.693943  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:52.697579  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.665s (SENT)
I20260501 14:00:52.699577  8372 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 14: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:52.702291  8374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:52.703209  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.704520  8372 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:52.703867  8374 raft_consensus.cc:606] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:52.705679  8374 raft_consensus.cc:614] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:52.708515 13089 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.709091 13089 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.709923  8373 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260501 14:00:52.709973  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:52.710692  7745 raft_consensus.cc:606] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:52.711076  7745 raft_consensus.cc:614] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:52.711234 13089 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.712666 12883 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:52.713274 12883 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.715428 12883 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.717700  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:52.718796  7745 raft_consensus.cc:606] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.692158 13082 raft_consensus.cc:740] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:52.719226  7745 raft_consensus.cc:614] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:52.720021  8372 raft_consensus.cc:1240] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:52.720469 13082 consensus_queue.cc:260] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.725708  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b540df5a794f06ab617858163d4297"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
W20260501 14:00:52.727769  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:52.732512  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.728427  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:52.732666 13082 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:52.732905  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.733534 13089 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:52.733707  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:52.736060 13000 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.734797  7745 raft_consensus.cc:606] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:52.740324  7745 raft_consensus.cc:614] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:52.696013  7576 rpcz_store.cc:276] 0501 14:00:43.808129 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:43.823575 (+ 15446us) service_pool.cc:224] Handling call
0501 14:00:52.695248 (+8871673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:49.073824 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:49.074667 (+   843us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:49.074728 (+    61us) write_op.cc:435] Acquired schema lock
0501 14:00:49.074756 (+    28us) tablet.cc:662] Decoding operations
0501 14:00:49.310392 (+235636us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:49.310458 (+    66us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:49.310494 (+    36us) tablet.cc:685] Acquiring locks for 23 operations
0501 14:00:49.312586 (+  2092us) tablet.cc:701] Row locks acquired
0501 14:00:49.312615 (+    29us) write_op.cc:260] PREPARE: finished
0501 14:00:49.312833 (+   218us) write_op.cc:270] Start()
0501 14:00:49.312992 (+   159us) write_op.cc:276] Timestamp: P: 1777644049312764 usec, L: 0
0501 14:00:49.313020 (+    28us) op_driver.cc:348] REPLICATION: starting
0501 14:00:49.387269 (+ 74249us) log.cc:844] Serialized 9045 byte log entry
0501 14:00:50.529223 (+1141954us) op_driver.cc:464] REPLICATION: finished
0501 14:00:50.667905 (+138682us) write_op.cc:301] APPLY: starting
0501 14:00:50.676231 (+  8326us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:50.919119 (+242888us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:50.919242 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:51.919793 (+1000551us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:51.936862 (+ 17069us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0501 14:00:51.936942 (+    80us) write_op.cc:312] APPLY: finished
0501 14:00:51.937669 (+   727us) log.cc:844] Serialized 204 byte log entry
0501 14:00:52.183335 (+245666us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:52.314891 (+131556us) write_op.cc:454] Released schema lock
0501 14:00:52.315101 (+   210us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:52.315740 (+   639us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:52.315779 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36722,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":80107,"apply.run_cpu_time_us":88053,"apply.run_wall_time_us":1665511,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":586276,"prepare.run_cpu_time_us":36211,"prepare.run_wall_time_us":926567,"raft.queue_time_us":214258,"raft.run_cpu_time_us":7651,"raft.run_wall_time_us":39530,"replication_time_us":1215991,"thread_start_us":1340718,"threads_started":5,"wal-append.queue_time_us":895175,"wal-append.run_cpu_time_us":84953,"wal-append.run_wall_time_us":1439214}]]}
I20260501 14:00:52.718904  7573 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 13, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.763182  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.763983  7828 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:52.767241  7754 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:52.768095  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:52.762668  7573 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:52.769605  7823 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:52.771416  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:52.779362  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.780030  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.777892  7573 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 14, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 14 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:52.783314  7749 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:52.776492  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.782836  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260501 14:00:52.786000  7573 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 12, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:52.787446  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:52.787727  7573 catalog_manager.cc:5671] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:00:52.788651  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:52.789284  7573 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:52.793474  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.794701 13007 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:52.795267  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:52.796002 13000 consensus_queue.cc:1059] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:52.796358 12876 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:52.791218  7573 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 12, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:52.796810 12876 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:52.777212 13089 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:52.807122 13113 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.807719 13113 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.808291  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:52.808900  8374 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:52.809351 13065 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:52.809935 13113 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.808900  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:52.796036 12460 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:52.820359  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:52.823869  8373 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:52.823954  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.799679 13000 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260501 14:00:52.803373 13021 raft_consensus.cc:3055] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:52.803974 13118 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:52.821730  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:52.829233  8380 raft_consensus.cc:2393] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:52.835860  7820 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:52.836705 13035 consensus_queue.cc:1059] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:52.838410  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:52.822728 12988 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:52.858529  7827 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:52.840485 13089 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.826588 13065 consensus_queue.cc:1059] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260501 14:00:52.849803  7718 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.835932  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:52.811489 12584 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:52.799849 13039 consensus_queue.cc:1059] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.029s
I20260501 14:00:52.863891 12584 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:52.864341 12584 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:52.867723  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.861737  8372 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:52.850418 12995 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:52.850889 13118 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:52.846421 13021 raft_consensus.cc:740] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:52.872887  7827 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 17.
W20260501 14:00:52.876250  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 52195.8us
I20260501 14:00:52.860363 12971 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.828286 13051 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260501 14:00:52.879411  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:52.875699 13118 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:52.889304  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:52.892833  7718 leader_election.cc:400] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
I20260501 14:00:52.880929 13114 raft_consensus.cc:2804] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:52.893177  7718 leader_election.cc:403] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:52.900569 13122 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:52.902917 13122 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:52.903541 13122 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:52.907393 12584 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.910923 12584 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.875469 12913 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:52.916065  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:52.883335 12971 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:52.895202  8374 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
I20260501 14:00:52.929525  7820 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:52.888445 13007 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:52.877049 12876 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:52.961270  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:52.892506 12825 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:52.978147 12825 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:52.978596  7750 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 17. Current term is 18. Ops: []
I20260501 14:00:52.978745 12987 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:52.965242  7827 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:52.979585 12987 consensus_queue.cc:1243] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260501 14:00:52.967286 12913 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:52.973552  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 60499.2us
W20260501 14:00:52.988752  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:52.993057  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 221666us
W20260501 14:00:52.993897  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 104658us
I20260501 14:00:52.995699  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:52.997121  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.003274  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:52.999637  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.003906  7678 raft_consensus.cc:1240] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:53.003962  7674 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:53.000190  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.005587  7676 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:53.005602 13124 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:53.006625 13124 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:53.007639 13124 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.000984  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.002120  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:53.011901  7673 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:53.002511  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.012933  7679 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:53.018568  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:53.019543  7675 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 19: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:52.975992 13035 raft_consensus.cc:3055] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:53.021113 12987 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:00:53.024032 13007 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Stepping down as leader of term 17
I20260501 14:00:53.029250 13007 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:52.960830 13021 consensus_queue.cc:260] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.028757 13035 raft_consensus.cc:740] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:53.029964 13127 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 17
W20260501 14:00:53.054168  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.048882  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.055394  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.056135  7750 raft_consensus.cc:1275] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260501 14:00:53.059146  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.040071 12913 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.040354 13039 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
W20260501 14:00:53.062943  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 45723.3us
I20260501 14:00:53.040866 12883 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:52.983150 12971 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.041322 12995 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:53.066680  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.067638  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:53.069521  8372 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:53.059752 13000 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.079677 13021 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:53.093235  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.101135  8372 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:53.105240  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.073052 12913 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.102891 13000 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.112244 13000 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.083206 13007 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.116420 13122 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.119163 13122 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:53.120306 13113 raft_consensus.cc:3055] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:53.120739 13113 raft_consensus.cc:740] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:53.121907 12988 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:53.121599 13113 consensus_queue.cc:260] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.074314 13039 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.122982 13113 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:00:53.124828  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.126017 13118 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:53.127954  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.128890  7676 raft_consensus.cc:2410] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260501 14:00:53.129379  7671 raft_consensus.cc:1240] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:53.130988 12913 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:53.132091  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.132033  7792 leader_election.cc:336] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.332s (SENT)
I20260501 14:00:53.132819  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:53.137476  7672 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260501 14:00:53.139066 13132 log.cc:927] Time spent T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260501 14:00:53.141129 12971 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.141590 12988 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:53.088517 12883 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.143035 12876 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:53.143680  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.143560 12883 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:53.144744  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.140949 13131 raft_consensus.cc:3055] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:53.145443 13131 raft_consensus.cc:740] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:53.146426 13131 consensus_queue.cc:260] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.099756 13035 consensus_queue.cc:260] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.080576 12995 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.148123 13131 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:53.157748  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 88853.5us
I20260501 14:00:53.083657 13082 consensus_queue.cc:1048] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260501 14:00:53.170765  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.164701  7792 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.172765  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:53.173633  7820 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:53.174527  7672 raft_consensus.cc:1240] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:53.170493 12460 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.176330 13134 raft_consensus.cc:2804] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:53.176564 13039 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.176719 12460 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.179019 12460 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:53.180759 13007 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:00:53.181726  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:53.196400  7675 raft_consensus.cc:1240] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:53.190999  7746 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:53.198164 13134 raft_consensus.cc:697] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:53.201499 13134 consensus_queue.cc:237] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:53.203661  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.204058 13035 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:53.215674  8374 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:00:53.218528 13127 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17.
I20260501 14:00:53.187981 13118 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:53.220577  7820 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
W20260501 14:00:53.229301  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.236578  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:53.238335  7672 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:53.240033 13114 raft_consensus.cc:697] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:53.240962  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 165525us
I20260501 14:00:53.243235  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.248816  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:53.249648  7746 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:53.249873  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.251096  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:53.253207  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.253954  7824 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:53.255090  7672 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 8.
I20260501 14:00:53.258121 13021 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:53.258822 13021 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:53.260093 13021 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.257571  8344 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.285354 13136 raft_consensus.cc:2804] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:53.286554  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.287568  7672 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:53.251860 13039 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:53.288457 13039 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:53.288955 13136 raft_consensus.cc:697] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:53.289638 13039 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.290020 13136 consensus_queue.cc:237] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:53.293241  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 43479.8us
I20260501 14:00:53.296725  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.288604  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.299762  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:53.303258  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:53.301580 12876 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:53.307118 13127 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260501 14:00:53.313621  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.314035 12876 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:53.301155 12995 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:53.314527  7672 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:53.315030 12995 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:53.315507 12995 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:53.314541 12876 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:53.302968 12460 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:53.340260 13146 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260501 14:00:53.342681  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:53.342968  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.343618  7672 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:53.343511  8372 raft_consensus.cc:2955] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:53.344769  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.345358  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:53.346226  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:53.346472  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:53.346824  7673 raft_consensus.cc:3060] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:53.347157  7679 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:53.323553 12913 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:53.345494  7675 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:53.352025  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.355710  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:53.358937  8373 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:00:53.359041  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:53.359393  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:53.357954  7671 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:53.362617  7827 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:53.358776  7678 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:00:53.365624  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:53.366403  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:53.367074  8371 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:00:53.366665 13114 consensus_queue.cc:237] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.367676  7828 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:53.356827 12913 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:53.370357 12913 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:53.373117  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:53.338793 12460 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.374037  7672 raft_consensus.cc:2393] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 19: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:53.366689  7820 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260501 14:00:53.367319  7826 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:00:53.383039  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:53.384078  8381 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:53.381778 12460 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:53.323908 13133 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260501 14:00:53.376220 13118 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:53.387997 13117 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election won for term 15
W20260501 14:00:53.385388 13147 log.cc:927] Time spent T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260501 14:00:53.395241 13117 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:53.396644 13117 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.391007  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:53.400255  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:53.401333  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:53.404141 13089 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:53.385717  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:53.412989  7679 raft_consensus.cc:2410] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260501 14:00:53.403633 12971 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:53.431922  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:53.433535  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:53.420127  8380 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:53.405709 12995 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:53.443519  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.445312  7673 raft_consensus.cc:2410] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260501 14:00:53.446280  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:53.446947  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.449504  7827 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:53.448108  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:00:53.464912  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.451516  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:53.432932 12971 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:53.449067 13118 raft_consensus.cc:2764] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260501 14:00:53.485814  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.478520 13129 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:53.485226 13130 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:53.451527 13133 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:00:53.469744 13000 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:53.460217 13127 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260501 14:00:53.532521 12988 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.520284 13114 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
W20260501 14:00:53.535887  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.530923 12876 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.519889 12971 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:53.541198 13165 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260501 14:00:53.623353 13155 log.cc:927] Time spent T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260501 14:00:53.537562 13000 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.624110 13000 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:53.604856 13039 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
W20260501 14:00:53.548619  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.548893 12995 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:53.549839 12913 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:53.571555  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.559568  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.531538 13129 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.536850 13130 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:53.606288  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 65188.7us
I20260501 14:00:53.614871 13133 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:53.542614 13127 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.640807  7827 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260501 14:00:53.662478  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.660147  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:53.636440 12971 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.646850 13171 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:53.647357  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.647843  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.675582  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 157274us
I20260501 14:00:53.677201  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:53.677860  7827 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:53.677497  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.684087  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:53.693657 13118 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.694245  7820 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260501 14:00:53.694326 13118 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.698073 13089 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.698699 13089 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:53.607439 12988 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:53.701715 12988 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:53.704010 12876 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:53.705211 12460 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.706205 12971 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.707288 12460 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:53.643643 13129 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:53.685319 13171 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.712133 13171 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.709668 13133 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.648192 13130 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:53.664455 13127 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:53.727443  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.667686 12995 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:00:53.733206  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:53.733950  7820 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:53.753937  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.768458  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:53.775508 13146 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.776156 13146 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:53.680784 13136 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260501 14:00:53.782133  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.769665  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:53.783236  7750 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:53.785126  7747 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:53.744549 13124 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:53.789986 13165 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:53.790382  7746 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260501 14:00:53.790676  8371 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:53.745095 12995 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:53.796037  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 99413.4us
I20260501 14:00:53.792089  8381 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:53.801258  7827 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:53.820523  7820 raft_consensus.cc:2468] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:53.821362  7825 raft_consensus.cc:1240] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:53.815765  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:53.827143  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.837356 13118 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.835325  7625 placement_policy_util.cc:244] tablet 5cde3c3e4a3b462b8f274fec8e2adbe3: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260501 14:00:53.883888  7625 placement_policy_util.cc:244] tablet c445f628c10d40b5a232bb391c4c92de: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260501 14:00:53.884500  8344 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:53.886195 13136 raft_consensus.cc:2804] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election won for term 14
W20260501 14:00:53.886428  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.886752 13136 raft_consensus.cc:697] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:53.887844 13136 consensus_queue.cc:237] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.823572 13168 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.894953  7718 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:53.930461  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.878893 12988 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:53.937175  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:53.880725 13035 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:53.811015 13124 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.898533 12913 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:53.933941 13089 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:53.938283 12988 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:53.979843  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:53.983131  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 88265.3us
W20260501 14:00:53.984264  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:53.898571 13178 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260501 14:00:53.966845 13035 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:53.983619 13021 raft_consensus.cc:2804] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:53.991037 13113 consensus_queue.cc:1059] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:53.992106 13113 raft_consensus.cc:3055] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:00:53.992457 13113 raft_consensus.cc:740] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:53.993300 13113 consensus_queue.cc:260] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:53.994562 13113 raft_consensus.cc:3060] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:53.982199 12988 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:53.998329  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.001732 13021 raft_consensus.cc:697] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:54.002928 13021 consensus_queue.cc:237] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:53.953383 13168 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.029668 13035 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:54.032406 13169 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260501 14:00:54.038059 13124 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:54.047922  7822 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260501 14:00:54.048234 13186 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:54.050874  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.051662  7746 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:54.052991 13172 log.cc:927] Time spent T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260501 14:00:54.057261 13156 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.328s	user 0.005s	sys 0.000s
I20260501 14:00:54.058540 13129 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.060124 13051 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:54.060506 13181 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260501 14:00:54.060674 13051 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.061925 13168 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:54.062726 13174 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260501 14:00:54.062813 13051 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:53.978972 12995 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:54.068363 13182 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
W20260501 14:00:54.068919  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.085063  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.069789 13130 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.044803 13146 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:54.095002  7820 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:54.096221  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:54.071663  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:54.072675  7750 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:54.074637  8372 raft_consensus.cc:1240] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 14. Current term is 15. Ops: []
I20260501 14:00:54.074751  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:54.075947 13123 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.076349 12988 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.115175  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.078323  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.077818 13127 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:54.094182 13173 log.cc:927] Time spent T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.198s	user 0.000s	sys 0.002s
I20260501 14:00:54.094547  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.111615  7747 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260501 14:00:54.115087  7718 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.518s (SENT)
W20260501 14:00:54.123761  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.124027  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:54.116281  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 44732us
W20260501 14:00:54.117554  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 144675us
W20260501 14:00:54.125619  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.132411  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:54.133677  8372 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:54.135640  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.139633  7826 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:54.139533  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.145989  7820 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:54.152150 13171 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.152801 13171 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.153321  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:54.154994 13171 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:54.156347  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:54.157719  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.158120  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.155202  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:54.159734  8380 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:54.160931  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:54.112112 13051 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.165369  7746 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:54.169974  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.171095  7819 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 15: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:54.166298  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.161723  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.172019  7745 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:54.174119  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:54.176630  7672 raft_consensus.cc:1275] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260501 14:00:54.179522  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.165633  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.183755  8372 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:54.185788  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.187891  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:54.189254  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:54.189216  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:54.190029  7822 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:54.184068  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:54.191660  8380 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:54.192042  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.193795  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.194448  7745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2975a86035451cb56a7caf76296505"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:54.195183  7745 raft_consensus.cc:606] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:54.206697  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.207064  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.207152  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.208369  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.209017  7678 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:54.209843  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.206738  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.207522  7679 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:54.213155  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.214046  7825 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260501 14:00:54.192680  7672 raft_consensus.cc:2376] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12. Re-sending same reply.
W20260501 14:00:54.216542  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:54.197419 13000 consensus_meta.cc:287] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.005s
I20260501 14:00:54.122393 13123 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.230490  7746 raft_consensus.cc:1240] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260501 14:00:54.230432  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.198956 13133 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:54.232290  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.206907 13065 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:54.177399 13051 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:54.237723  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 122686us
I20260501 14:00:54.238862  7754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
W20260501 14:00:54.241544  7718 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.566s (SENT)
I20260501 14:00:54.246452  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:54.247709  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.247005  7676 raft_consensus.cc:3055] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:00:54.252633  7676 raft_consensus.cc:740] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:54.255112  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.220376 13000 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.264300  7822 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 16.
W20260501 14:00:54.279029  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.373890  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.250777 13129 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:54.323737  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 82213.2us
W20260501 14:00:54.379490  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 119738us
I20260501 14:00:54.380522  7679 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:54.379544  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:54.381758  7754 raft_consensus.cc:606] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:54.382282  7754 raft_consensus.cc:614] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:54.264218 13128 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:54.257673  7676 consensus_queue.cc:260] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.265350 13187 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260501 14:00:54.393203  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.393496  7676 raft_consensus.cc:3060] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:54.398275  7675 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 16. Ops: []
I20260501 14:00:54.396057 13178 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.400867 13178 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.402580  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.404476  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.407578 13000 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:54.405804 13135 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260501 14:00:54.407608  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:54.406754  7747 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:54.409330  7748 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:54.408793  7745 raft_consensus.cc:1240] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 9. Current term is 10. Ops: []
I20260501 14:00:54.411197  7745 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:00:54.411516  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.412094  7750 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 13.
I20260501 14:00:54.412969  7747 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:54.413753  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.415066  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.267622 13028 consensus_queue.cc:1059] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260501 14:00:54.417501 13028 raft_consensus.cc:3055] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:54.418063 13028 raft_consensus.cc:740] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:54.417531  8374 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260501 14:00:54.418406  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.419030  7752 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:54.403509  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.419059 13028 consensus_queue.cc:260] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.440240  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.440452  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.440954  7673 raft_consensus.cc:3060] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:54.441413 13028 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:54.442560  8379 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260501 14:00:54.438802 13191 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260501 14:00:54.389771 13128 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:54.449193  8380 raft_consensus.cc:2468] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:54.454553  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.454654  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.450181 13128 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:54.461036 13130 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:54.461508 13051 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:54.462143 13163 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260501 14:00:54.462632 13197 log.cc:927] Time spent T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260501 14:00:54.462567  7748 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 16.
I20260501 14:00:54.463565 13136 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:54.475701 13128 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:54.477195 13198 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260501 14:00:54.478942 13128 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:54.393059 13142 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:54.507535 13142 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.510512 13142 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:54.512857 13178 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:54.514577 13129 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260501 14:00:54.431133 13127 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:54.518230 12988 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:54.536891  7676 raft_consensus.cc:1275] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260501 14:00:54.430855 12460 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.556165  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.557940  7673 raft_consensus.cc:2468] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
W20260501 14:00:54.560935  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 180137us
W20260501 14:00:54.577746  7791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.591060  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.591259  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.592716  7676 raft_consensus.cc:2376] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12. Re-sending same reply.
I20260501 14:00:54.592994  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.593981  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.594543  7676 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:54.597250  7679 raft_consensus.cc:1275] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:54.597220  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.597991  7672 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:54.571374 12460 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.602891  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66"
dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:35982
I20260501 14:00:54.603562  8380 raft_consensus.cc:606] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:54.603916  8380 raft_consensus.cc:614] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:54.604210 12460 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:54.604950  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.605309  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.605638  7674 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:54.606026  7673 raft_consensus.cc:2376] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19. Re-sending same reply.
I20260501 14:00:54.608243  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.611981  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.612254  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.600026  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:54.618806  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.620783  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.622280  7679 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:54.623665  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.571597 13123 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:54.628022  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.629717  7677 raft_consensus.cc:3055] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:54.630110  7677 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:54.635377  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.636005  7677 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.637171  7677 raft_consensus.cc:3060] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:54.538332 13187 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.104s
I20260501 14:00:54.586621 13130 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:54.642948  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:54.640415  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:54.644634  7754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:54.653710  7754 raft_consensus.cc:606] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:54.654251  7754 raft_consensus.cc:614] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:54.640100  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.656997  7670 raft_consensus.cc:3060] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:54.636000  7671 raft_consensus.cc:2376] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14. Re-sending same reply.
I20260501 14:00:54.639802  7674 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:54.656327  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.624495 13127 raft_consensus.cc:2764] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260501 14:00:54.662460  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.666430  7671 raft_consensus.cc:2376] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13. Re-sending same reply.
I20260501 14:00:54.663902  7675 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:54.669404  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.670495  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.643067 13167 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.673877  7678 raft_consensus.cc:2393] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 16: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:54.676493  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.677428  7671 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:54.678973  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:54.679654  7675 raft_consensus.cc:2376] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11. Re-sending same reply.
I20260501 14:00:54.683631  7676 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:54.683740  7674 raft_consensus.cc:2376] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11. Re-sending same reply.
I20260501 14:00:54.686204  7820 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260501 14:00:54.699985  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:54.660526  7718 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.508s (SENT) [suppressed 32 similar messages]
I20260501 14:00:54.613355 13168 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260501 14:00:54.706945  7676 raft_consensus.cc:1275] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:54.665711 13171 raft_consensus.cc:2764] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260501 14:00:54.670176 13142 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.715867  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:54.716050  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 75776.7us
I20260501 14:00:54.716746  7675 raft_consensus.cc:2376] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13. Re-sending same reply.
W20260501 14:00:54.716423  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 283771us
W20260501 14:00:54.715924  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 73073.2us
I20260501 14:00:54.672298 13128 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260501 14:00:54.721271  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.722446  7679 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:54.680768 13129 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.658700 13130 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.730600  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
W20260501 14:00:54.712586 13189 log.cc:927] Time spent T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.099s	user 0.006s	sys 0.024s
I20260501 14:00:54.732028  7754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:54.732878  7754 raft_consensus.cc:606] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Received request to transfer leadership to TS ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:54.733369  7754 raft_consensus.cc:614] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:54.734648  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:54.735527  8344 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:54.729139  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:54.738188  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:54.755111  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.726316 13187 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:54.757789  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:54.733815  7828 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.043s	sys 0.043s
I20260501 14:00:54.766461  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:54.760215  7820 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:00:54.729844 13113 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.763396  7678 raft_consensus.cc:1275] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260501 14:00:54.747881 13177 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:54.760699  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
W20260501 14:00:54.771735  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.748195 13124 raft_consensus.cc:2804] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:54.737514 13122 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:54.767024  7828 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.044s	sys 0.043s
I20260501 14:00:54.773806 13187 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.808820  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:54.715214 13167 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:54.817394  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 57600.2us
I20260501 14:00:54.736418 13129 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.759488 13171 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:54.828655  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:54.829366  7827 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:54.729504 13142 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:54.772394 13177 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:54.837613  7749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b540df5a794f06ab617858163d4297"
dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:47166
I20260501 14:00:54.836961  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:54.839474  7749 raft_consensus.cc:606] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:54.841017 13142 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:54.841301 13028 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:54.826900 13123 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:54.830325 12988 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260501 14:00:54.844115  7749 raft_consensus.cc:614] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:54.828889 13122 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.843006  7748 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:54.850085  7677 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260501 14:00:54.853020  7677 pending_rounds.cc:85] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 9
I20260501 14:00:54.813182 13113 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:54.854452  7677 pending_rounds.cc:107] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260501 14:00:54.838366 13210 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:54.923775  7677 raft_consensus.cc:2889] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:54.869356  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260501 14:00:54.928679  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:54.928236  7671 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:54.879894  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:54.932971  7674 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260501 14:00:54.863735 13082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.023s	sys 0.042s
W20260501 14:00:54.923786 13202 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.162s	user 0.000s	sys 0.004s
I20260501 14:00:54.839485 13177 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:00:54.941608 13209 log.cc:927] Time spent T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260501 14:00:54.948912 13200 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.442s	user 0.002s	sys 0.000s
I20260501 14:00:54.851400 12988 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:54.844815 13028 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:54.937778 13082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.023s	sys 0.043s
I20260501 14:00:54.929998 13205 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:00:54.970665  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 211298us
I20260501 14:00:54.962862  7670 raft_consensus.cc:2468] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:54.927884 13210 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:54.854260 13123 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:54.977046  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 128713us
I20260501 14:00:54.967566 12988 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:54.967936 13028 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:54.968392 13142 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:54.970973 13130 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:55.005784  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 282203us
I20260501 14:00:55.006145  7672 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:54.977510 13210 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:55.005314 12995 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260501 14:00:54.985968 13122 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.018661 13123 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.017813  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:55.038398  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 264028us
I20260501 14:00:54.999982 13142 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:54.983006 13127 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260501 14:00:55.013931 13129 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:54.976622 13205 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.041549 13167 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:55.063832  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46088.7us
I20260501 14:00:55.046265 13142 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:55.044572 13130 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:55.071614  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:55.052594 13187 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.069015  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:55.076807  8371 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:55.077811  8381 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260501 14:00:55.074829  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.080317  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.081568  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:55.082136  8374 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:55.082510  8379 raft_consensus.cc:2410] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260501 14:00:55.060802 13124 raft_consensus.cc:697] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:55.068972 13113 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:55.104663 13214 log.cc:927] Time spent T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260501 14:00:55.086496 13122 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.170267 13122 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.172465 13122 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.124308 13127 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:55.173208 13127 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.175223 13127 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.176311 13220 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.176896 13220 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:55.125707  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.183014 13217 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:55.183636  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 107147us
I20260501 14:00:55.184605  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.185555 13171 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.183566 13217 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.189337  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:00:55.151993  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 146473us
I20260501 14:00:55.160262  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:55.233357  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:55.100211 13130 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:55.234815 13082 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:00:55.234874 13130 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:55.235395 13082 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:55.189601 13217 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:55.193298  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.235885 13082 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:55.238076 13177 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.138386 13205 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.240520 13177 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:55.240878  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:55.242148  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:55.243495 13135 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:55.243911 13135 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:55.244278 13135 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:55.245086 13171 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:55.245505  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:55.234055  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 14:00:55.252039  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 264839us
I20260501 14:00:55.204592 13124 consensus_queue.cc:237] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.217321 13028 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.220568 12988 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.221908  8371 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:55.228080 13220 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.232411  8374 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:55.242827 13123 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:55.213500 13142 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:55.253810  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 160310us
I20260501 14:00:55.252856  7718 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:55.262869  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:55.268649  7827 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:00:55.271180  7820 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:00:55.227330 13210 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.272444  7824 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:55.275010  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.280480  7820 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:55.283417  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.284176  7824 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:55.254238 13203 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260501 14:00:55.285952  7822 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:55.262053 13123 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:55.262246 13204 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.289855  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.296449  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.296918 13065 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260501 14:00:55.296545  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.297427  7754 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:55.298849  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.299767  7819 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
I20260501 14:00:55.296451  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.303401  7824 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:55.273607 13114 raft_consensus.cc:2804] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:55.304313  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.304750  7751 raft_consensus.cc:1275] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260501 14:00:55.305167  7751 pending_rounds.cc:85] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Aborting all ops after (but not including) 10
I20260501 14:00:55.305465  7751 pending_rounds.cc:107] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260501 14:00:55.305698  7751 raft_consensus.cc:2889] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:55.304762 13114 raft_consensus.cc:697] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:00:55.307541  7625 auto_rebalancer.cc:285] failed to send replica move request: Illegal state: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:55.301046 13123 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:55.309989 13114 consensus_queue.cc:237] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:55.305164  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 48664.3us
I20260501 14:00:55.280373 13205 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260501 14:00:55.313467 13206 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.321131  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:55.335712  7718 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.652s (SENT)
I20260501 14:00:55.334964  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.335340  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.343915  7822 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:55.344175  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.326570 13206 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.344858  7748 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:55.346273  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.336988  7819 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:55.316257 13204 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.344789 12988 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.334476 13221 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.351356 13221 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:55.353415  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.357673  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.358399  7751 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:55.358546 13142 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:55.378530  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 43659.8us
I20260501 14:00:55.381837  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:55.382522  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 193265us
I20260501 14:00:55.383786  8344 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.382629  7754 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:55.385749  7827 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260501 14:00:55.386685  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:55.388095  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.340325  7577 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } }
I20260501 14:00:55.389899  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.391566  7748 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:55.392719  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 57031.4us
W20260501 14:00:55.393573  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.043s (SENT)
I20260501 14:00:55.396987  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.397790 13225 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:55.401167 13065 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:55.401608 13065 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.401927 13065 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.403028 13224 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:55.403478 13224 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.403782 13224 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.404969 13204 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.387261 13203 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.389572 13226 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:55.409667  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.411034  7746 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:55.408147 13207 consensus_queue.cc:1048] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260501 14:00:55.413793 13221 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:55.414359  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.415580 13135 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.384706 12988 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.391999  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.389979  7573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 316) took 7589 ms. Trace:
I20260501 14:00:55.411078 13226 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.418486  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.421909 13210 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.421309  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:55.437273 13226 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:55.438815  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.437541  7746 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:55.445647 13221 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:55.449437 13221 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.449857 13221 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.410867 13203 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.453876 13207 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.456432 13226 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.441783 12988 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.459043 12988 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:55.459064 13226 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.386039 13142 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260501 14:00:55.461781 13177 consensus_queue.cc:1059] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:55.462967 13220 raft_consensus.cc:3055] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Stepping down as leader of term 8
I20260501 14:00:55.463398 13220 raft_consensus.cc:740] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:55.464380 13220 consensus_queue.cc:260] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.466619 13135 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:55.467585 13228 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260501 14:00:55.467804  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 80147.1us
I20260501 14:00:55.468833  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.469655 13228 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:00:55.470052  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.470901 13228 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:55.446391 13168 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260501 14:00:55.473590 13206 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:55.474048 13207 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:55.442900  7577 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 11 to 10, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 10 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:55.474550 13220 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:55.428876  7573 rpcz_store.cc:276] 0501 14:00:47.797834 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:47.808246 (+ 10412us) service_pool.cc:224] Handling call
0501 14:00:55.386910 (+7578664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:53.117343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:53.118071 (+   728us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:53.118140 (+    69us) write_op.cc:435] Acquired schema lock
0501 14:00:53.118157 (+    17us) tablet.cc:662] Decoding operations
0501 14:00:53.119697 (+  1540us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:53.119803 (+   106us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:53.159199 (+ 39396us) tablet.cc:685] Acquiring locks for 17 operations
0501 14:00:53.220568 (+ 61369us) tablet.cc:701] Row locks acquired
0501 14:00:53.220587 (+    19us) write_op.cc:260] PREPARE: finished
0501 14:00:53.220790 (+   203us) write_op.cc:270] Start()
0501 14:00:53.220969 (+   179us) write_op.cc:276] Timestamp: P: 1777644053220714 usec, L: 0
0501 14:00:53.221032 (+    63us) op_driver.cc:348] REPLICATION: starting
0501 14:00:53.221868 (+   836us) log.cc:844] Serialized 6702 byte log entry
0501 14:00:53.365909 (+144041us) op_driver.cc:464] REPLICATION: finished
0501 14:00:53.385341 (+ 19432us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2f762682c 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fe123360
0501 14:00:53.615954 (+230613us) write_op.cc:301] APPLY: starting
0501 14:00:53.616072 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:54.051248 (+435176us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:54.051296 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:54.468886 (+417590us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:54.469374 (+   488us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0501 14:00:54.469449 (+    75us) write_op.cc:312] APPLY: finished
0501 14:00:54.469986 (+   537us) log.cc:844] Serialized 156 byte log entry
0501 14:00:54.520186 (+ 50200us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2f762682c 00007fb30041fbc9 00007fb2f7642cdb 00007fb2f7640f7f 00007fb2f7643242 00007fb2fa27a5ab
0501 14:00:54.714866 (+194680us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:54.725996 (+ 11130us) write_op.cc:454] Released schema lock
0501 14:00:54.737608 (+ 11612us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:54.777240 (+ 39632us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:54.813376 (+ 36136us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73985,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":249727,"apply.run_cpu_time_us":63289,"apply.run_wall_time_us":1146615,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75085,"num_ops":17,"prepare.queue_time_us":141785,"prepare.run_cpu_time_us":6625,"prepare.run_wall_time_us":104923,"replication_time_us":144675,"spinlock_wait_cycles":131528832,"thread_start_us":504115,"threads_started":3,"wal-append.queue_time_us":367144}]]}
I20260501 14:00:55.487519 13187 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:55.491014 13221 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.455521 13203 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.497409 13187 consensus_queue.cc:1059] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:00:55.498754 13168 raft_consensus.cc:3055] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:55.499212 13168 raft_consensus.cc:740] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:55.500665 13168 consensus_queue.cc:260] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.497499 13028 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.506665  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.507020  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.507719  8371 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:55.507856 13168 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.508040  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.508872  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.508966  8372 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:00:55.510216  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.510964  8381 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:55.513242  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.514091  8379 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:55.515477  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:00:55.516227  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.516316  8371 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:55.518844 13123 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.532960  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:55.471517  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.532927  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.537875  7753 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:55.538983 13228 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:55.540189  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 68758.1us
I20260501 14:00:55.541160  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.535380  7821 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 18.
W20260501 14:00:55.542793  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.503s (SENT)
I20260501 14:00:55.544476  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:55.546064  7748 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
W20260501 14:00:55.553926  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58705.9us
I20260501 14:00:55.555377  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.562000  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:55.562736  7823 raft_consensus.cc:3060] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:55.565858  8344 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.168s (SENT)
I20260501 14:00:55.503302 13065 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.569170 13123 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:55.571069 13221 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:55.598919  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49313.1us
I20260501 14:00:55.572971 13082 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:55.575078  7753 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:55.578357 13113 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:00:55.553191 13226 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:55.548112 13133 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:55.657734  7823 raft_consensus.cc:2468] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 14.
I20260501 14:00:55.562860 13000 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:55.601953  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.604456  7751 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:55.606531  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.622215 13065 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:55.559487 13167 consensus_queue.cc:1059] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260501 14:00:55.660147  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58294.6us
I20260501 14:00:55.661111  7827 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:55.675881  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 287798us
W20260501 14:00:55.676472  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.689651  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.660060 13000 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.701592  7823 raft_consensus.cc:1240] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:55.704818  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:55.706976  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 100618us
I20260501 14:00:55.694216 13220 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:55.718742  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.722173  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:00:55.726222  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.721082  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.728883  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.729671  8379 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:55.716048  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:55.734001  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.735132  7748 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:55.741736  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:55.706960 13000 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.711660 13228 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:00:55.750352  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:55.748934  8381 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [9.10-11.11]
W20260501 14:00:55.760293  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.723520  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:55.770022  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.672843 13133 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.775074  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:55.775990  7754 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:55.783654  7749 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:55.782984  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 201170us
I20260501 14:00:55.791776  7751 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:55.796651  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 73045.9us
I20260501 14:00:55.780596 13136 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260501 14:00:55.798427  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 53941.1us
W20260501 14:00:55.802729  7718 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.061s (SENT)
I20260501 14:00:55.804147  8371 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:55.806515  8344 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.807655  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.812016  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.813098 13127 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:55.801604 13136 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.830025  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:55.832362  7718 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:55.837116  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:55.808126 13228 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:55.835440  7718 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:55.822841 13178 raft_consensus.cc:2804] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:55.867547  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:55.864646  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:55.832278 13136 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:00:55.831741 13082 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:55.845050 13113 raft_consensus.cc:2804] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:55.839218 13124 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:55.871243 13114 raft_consensus.cc:2804] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:55.823305 13205 consensus_queue.cc:1059] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
W20260501 14:00:55.898437  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 148355us
I20260501 14:00:55.840194 13127 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260501 14:00:55.890803 13187 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260501 14:00:55.901412  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 93842.4us
I20260501 14:00:55.904069  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.864889 13228 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:55.905464  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:55.906667  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.907027  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:55.915520  7792 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.902330 13187 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.923424  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:55.918252 13065 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:55.907508 13232 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260501 14:00:55.929806 13245 log.cc:927] Time spent T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260501 14:00:55.921523 13224 consensus_meta.cc:287] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.002s
W20260501 14:00:55.932578 13239 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260501 14:00:55.931473  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:55.934794 13238 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260501 14:00:55.921032 13187 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:55.936857 13234 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.398s	user 0.006s	sys 0.000s
I20260501 14:00:55.941305 13225 raft_consensus.cc:3055] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:55.943272 13133 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:55.948383  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:55.925922 13255 consensus_queue.cc:1059] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260501 14:00:55.931450 13142 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:00:55.952423 13252 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:55.971292  7754 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:55.996682  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 65293.2us
I20260501 14:00:55.997346 13123 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260501 14:00:55.929840 13243 log.cc:927] Time spent T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260501 14:00:55.953925 13231 log.cc:927] Time spent T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260501 14:00:55.928833 13065 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.952684 13232 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:56.000204  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 107858us
I20260501 14:00:55.919355 13028 raft_consensus.cc:2804] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Leader election won for term 9
I20260501 14:00:56.019640  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.015345 13142 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:55.999748 13178 raft_consensus.cc:697] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:55.999950 13114 raft_consensus.cc:697] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:56.002624 13225 raft_consensus.cc:740] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:55.994824 13113 raft_consensus.cc:697] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:56.045809  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:56.016772 13221 raft_consensus.cc:3055] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:56.008592 13205 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:56.034953  8381 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:55.995502 13224 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.040268  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.037887 13232 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:56.035989 13065 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.038715 13252 raft_consensus.cc:2764] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260501 14:00:56.041869 13142 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:56.026603 13123 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:56.043213 13135 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:56.080668 13135 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:56.081161 13135 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
W20260501 14:00:56.064060  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.043530 13028 raft_consensus.cc:697] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.083762 13028 consensus_queue.cc:237] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.052743 13221 raft_consensus.cc:740] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:56.086035 13221 consensus_queue.cc:260] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.088500 13178 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.092342 13114 consensus_queue.cc:237] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.095920 13123 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:56.096313 13252 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.096910  8380 raft_consensus.cc:2368] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
W20260501 14:00:56.096387  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:00:56.097035 13252 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:56.097627  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 962840f0434049bbb395d330e010962d, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.097759 13224 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:56.098006  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 962840f0434049bbb395d330e010962d, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:56.074283 13251 log.cc:927] Time spent T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260501 14:00:56.099246 13252 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.100687 13203 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:56.101217 13203 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:56.101639 13203 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:00:56.104030  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.092355 13113 consensus_queue.cc:237] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.107888 13123 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.111639  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:56.112020  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:56.112666  7821 raft_consensus.cc:3060] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.072774 13257 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260501 14:00:56.075789 13000 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.079218 13228 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:56.059690 13127 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260501 14:00:56.131282  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:56.135389  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 231945us
W20260501 14:00:56.137743  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:56.139096  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.684s (SENT)
I20260501 14:00:56.139519  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:56.142010  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.142313  7751 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:56.142709  7827 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:56.114099 13221 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:56.134169 13167 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Stepping down as leader of term 11
W20260501 14:00:56.155364  7718 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.700s (SENT)
I20260501 14:00:56.125038 13127 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:56.063850 13205 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.159106  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:56.173031  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.833s (SENT)
I20260501 14:00:56.173740  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:56.179261 13000 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.141750 13232 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.185890 13232 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.187354 13123 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.189635 13142 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.168491 13127 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:56.155344 13168 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260501 14:00:56.202811  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 139928us
I20260501 14:00:56.204449  7792 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.204990  7825 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:56.161124 13167 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:56.207397  7792 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.220618  7672 raft_consensus.cc:1275] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260501 14:00:56.220961  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.140584 13225 consensus_queue.cc:260] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.221200  7672 pending_rounds.cc:85] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 7
I20260501 14:00:56.226796  7672 pending_rounds.cc:107] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260501 14:00:56.191797 13142 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:56.224112  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.227293  7672 raft_consensus.cc:2889] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:56.227806  7674 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:56.228883  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.229645  7670 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:56.221994  7678 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:56.203943 13264 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:56.231678 13267 raft_consensus.cc:2804] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:56.230661  7792 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.200376 13268 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election won for term 16
W20260501 14:00:56.252272  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 79271.2us
I20260501 14:00:56.220053 13136 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:56.288791  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 58211.2us
I20260501 14:00:56.256584 13123 raft_consensus.cc:2804] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:56.259943 13207 raft_consensus.cc:3055] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:00:56.262465  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.307618 13207 raft_consensus.cc:740] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:56.308032  7674 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:56.308800 13207 consensus_queue.cc:260] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.309486  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.310034 13207 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:56.310266  7674 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:56.263020  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.311784  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:56.264254  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.312623  7754 raft_consensus.cc:2368] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:56.313015  7678 raft_consensus.cc:3060] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:56.312944 12988 raft_consensus.cc:2804] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:56.264505  7675 raft_consensus.cc:1240] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260501 14:00:56.317021  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.317760  7675 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:56.318761  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.319386  7675 raft_consensus.cc:3060] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:56.266180  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.268447  7679 pending_rounds.cc:85] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 6
I20260501 14:00:56.320439  7679 pending_rounds.cc:107] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260501 14:00:56.320369  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:56.320878  7679 raft_consensus.cc:2889] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:56.321120  7754 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:00:56.321327  7679 pending_rounds.cc:107] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260501 14:00:56.321640  7679 raft_consensus.cc:2889] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:56.320230  7677 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:56.322747  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.269171  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.274520 13225 raft_consensus.cc:3060] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:56.323426  7677 raft_consensus.cc:3060] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.328253  7672 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:56.329246  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.329845  7672 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 10.
I20260501 14:00:56.330611  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.331606 13113 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.332206 13113 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.334414 13113 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:56.331292  7672 raft_consensus.cc:2393] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:56.335642  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.339048  7672 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:00:56.339751  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.275056 13065 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.279750  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.341106  7676 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:56.217068 13205 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:56.280229  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.342207  7673 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:56.282087  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.212554 13232 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:56.312286  7671 raft_consensus.cc:3060] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:56.343132  7670 raft_consensus.cc:3060] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 8 FOLLOWER]: Advancing to term 9
I20260501 14:00:56.343289 13232 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.345599 13232 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.348627 13065 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.351024  7670 raft_consensus.cc:2468] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 9.
I20260501 14:00:56.364460  7678 raft_consensus.cc:2468] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:56.368820  7754 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:00:56.225099 13228 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.378892  7674 raft_consensus.cc:2468] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:56.382129  7677 raft_consensus.cc:2468] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:56.382982  7675 raft_consensus.cc:2468] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:56.355280  7671 raft_consensus.cc:2468] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:00:56.401866  8371 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 19: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
W20260501 14:00:56.406802  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.054s (SENT)
I20260501 14:00:56.407472  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:56.355707 13252 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.365499 12988 raft_consensus.cc:697] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.420668  7751 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:00:56.420939  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:56.372753  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260501 14:00:56.421819  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 254716us
I20260501 14:00:56.426381  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.429941  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:56.430546  8372 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:56.438330  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.439016  7671 raft_consensus.cc:3060] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.404090 13267 raft_consensus.cc:697] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:56.444276  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.448833  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:56.449594  8373 raft_consensus.cc:2368] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:56.410095 13269 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:56.373944 13203 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.406961 13228 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.463279  8372 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:56.428460 13177 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:56.463311  7671 raft_consensus.cc:2468] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:56.467554  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.458317 13262 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.464247  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.370179 13167 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.446791 13123 raft_consensus.cc:697] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.420447 13135 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.418653 13252 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.493748 13205 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260501 14:00:56.511225  7675 raft_consensus.cc:3060] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:56.514569 13228 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.518748  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:56.521242  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.478349 13268 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
W20260501 14:00:56.536170  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.527750  7671 raft_consensus.cc:2376] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13. Re-sending same reply.
I20260501 14:00:56.538127  7821 raft_consensus.cc:2468] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:56.541097  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:56.541181 13123 consensus_queue.cc:237] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.543275 13135 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:56.543980 12988 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.545696 13168 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:56.546276 13168 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:56.554683  7675 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:56.555985  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:56.556874  7821 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:56.546808 13168 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:56.465117 13269 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:56.565636  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.565356  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.568979  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.570102  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.572669  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:56.574651  8372 raft_consensus.cc:1240] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:56.577714  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:56.578297  7671 raft_consensus.cc:3060] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 15
I20260501 14:00:56.575695  8373 raft_consensus.cc:1240] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 13. Current term is 14. Ops: []
I20260501 14:00:56.578969  7821 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:00:56.576079  8379 raft_consensus.cc:1240] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:56.586139  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:56.586690  7792 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.586984  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:56.587791  7792 leader_election.cc:400] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:56.589529  7792 leader_election.cc:400] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:56.589815  7792 leader_election.cc:403] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260501 14:00:56.590207 13135 raft_consensus.cc:2804] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:56.590520  7792 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.590796 13135 raft_consensus.cc:697] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.591508  8344 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:56.591987  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:56.591912 13135 consensus_queue.cc:237] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.593080  8376 raft_consensus.cc:2393] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:56.594023 13142 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
I20260501 14:00:56.594889 13142 raft_consensus.cc:2804] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:56.595408 13142 raft_consensus.cc:697] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.597360 13268 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.587019  7821 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 14: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:56.538545 13167 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.601130  7675 raft_consensus.cc:3060] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 14
W20260501 14:00:56.608397  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.059s (SENT)
I20260501 14:00:56.608933  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:56.612068  7671 raft_consensus.cc:2468] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
W20260501 14:00:56.616180  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.616717  7792 leader_election.cc:400] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 11. Current term is 12.
W20260501 14:00:56.579226 13247 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260501 14:00:56.628262  8345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.629742  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:56.579913 13228 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.632388  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:56.610056 13249 log.cc:927] Time spent T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260501 14:00:56.634441  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:56.635591  7753 raft_consensus.cc:3060] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:56.640707  7751 raft_consensus.cc:3060] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.638499  7792 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.640534  7675 raft_consensus.cc:2468] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:56.633785  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:56.642074  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.642743  7828 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:56.617313 13124 raft_consensus.cc:2804] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:56.617291 13261 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.616899 13136 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:56.657799  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.522485 13262 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:56.639180 13187 consensus_meta.cc:287] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260501 14:00:56.659906  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:56.634372 13256 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260501 14:00:56.654597 13028 raft_consensus.cc:2804] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
W20260501 14:00:56.681890  8374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.013s	sys 0.009s
W20260501 14:00:56.682406  8374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.013s	sys 0.010s
I20260501 14:00:56.561349 13267 consensus_queue.cc:237] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:56.712620 13279 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260501 14:00:56.664134  7751 raft_consensus.cc:2468] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:56.665171 13261 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.666380 13187 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.652434 13228 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.664642 13124 raft_consensus.cc:697] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:00:56.730031  7753 raft_consensus.cc:2468] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:00:56.734104  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:56.745626  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 103341us
I20260501 14:00:56.746057  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.748075  7819 raft_consensus.cc:2393] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:56.750262  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.756064  7574 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:56.757849 13187 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:56.758478  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:56.672704 13142 consensus_queue.cc:237] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.764006  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:56.724609 13028 raft_consensus.cc:697] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.779309  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:56.769855 13252 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:56.787011 13127 consensus_meta.cc:287] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.004s
I20260501 14:00:56.799329  8375 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:56.800451 13261 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:56.801513 13269 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:56.805725 13124 consensus_queue.cc:237] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.809298 13228 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:56.821435 13262 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:56.824100 13178 consensus_queue.cc:1048] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:56.825371 13028 consensus_queue.cc:237] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:56.815546 13207 consensus_meta.cc:287] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260501 14:00:56.831350  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:56.823235 13262 consensus_queue.cc:1048] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:56.841305  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:56.844511  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 117804us
W20260501 14:00:56.845247  7718 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.822s (SENT)
W20260501 14:00:56.846071  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 93401us
W20260501 14:00:56.846246  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.833s (SENT)
I20260501 14:00:56.846664  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:56.852808  8374 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [9.10-11.11]
W20260501 14:00:56.837764 13221 consensus_meta.cc:287] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.001s
I20260501 14:00:56.854913  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:56.858242  8371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51744 (request call id 1382) took 1021 ms. Trace:
I20260501 14:00:56.858429  8381 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260501 14:00:56.858669  8371 rpcz_store.cc:276] 0501 14:00:55.836668 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:55.836839 (+   171us) service_pool.cc:224] Handling call
0501 14:00:56.858008 (+1021169us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54005901d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:56.858175 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296417152}
W20260501 14:00:56.861486  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.861038  7792 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.863987  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:56.864704  8371 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:56.828598 13127 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.874462  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:56.897094 13203 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:56.901163  7792 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.901784 13221 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260501 14:00:56.902230 12988 raft_consensus.cc:2804] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:56.909648 12988 raft_consensus.cc:697] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.910677 12988 consensus_queue.cc:237] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.904847 13127 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:56.905530  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:56.860567 13260 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:56.913933 13292 raft_consensus.cc:2804] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:00:56.914487 13292 raft_consensus.cc:697] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:56.915391 13292 consensus_queue.cc:237] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:56.922488  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.898s (SENT)
I20260501 14:00:56.928088  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:56.928997  7747 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
W20260501 14:00:56.929077  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 52478.8us
I20260501 14:00:56.931720  8380 raft_consensus.cc:2468] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:00:56.934507  8372 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:00:56.936172  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262547d9184416ab702339797bead6f"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:56.936851  7824 raft_consensus.cc:606] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:56.943329  7828 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:00:56.947446  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:56.948901  8371 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
W20260501 14:00:56.953511  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.017s (SENT)
I20260501 14:00:56.956172  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:56.915454 13168 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:56.960919  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:56.971863  7792 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.984711 13269 raft_consensus.cc:2804] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:56.985364 13269 raft_consensus.cc:697] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:56.986480  7718 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.059s (SENT)
I20260501 14:00:56.986393 13269 consensus_queue.cc:237] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:56.971379 13203 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:56.988591  7824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:56.989254  7824 raft_consensus.cc:606] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:56.990142 13167 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:56.997903 13205 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:00:56.999540  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:56.969707 13000 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:00:57.000329 13293 log.cc:927] Time spent T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
W20260501 14:00:57.002137  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:57.002717  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.572s (SENT)
I20260501 14:00:57.003068  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.003683  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:57.005893  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.593s (SENT)
W20260501 14:00:57.006608  7718 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.601s (SENT)
I20260501 14:00:57.006981  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:57.007557  7718 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.669s (SENT)
I20260501 14:00:57.011916  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:57.012042 13267 consensus_queue.cc:1059] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:57.012454 13221 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:57.013041 13000 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:00:57.008209  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:57.014668  8372 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 15.
W20260501 14:00:57.013062  7718 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.700s (SENT)
I20260501 14:00:57.008016  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:57.017127  7753 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:57.018913  7819 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19.
I20260501 14:00:57.016791  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.019199  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:57.020023  8372 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:57.018395  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.021198 13302 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Advancing to term 19
W20260501 14:00:57.023782  7718 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.811s (SENT)
I20260501 14:00:57.023978  8381 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:00:57.023998 13000 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:57.018460 13203 raft_consensus.cc:3055] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:57.009052 13082 consensus_queue.cc:1048] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260501 14:00:57.025295 13203 raft_consensus.cc:740] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:57.016494 13135 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:00:57.028263 13135 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:57.028501 13203 consensus_queue.cc:260] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.031271 13268 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:56.990715 13167 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.031880 13268 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.033576 13167 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.033717  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:57.033977 13268 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:57.034360  7827 raft_consensus.cc:606] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:57.035003  7643 connection.cc:254] RPC call timeout handler was delayed by -1.2141070760000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260501 14:00:57.035543  7642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.040009 13294 raft_consensus.cc:993] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: : Instructing follower bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:57.040681 13294 raft_consensus.cc:1081] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Signalling peer bc1b0a0a152e46fea4bd4934ba9976ed to start an election
I20260501 14:00:57.039939  7574 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 13 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 15 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:57.042060  7574 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:57.017935 13124 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:00:57.049335  8371 raft_consensus.cc:1275] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260501 14:00:57.049911  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.025970  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.043536  7574 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:57.053943  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:57.047772 13135 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:57.054600  8371 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:57.055485  7827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:57.056571  7827 raft_consensus.cc:606] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:57.060724  7719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:57.070590  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 46829.6us
W20260501 14:00:57.072889  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.980s (SENT)
I20260501 14:00:57.073393  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.081045  8371 raft_consensus.cc:2468] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:57.068568 13268 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.082404 13268 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.083676 13265 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:57.084578 13268 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.085384 13302 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260501 14:00:57.085718  7718 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.026s (SENT)
I20260501 14:00:57.085492  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 14, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:57.086302  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.087033 13000 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:57.087289  7574 catalog_manager.cc:5671] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:00:57.089298  7718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.089166  7574 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 12, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 12 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:00:57.035512  7643 connection.cc:254] RPC call timeout handler was delayed by -1.0296070760000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260501 14:00:57.093861  7643 connection.cc:254] RPC call timeout handler was delayed by -1.0296070760000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260501 14:00:57.094300  7643 connection.cc:254] RPC call timeout handler was delayed by -1.0062070760000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260501 14:00:57.095289  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.096154 13228 consensus_queue.cc:1059] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:57.097005 13228 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:57.097249 13000 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260501 14:00:57.097640 13228 raft_consensus.cc:3055] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:00:57.098024 13228 raft_consensus.cc:740] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:57.098232 13168 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.098295 13114 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Stepping down as leader of term 18
I20260501 14:00:57.099632 13133 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.099915 13114 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:57.100231 13133 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.100754  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.100905 13114 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.102312 13133 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.102403 13114 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:00:57.102870 13133 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:00:57.099287 13228 consensus_queue.cc:260] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.104514 13228 raft_consensus.cc:3060] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:57.104483  8372 raft_consensus.cc:2468] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:57.055429 13167 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:00:57.108084  7577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 304) took 23573 ms (client timeout 15000 ms). Trace:
I20260501 14:00:57.110275 13000 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260501 14:00:57.120836  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "109c9ba263c34ff8aee17bc446cf258e"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:57.121727  7819 raft_consensus.cc:606] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Received request to transfer leadership to TS 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:57.122159  7819 raft_consensus.cc:614] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:57.115795 13065 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:57.148918  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.150681  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.152423  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 14:00:57.155054  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:00:57.157615  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:57.116330 13168 consensus_queue.cc:1048] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260501 14:00:57.128620 13252 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:00:57.111361  7577 rpcz_store.cc:269] 0501 14:00:33.507043 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:33.531943 (+ 24900us) service_pool.cc:224] Handling call
0501 14:00:33.653914 (+121971us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54000429d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64b470 00007fb2fa6ea31a 00007fb30048d46c 00007fb3005873ee 00007fb2fea6d4a4 00007fb2fea6d432 00007fb2fea6d361 00007fb2fea6d2dc 00007fb2fea6c592 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:00:57.080667 (+23426753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:55.679558 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:55.781117 (+101559us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:55.783432 (+  2315us) write_op.cc:435] Acquired schema lock
0501 14:00:55.785959 (+  2527us) tablet.cc:662] Decoding operations
0501 14:00:55.828120 (+ 42161us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:55.838777 (+ 10657us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:55.845016 (+  6239us) tablet.cc:685] Acquiring locks for 2 operations
0501 14:00:55.936241 (+ 91225us) tablet.cc:701] Row locks acquired
0501 14:00:55.936268 (+    27us) write_op.cc:260] PREPARE: finished
0501 14:00:55.936489 (+   221us) write_op.cc:270] Start()
0501 14:00:55.936630 (+   141us) write_op.cc:276] Timestamp: P: 1777644055936428 usec, L: 0
0501 14:00:55.936653 (+    23us) op_driver.cc:348] REPLICATION: starting
0501 14:00:55.937416 (+   763us) log.cc:844] Serialized 918 byte log entry
0501 14:00:56.075336 (+137920us) op_driver.cc:464] REPLICATION: finished
0501 14:00:56.257138 (+181802us) write_op.cc:301] APPLY: starting
0501 14:00:56.257253 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0501 14:00:56.259055 (+  1802us) tablet.cc:1370] finished BulkCheckPresence
0501 14:00:56.259166 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:00:56.309546 (+ 50380us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:00:56.310228 (+   682us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0501 14:00:56.310364 (+   136us) write_op.cc:312] APPLY: finished
0501 14:00:56.311691 (+  1327us) log.cc:844] Serialized 33 byte log entry
0501 14:00:56.312386 (+   695us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:56.312679 (+   293us) write_op.cc:454] Released schema lock
0501 14:00:56.312813 (+   134us) write_op.cc:341] FINISH: Updating metrics
0501 14:00:56.315886 (+  3073us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:00:56.316002 (+   116us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14701,"reported_tablets":36,"spinlock_wait_cycles":164491648,"child_traces":[["op",{"apply.queue_time_us":155305,"apply.run_cpu_time_us":5804,"apply.run_wall_time_us":57541,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":198687,"prepare.run_cpu_time_us":4866,"prepare.run_wall_time_us":258173,"replication_time_us":138499,"thread_start_us":269667,"threads_started":2}]]}
I20260501 14:00:57.167270  7574 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 5 to 8, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 8 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:00:57.180588  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 168893us
I20260501 14:00:57.181562  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:57.187785  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:57.189172  7645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.190420  7574 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:57.195405  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.163688 13065 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:57.203042  7793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.202241  7574 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:57.175616 13167 consensus_queue.cc:1048] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260501 14:00:57.181406 13265 consensus_queue.cc:1048] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260501 14:00:57.199733 13292 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:57.208050  7574 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 13 to 16, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 16 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:00:57.200420 13127 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260501 14:00:57.205876  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.184267 13252 consensus_queue.cc:1059] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260501 14:00:57.216092  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 112057us
W20260501 14:00:57.216802  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.731s (SENT)
I20260501 14:00:57.217242  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.217935  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:57.218568 13287 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:57.219504 13028 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:57.220479 13178 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:00:57.200425 13260 consensus_queue.cc:1048] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260501 14:00:57.198868 13000 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260501 14:00:57.209962 13292 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:57.207057 13232 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:00:57.200846 13133 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260501 14:00:57.226263  7792 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:57.228991  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.228571  7574 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 6 to 10, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 10 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:57.230203  7574 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 8 to 10, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:00:57.232087  7574 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 7 to 10, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:00:57.233631  8344 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.675s (SENT)
I20260501 14:00:57.216398 13225 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:57.214169 13221 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:57.247308  7792 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:57.235518 13292 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
W20260501 14:00:57.248811  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 82038.1us
I20260501 14:00:57.236892 13225 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:57.249963 13282 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:00:57.256309  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:57.245069 13261 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:00:57.257736  8372 raft_consensus.cc:1275] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260501 14:00:57.261686  7753 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260501 14:00:57.262126  8372 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:57.262915 13203 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:57.250349 13232 raft_consensus.cc:2804] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:57.249341 13313 raft_consensus.cc:2804] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:00:57.259316 13261 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:57.265898 13321 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:00:57.252153 13225 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:57.271145  7792 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.257274 13268 consensus_queue.cc:1059] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260501 14:00:57.275496 13065 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:00:57.276342 13317 log.cc:927] Time spent T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260501 14:00:57.280877 13282 consensus_queue.cc:1059] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:57.284034 13232 raft_consensus.cc:697] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:57.293326 13313 raft_consensus.cc:697] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:00:57.296391 13312 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260501 14:00:57.297065 13313 consensus_queue.cc:237] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.289961 13261 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:00:57.295588  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.297009 13232 consensus_queue.cc:237] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.290711 13321 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:57.309996  7754 raft_consensus.cc:1275] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:57.312716  7753 raft_consensus.cc:1275] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260501 14:00:57.313712  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.317884 13321 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:57.320066 13065 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:57.320719  7747 raft_consensus.cc:1275] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:57.322378 13267 consensus_queue.cc:1048] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:00:57.258630 13252 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260501 14:00:57.325259 13287 raft_consensus.cc:3055] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Stepping down as leader of term 13
W20260501 14:00:57.332520  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 103791us
I20260501 14:00:57.334321  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:57.334525  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:57.295512 13269 raft_consensus.cc:2804] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:57.335202  7819 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:57.335963  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:00:57.330271 13268 raft_consensus.cc:3055] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Stepping down as leader of term 9
I20260501 14:00:57.349659  7747 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260501 14:00:57.354733  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:57.332307 13287 raft_consensus.cc:740] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:57.368674  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:57.371318  7718 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.508s (SENT)
I20260501 14:00:57.384754  7827 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:57.347020 13269 raft_consensus.cc:697] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:57.336977 13082 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260501 14:00:57.387876  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.818s (SENT)
I20260501 14:00:57.363039 13114 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.357092 13268 raft_consensus.cc:740] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:57.393594  7718 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:57.348920 13233 consensus_queue.cc:1048] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260501 14:00:57.348089 13135 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.410825  7718 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:00:57.365751 13142 consensus_queue.cc:1048] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260501 14:00:57.415306  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 79448.7us
I20260501 14:00:57.416113  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.396363 13228 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:57.424013  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:57.436326  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 50533.2us
W20260501 14:00:57.438431  8344 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.666s (SENT)
I20260501 14:00:57.390017 13123 consensus_queue.cc:1048] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260501 14:00:57.421226 13000 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:57.453852  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.395416 13114 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.413535 13207 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260501 14:00:57.427220 13167 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:57.419245 13322 raft_consensus.cc:2804] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:57.432415 13282 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:57.441672 13133 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:57.415298 13292 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.462191 13167 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:57.476938  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.472242  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.421622 13287 consensus_queue.cc:260] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:57.502750  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.468870 13228 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:57.467168 13133 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:57.465832 13282 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:00:57.510897  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 44426.2us
W20260501 14:00:57.509446  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.471776 13000 raft_consensus.cc:697] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:57.482810 13167 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:57.515920  7824 raft_consensus.cc:1240] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 15. Current term is 16. Ops: []
I20260501 14:00:57.499785 13329 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:57.456459 13269 consensus_queue.cc:237] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.444967 13268 consensus_queue.cc:260] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.528250 13261 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.506345 13322 raft_consensus.cc:697] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:57.530254 13322 consensus_queue.cc:237] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.531054 13325 consensus_queue.cc:1059] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:00:57.528697 13268 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Advancing to term 10
W20260501 14:00:57.534492  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 171238us
I20260501 14:00:57.531989 13257 raft_consensus.cc:3055] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:57.514043 13133 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:57.536911 13257 raft_consensus.cc:740] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:57.537849 13257 consensus_queue.cc:260] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.538661 13332 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.513348 13282 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:57.539172 13257 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:57.539268 13332 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.541841 13332 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.548712 13135 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:57.550369  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:57.551442 13329 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:00:57.553508 13000 consensus_queue.cc:237] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.555162 13292 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:57.555459 13323 raft_consensus.cc:3055] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:00:57.555914 13323 raft_consensus.cc:740] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:57.556842 13287 raft_consensus.cc:3060] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:57.556764 13323 consensus_queue.cc:260] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.557953  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.560128  7819 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:57.564606  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:57.565086  7718 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:57.566084  7718 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.504s (SENT)
I20260501 14:00:57.567389  7747 raft_consensus.cc:2410] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260501 14:00:57.568926  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:57.569500  7828 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:00:57.570394  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:57.571203  7754 raft_consensus.cc:1275] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260501 14:00:57.577353  8374 raft_consensus.cc:1275] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260501 14:00:57.531622 13326 consensus_queue.cc:1175] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "91854d93e96c4756834efe8b2ef59fce" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260501 14:00:57.571574  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:57.580402  7753 raft_consensus.cc:1275] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:57.567062 13265 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:57.589511 13114 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.589330 13321 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.553510 13261 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.598145  8374 raft_consensus.cc:1275] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260501 14:00:57.586822  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.605207  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:57.606950  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:00:57.638388  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:00:57.617599  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:57.574138 13329 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.590514 13323 raft_consensus.cc:3060] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:57.621884 13302 consensus_queue.cc:1048] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:00:57.573904 13252 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260501 14:00:57.640705  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 53967.8us
I20260501 14:00:57.641111  7753 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:00:57.604882 13187 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.607662 13228 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:00:57.654728  8344 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.084s (SENT)
I20260501 14:00:57.655588  7819 raft_consensus.cc:1275] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260501 14:00:57.655539  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:57.657568 13252 raft_consensus.cc:2804] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:00:57.657451 13334 consensus_queue.cc:1059] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260501 14:00:57.691537 13252 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:57.648319 13178 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:00:57.691968 13334 raft_consensus.cc:3055] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Stepping down as leader of term 15
I20260501 14:00:57.692226 13252 raft_consensus.cc:3060] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:57.692502 13334 raft_consensus.cc:740] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:00:57.693475 13334 consensus_queue.cc:260] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.684805 13187 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.694855 13334 raft_consensus.cc:3060] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:00:57.696724 13187 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.698050  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:57.698280 13225 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.698889  7819 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:57.700186  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.652256 13329 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.659327 13321 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:57.664063 13328 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:00:57.664408 13338 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:57.668813 13133 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.671067 13282 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.673738  7828 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 20.
I20260501 14:00:57.676662 13261 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:57.631723 13265 raft_consensus.cc:697] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:57.706851  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
W20260501 14:00:57.708494  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53815.6us
I20260501 14:00:57.741472 13265 consensus_queue.cc:237] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.719305  7753 raft_consensus.cc:2468] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 12.
I20260501 14:00:57.715154 13178 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:00:57.707279 13187 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:00:57.746016 13187 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:57.746528 13187 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:57.752627 13261 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.754952 13261 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:57.760329  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.762589  7752 raft_consensus.cc:1275] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260501 14:00:57.765798 13328 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:57.766502 13328 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.768784 13328 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.769209 13330 consensus_queue.cc:1048] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:00:57.770854 13337 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260501 14:00:57.772765 13330 consensus_queue.cc:1048] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260501 14:00:57.724201 13225 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:57.724761  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.725656  7718 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.728037 13282 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.728986 13338 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:57.731421 13133 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:57.733512 13167 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.801785  7792 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.734620 13329 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:00:57.775852  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.174s (SENT)
I20260501 14:00:57.796631  7748 raft_consensus.cc:2468] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
W20260501 14:00:57.795886  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 70284.1us
I20260501 14:00:57.820875  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:00:57.825870  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 50098.4us
W20260501 14:00:57.827647  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.772s (SENT)
I20260501 14:00:57.831301  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:57.832329  7819 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:00:57.832828  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:57.833654  7828 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
W20260501 14:00:57.837247  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 198984us
I20260501 14:00:57.840690  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.842402  7671 raft_consensus.cc:1240] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 8. Current term is 9. Ops: []
I20260501 14:00:57.844022  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.844741  7671 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:57.845755  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.846395  7679 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:57.848343  7679 raft_consensus.cc:1240] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 10. Current term is 11. Ops: []
I20260501 14:00:57.851003  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.851747  7677 raft_consensus.cc:2368] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 13. Current term is 14.
I20260501 14:00:57.852334  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.852653  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.853302  7670 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:00:57.853453  7674 raft_consensus.cc:2368] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 13. Current term is 14.
I20260501 14:00:57.854482  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.855209  7678 raft_consensus.cc:3060] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:00:57.855088  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.856715  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.857304  7677 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:57.872260  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.873008  7671 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 10.
I20260501 14:00:57.874493  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.875260  7671 raft_consensus.cc:2468] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:57.825181 13225 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:00:57.881316  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.883453  7828 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:00:57.883664  7674 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:57.888033  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.828549 13302 raft_consensus.cc:2804] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:00:57.892406  7678 raft_consensus.cc:2468] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:00:57.893831  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.836578 13224 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:00:57.897107  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:57.900791  7753 raft_consensus.cc:1275] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260501 14:00:57.900729  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.901656  7674 raft_consensus.cc:2393] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:57.903291  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.904356  7678 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:57.871140 13282 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:57.917631  7718 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:57.929476  7819 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:57.929786  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:57.930752  7671 raft_consensus.cc:2468] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:57.972961  7678 raft_consensus.cc:1275] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:00:57.973384  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.981127  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:57.994280  7821 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 11.
W20260501 14:00:57.995133  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 67718.4us
W20260501 14:00:57.980865  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 132827us
I20260501 14:00:57.983718  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:57.997614  7673 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:57.871691 13123 consensus_queue.cc:1048] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260501 14:00:57.912941 13225 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:57.991477  7670 raft_consensus.cc:2468] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 15.
I20260501 14:00:57.926846 13302 raft_consensus.cc:697] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:58.056809  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:58.057579  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:58.058226  7670 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260501 14:00:57.919903 13233 consensus_queue.cc:1048] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260501 14:00:57.928599 13282 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:57.930434 13313 consensus_queue.cc:1048] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260501 14:00:58.081867 13282 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:00:58.083626 13344 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260501 14:00:58.087999 13289 raft_consensus.cc:2804] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:58.088227 13225 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.094120 13187 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.064059 13331 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:58.101209  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 90600.9us
W20260501 14:00:58.100597  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260501 14:00:58.088304 13335 log.cc:927] Time spent T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260501 14:00:58.061484 13207 consensus_queue.cc:1048] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260501 14:00:58.178356  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 59485.2us
W20260501 14:00:58.188001 13346 log.cc:927] Time spent T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260501 14:00:58.191169  7718 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:58.117777 13289 raft_consensus.cc:697] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:58.195509  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:58.121814 13252 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:58.178248 13331 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:58.239965  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 185096us
I20260501 14:00:58.208025 13187 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:58.207728 13000 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:00:58.242369  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.242835 13000 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:58.243194  7673 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:00:58.243302 13000 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:00:58.208362 13349 log.cc:927] Time spent T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260501 14:00:58.221110 13336 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.598s	user 0.002s	sys 0.000s
I20260501 14:00:58.247594  8372 raft_consensus.cc:1275] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260501 14:00:58.248009  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:58.252943  8371 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 12.
I20260501 14:00:58.199364 13322 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
W20260501 14:00:58.253114  7718 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.943s (SENT)
I20260501 14:00:58.257275  7675 raft_consensus.cc:2368] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for earlier term 15. Current term is 16.
W20260501 14:00:58.258273  7718 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.018s (SENT)
I20260501 14:00:58.236621 13338 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:58.264729  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
W20260501 14:00:58.259564  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.043s (SENT)
I20260501 14:00:58.202170 13167 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:58.265754  7821 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:58.271672  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:00:58.310388 13331 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:58.272434 13322 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:58.320847  7821 raft_consensus.cc:2468] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:00:58.208760 13302 consensus_queue.cc:237] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.293924 13326 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:58.328547  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.344374  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:58.350068  7671 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:00:58.348619  8381 raft_consensus.cc:1275] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260501 14:00:58.348835  8380 raft_consensus.cc:1275] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
W20260501 14:00:58.360550  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:58.360483  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.473928  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.475109  7673 raft_consensus.cc:2393] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 12: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:00:58.504345  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:58.517918  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:58.518950  8381 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:00:58.525233  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.525609  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.526060  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.528117  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:58.529667  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.530426  7673 raft_consensus.cc:2393] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 14: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:58.528172  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:58.533281 13345 log.cc:927] Time spent T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
W20260501 14:00:58.534294 13358 log.cc:927] Time spent T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260501 14:00:58.534439  7672 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10.
W20260501 14:00:58.536780  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:58.557904  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.559150  7676 raft_consensus.cc:2368] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13.
W20260501 14:00:58.638140  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:58.317271 13289 consensus_queue.cc:237] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.514008 13269 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:58.667889  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.669062  7676 raft_consensus.cc:2376] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13. Re-sending same reply.
I20260501 14:00:58.480620 13326 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.683398  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:58.687182  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 362717us
I20260501 14:00:58.690407  7671 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:58.508795 13322 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.695689  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "294b76c5890f455f97130fdbedace9af"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
W20260501 14:00:58.695861  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.635s (SENT)
I20260501 14:00:58.696393  7819 raft_consensus.cc:606] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:58.696740  7819 raft_consensus.cc:614] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260501 14:00:58.697129  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.099s (SENT)
I20260501 14:00:58.698660 13326 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:58.698793  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:58.700343  7821 raft_consensus.cc:3060] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:00:58.686862 13252 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:58.712788  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.714860  7674 raft_consensus.cc:2368] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15.
I20260501 14:00:58.684161 13269 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:58.718957 13350 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:58.728329 13350 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:58.732620 13269 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:58.732961 13350 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:58.735918  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.738538  7676 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260501 14:00:58.738430  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.739624  7679 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260501 14:00:58.753288  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.754209  7679 raft_consensus.cc:2376] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15. Re-sending same reply.
I20260501 14:00:58.758270  7671 raft_consensus.cc:1275] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:00:58.783687  7677 raft_consensus.cc:2468] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:00:58.711341  7821 raft_consensus.cc:2468] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:00:58.789948  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:58.790863  7819 raft_consensus.cc:606] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:58.794487  7673 raft_consensus.cc:1240] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260501 14:00:58.746271 13000 consensus_meta.cc:287] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260501 14:00:58.788329 13371 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:58.821321  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.823210  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.826674  7670 raft_consensus.cc:1240] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:58.828553 13368 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260501 14:00:58.830843  7792 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.048s	sys 0.068s
W20260501 14:00:58.831264  7792 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.048s	sys 0.068s
I20260501 14:00:58.831488  7674 raft_consensus.cc:2468] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
W20260501 14:00:58.832078  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 569207us
I20260501 14:00:58.814863 13350 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:58.834980  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.850865 13207 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:58.851289  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47951612b03c496aa487574a115ca380"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:58.852491  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.853067  7819 raft_consensus.cc:606] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:58.853364  7673 raft_consensus.cc:2468] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:00:58.853600  7819 raft_consensus.cc:614] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260501 14:00:58.855544  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.856599  7674 raft_consensus.cc:2393] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 16: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:00:58.855095  7792 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:58.859113  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.817951 13000 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:58.859972  7677 raft_consensus.cc:2376] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13. Re-sending same reply.
I20260501 14:00:58.866588  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:58.867975  7671 raft_consensus.cc:2410] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260501 14:00:58.867781  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:58.868642  7674 raft_consensus.cc:2376] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16. Re-sending same reply.
W20260501 14:00:58.950352  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:58.851558 13207 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.026360  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:59.041322  7674 raft_consensus.cc:2376] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 10. Re-sending same reply.
I20260501 14:00:59.039772  7673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:59.043193  7673 raft_consensus.cc:2376] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15. Re-sending same reply.
I20260501 14:00:59.040174  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:59.044303  7677 raft_consensus.cc:2376] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14. Re-sending same reply.
W20260501 14:00:58.860370 13205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.004s	sys 0.021s
I20260501 14:00:59.049468  7751 raft_consensus.cc:2368] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13.
I20260501 14:00:58.830169 13371 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:58.862294 13232 raft_consensus.cc:2804] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:00:58.847298 13350 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:59.049801 13205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.004s	sys 0.022s
I20260501 14:00:59.060127  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
I20260501 14:00:59.049288 13360 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.046293 13365 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.066646  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
I20260501 14:00:59.067521  7674 raft_consensus.cc:2468] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:00:59.061012  7677 raft_consensus.cc:2376] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16. Re-sending same reply.
W20260501 14:00:59.062876  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 553978us
I20260501 14:00:59.063900  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:59.070785  7819 raft_consensus.cc:606] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.073104 13350 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.065382 13360 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.073904  7819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6"
dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
mode: GRACEFUL
new_leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed"
 from {username='slave'} at 127.0.0.1:59004
I20260501 14:00:59.074483  7819 raft_consensus.cc:606] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Received request to transfer leadership to TS bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.075495 13360 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.066030 13365 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.076673  7673 raft_consensus.cc:1275] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260501 14:00:59.077020  7673 pending_rounds.cc:85] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting all ops after (but not including) 10
I20260501 14:00:59.077250  7673 pending_rounds.cc:107] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260501 14:00:59.077484  7673 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:00:59.078156 13365 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:432: Failure
Failed
Bad status: Remote error: Service unavailable: leadership transfer for b217e36f6e5e4fc38ba6e4ad89082fc6 already in progress
I20260501 14:00:59.079061  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
I20260501 14:00:59.079061  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" is_pre_election: true
W20260501 14:00:59.080014  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.936s (SENT)
I20260501 14:00:59.083684  7674 raft_consensus.cc:1275] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260501 14:00:59.086184  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 373626us
I20260501 14:00:59.082455 13350 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.096071  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.082993 13365 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.087633 13325 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:00:59.100121  7753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.009s	sys 0.022s
W20260501 14:00:59.105121  7753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.009s	sys 0.023s
I20260501 14:00:59.107604 13000 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.108347 13000 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.097323 13350 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:59.109294  7720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.126971 13207 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.099696 13365 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.153156  7717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.104365 13325 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:00:59.170197  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 308613us
I20260501 14:00:59.170472 13383 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:00:59.176071 13343 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.187s	user 0.010s	sys 0.012s
I20260501 14:00:59.196152 13397 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.196924 13397 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.198698 13403 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.199393 13397 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.168601 13371 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.183517 13252 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.146461 13000 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.184333 13232 raft_consensus.cc:697] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:00:59.214629 13332 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.234212  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 148475us
I20260501 14:00:59.216734 13395 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.187927 13383 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.260797  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 172966us
I20260501 14:00:59.232355 13384 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:59.272833  7718 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:59.276124 13350 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.224002 13252 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.285744  7792 connection.cc:254] RPC call timeout handler was delayed by -1.0361570879999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260501 14:00:59.218353 13403 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.297120  7718 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:00:59.295192  7792 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.674s (SENT)
W20260501 14:00:59.273723 13375 log.cc:927] Time spent T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260501 14:00:59.296868  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.307667 13394 consensus_queue.cc:1048] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:00:59.308233 13142 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.308884 13142 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.309945 13386 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.310501 13386 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.296785 13351 log.cc:927] Time spent T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 1.296s	user 0.006s	sys 0.014s
W20260501 14:00:59.311890 13366 log.cc:927] Time spent T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.495s	user 0.000s	sys 0.011s
I20260501 14:00:59.290944 13384 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.312132 13393 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.313139  7746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3623) took 1669 ms. Trace:
I20260501 14:00:59.313030 13393 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.314118 13384 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.244187 13332 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.315320 13393 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.316246  7752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60274 (request call id 3630) took 1431 ms. Trace:
I20260501 14:00:59.313553  7746 rpcz_store.cc:276] 0501 14:00:57.643429 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:57.643650 (+   221us) service_pool.cc:224] Handling call
0501 14:00:57.680439 (+ 36789us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:57.680858 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:57.680894 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:57.681421 (+   527us) log.cc:844] Serialized 26 byte log entry
0501 14:00:57.839745 (+158324us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:57.839785 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:57.839876 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.183835 (+1343959us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:59.312791 (+128956us) raft_consensus.cc:1685] finished
0501 14:00:59.312817 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.313053 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3686,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6515,"spinlock_wait_cycles":126639488,"thread_start_us":158011,"threads_started":1,"wal-append.queue_time_us":238736}
I20260501 14:00:59.316901 13386 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.316663  7752 rpcz_store.cc:276] 0501 14:00:57.884701 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:57.885446 (+   745us) service_pool.cc:224] Handling call
0501 14:00:57.919019 (+ 33573us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:58.075221 (+156202us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:58.075301 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:58.113084 (+ 37783us) log.cc:844] Serialized 26 byte log entry
0501 14:00:58.518084 (+405000us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:58.518126 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:58.518191 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.311265 (+793074us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:59.315898 (+  4633us) raft_consensus.cc:1685] finished
0501 14:00:59.315927 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.316178 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168089,"raft.queue_time_us":155498,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3864,"spinlock_wait_cycles":86869888,"thread_start_us":316504,"threads_started":1,"wal-append.queue_time_us":555544}
I20260501 14:00:59.318172 13332 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.319698 13393 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.320369 13365 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.322958  7824 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:00:59.323702  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.324154  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.324183  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.325104  7828 raft_consensus.cc:2393] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 17: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:59.325470  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:59.326056  7821 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Advancing to term 13
I20260501 14:00:59.325824  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.326701  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.326825  7827 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19.
I20260501 14:00:59.328183  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.328823  8381 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: []
I20260501 14:00:59.328985 13000 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.329628  7746 raft_consensus.cc:1240] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260501 14:00:59.330104  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:59.328186  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.320375 13393 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.332157  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:59.333819 13378 log.cc:927] Time spent T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.211s	user 0.004s	sys 0.004s
I20260501 14:00:59.335150 13393 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.335853 13350 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.336024 13385 consensus_queue.cc:1048] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:00:59.336422 13350 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.251788 13395 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.338469 13350 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.339200 13385 consensus_queue.cc:1048] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:00:59.341204 13252 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.298332 13232 consensus_queue.cc:237] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.367715  7675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46596 (request call id 890) took 1508 ms. Trace:
I20260501 14:00:59.297188 13127 raft_consensus.cc:2804] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:59.373116  8375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1410) took 1026 ms. Trace:
W20260501 14:00:59.373395  7718 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.543s (SENT)
W20260501 14:00:59.375104  7718 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.037s (SENT)
I20260501 14:00:59.368432  7675 rpcz_store.cc:276] 0501 14:00:57.840269 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:57.840430 (+   161us) service_pool.cc:224] Handling call
0501 14:00:59.347866 (+1507436us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540004c9d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:59.348095 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955914496}
I20260501 14:00:59.386457  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.387863  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.400072  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:59.400818  8380 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:59.402855  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:59.402891  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:59.403887  7746 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:00:59.306752 13205 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.410069  7823 raft_consensus.cc:1275] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:00:59.348951 13289 raft_consensus.cc:2804] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election won for term 17
I20260501 14:00:59.398034 13350 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.414322 13350 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.415674 13205 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.416815 13350 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.417799 13205 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.419808 13142 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.421185  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:59.422820  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.407716  7821 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:00:59.434352  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:00:59.435268  8371 raft_consensus.cc:2393] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 16: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:59.484850  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:00:59.486091  7821 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:00:59.373584  8375 rpcz_store.cc:276] 0501 14:00:58.347156 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.477296 (+130140us) service_pool.cc:224] Handling call
0501 14:00:58.477627 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:58.508570 (+ 30943us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:58.508609 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:58.509067 (+   458us) log.cc:844] Serialized 26 byte log entry
0501 14:00:58.865442 (+356375us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:00:58.865496 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:58.865572 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.333180 (+467608us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:00:59.362711 (+ 29531us) raft_consensus.cc:1685] finished
0501 14:00:59.362746 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.373039 (+ 10293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3775,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7605,"spinlock_wait_cycles":11153280,"thread_start_us":326472,"threads_started":1,"wal-append.queue_time_us":579809}
I20260501 14:00:59.429062  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:59.486651  8381 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
W20260501 14:00:59.487447  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 58478.3us
I20260501 14:00:59.488758  7819 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260501 14:00:59.489464  7718 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.525s (SENT)
W20260501 14:00:59.492491  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.805s (SENT)
I20260501 14:00:59.492374  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.493167  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.389598 13252 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.498725  8343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.501305 13224 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.410624 13124 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.407207 13127 raft_consensus.cc:697] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:59.517282  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.518389  7751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3633) took 1163 ms. Trace:
I20260501 14:00:59.518920  7751 rpcz_store.cc:276] 0501 14:00:58.343762 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.343976 (+   214us) service_pool.cc:224] Handling call
0501 14:00:59.507170 (+1163194us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54003ac0d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:00:59.507348 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607998848}
I20260501 14:00:59.495790 13350 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.514747 13325 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.495674 13133 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:00:59.498420 13289 raft_consensus.cc:697] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:59.531849  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:00:59.503782 13395 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.516314 13224 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.546921  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:00:59.559454  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:00:59.565588  8380 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:59.531252 13257 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:59.560884  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:00:59.537233 13133 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:00:59.521250 13261 consensus_queue.cc:1048] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260501 14:00:59.543262 13000 consensus_queue.cc:1048] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.042s
I20260501 14:00:59.551360 13325 consensus_queue.cc:1048] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260501 14:00:59.520844 13124 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.515120 13252 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.596365  7718 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:00:59.542080 13224 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.538342 13350 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.605115  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:00:59.611016  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:00:59.592772 13133 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:00:59.605239  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.625319  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.626032  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.626840  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.627879  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.607461 13257 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.598686 13371 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260501 14:00:59.644573  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.646473  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.647464  7751 raft_consensus.cc:2410] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260501 14:00:59.652750  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 410208us
W20260501 14:00:59.654326  7792 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.825s (SENT)
I20260501 14:00:59.614416 13167 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:00:59.668706  7792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.913s (SENT) [suppressed 65 similar messages]
I20260501 14:00:59.658897  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.615007 13361 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.657326  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.674734  7718 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:00:59.675877  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.679881  7792 leader_election.cc:400] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13.
I20260501 14:00:59.683131  7792 leader_election.cc:403] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260501 14:00:59.597080 13127 consensus_queue.cc:237] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.638739 13403 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.689786  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.695760  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.649274 13292 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.702028  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.703449  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.707176  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.708416  7821 raft_consensus.cc:2410] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260501 14:00:59.709019  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.704768 13385 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) with higher term. Message: Invalid argument: T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 for earlier term 12. Current term is 13.
W20260501 14:00:59.713976  8344 connection.cc:254] RPC call timeout handler was delayed by -1.1229096429999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2926s for a response
I20260501 14:00:59.714679  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:00:59.716091  8344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:00:59.717947  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.718691  7819 raft_consensus.cc:2468] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 16.
I20260501 14:00:59.702003  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.651108 13257 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.722846  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.723517  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.724120  7827 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260501 14:00:59.701157 13325 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:00:59.618741 13289 consensus_queue.cc:237] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.730496  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.683682 13261 consensus_queue.cc:1048] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260501 14:00:59.737392  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.742067  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:00:59.717582 13205 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.747886  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.688417 13361 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.768352  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.773610 13113 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260501 14:00:59.767969  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.785575  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.713109 13292 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.733774 13167 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260501 14:00:59.773813 13224 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.790584 13224 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.792891 13257 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.793298 13224 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.793816 13383 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.794734 13350 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.795292 13350 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.777559 13388 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.795740 13350 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.796150 13388 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.797935 13350 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.798226 13388 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.798415 13350 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.798933 13350 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.774246 13205 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.803413 13361 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.776654 13407 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.797956 13124 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:00:59.810341  7746 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 14.
I20260501 14:00:59.815716  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.766986 13325 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:00:59.803658 13205 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.811645 13167 consensus_queue.cc:1243] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260501 14:00:59.809989 13407 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.860306  7745 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 16. Current term is 17. Ops: []
W20260501 14:00:59.843039 13379 log.cc:927] Time spent T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260501 14:00:59.825858 13124 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.813596 13404 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:00:59.877003  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484e3aa806394c42a224a8dbb213dd30" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.842634 13388 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:00:59.886130  7746 raft_consensus.cc:1275] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260501 14:00:59.856575 13123 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.855409 13252 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.895159  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:00:59.880501 13332 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.898571 13388 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.910279 13252 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:00:59.918995 13410 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.207s	user 0.003s	sys 0.003s
I20260501 14:00:59.886001 13124 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.899145 13123 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.914405 13269 consensus_queue.cc:1048] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260501 14:00:59.943198  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 57412.3us
I20260501 14:00:59.945883 13392 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:00:59.946556 13392 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:00:59.947613 13421 log.cc:927] Time spent T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260501 14:00:59.947692 13124 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:00:59.948627 13392 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:00:59.949204 13437 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.949708 13437 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.952579 13292 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.953747 13350 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.954272 13350 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.954661 13350 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:00:59.932610 13252 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.956934 13429 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:00:59.957655 13252 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:00:59.912806 13325 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.958349 13424 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:00:59.924551 13332 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:00:59.937700 13428 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:00:59.964319  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:00.004015  8374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51744 (request call id 1407) took 1747 ms. Trace:
W20260501 14:00:59.997228  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1675855529999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260501 14:01:00.005159  7643 connection.cc:254] RPC call timeout handler was delayed by -1.1486855530000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260501 14:00:59.951656 13437 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.010465  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:00.004420  8374 rpcz_store.cc:276] 0501 14:00:58.249747 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.255559 (+  5812us) service_pool.cc:224] Handling call
0501 14:00:58.256086 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:00:58.256581 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:00:58.256624 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:00:59.299560 (+1042936us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b2c0001ced8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:00:59.349535 (+ 49975us) log.cc:844] Serialized 26 byte log entry
0501 14:00:59.588717 (+239182us) raft_consensus.cc:1645] Marking committed up to 10
0501 14:00:59.588774 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:00:59.588863 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:00:59.958804 (+369941us) raft_consensus.cc:1685] finished
0501 14:00:59.958834 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:00:59.997184 (+ 38350us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37859,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":13218,"spinlock_wait_cycles":4590464,"thread_start_us":173148,"threads_started":1,"wal-append.queue_time_us":350178}
I20260501 14:01:00.008389 13424 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.016113 13436 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.016793 13436 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.018129 13123 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:00.018970 13436 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.020232 13414 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:00.021483 13388 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:00.025295 13407 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.028167 13428 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.030993 13428 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.033758 13332 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.038964  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:00.001917 13416 log.cc:927] Time spent T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260501 14:01:00.060633  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.060907  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:00:59.999485 13429 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.064282 13124 consensus_queue.cc:1048] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:01:00.104553  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.132761  8371 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 11.
I20260501 14:01:00.003654 13252 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.071694 13332 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:01:00.041287 13391 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.023440 13205 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:00.137859  7747 raft_consensus.cc:1240] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 15. Current term is 16. Ops: []
I20260501 14:01:00.105345  8375 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 19.
I20260501 14:01:00.144519  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.111423 13269 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.174165  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.172380  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.141490 13257 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.172573 13350 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.195366  7823 pending_rounds.cc:85] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Aborting all ops after (but not including) 11
W20260501 14:01:00.178386 13434 log.cc:927] Time spent T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260501 14:01:00.142082 13332 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:01:00.173640 13433 log.cc:927] Time spent T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.002s
I20260501 14:01:00.165277 13168 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.168138 13397 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.180908 13424 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.200711  7823 pending_rounds.cc:107] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260501 14:01:00.218528  7823 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:01:00.165735 13265 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.223109 13429 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.223050 13265 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.165560 13384 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.172720 13409 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260501 14:01:00.212898 13292 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:00.146257 13252 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.205025 13403 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.213407 13361 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.155361 13205 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.187628 13269 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.213217 13332 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:00.200084 13257 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:00.293056  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 63454.4us
I20260501 14:01:00.296075  8376 raft_consensus.cc:1275] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:01:00.292055  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.293565  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:00.300313  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 47897.5us
I20260501 14:01:00.295095  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.151852 13391 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:00.237514 13133 consensus_meta.cc:287] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.001s
I20260501 14:01:00.312309  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:00.313452  8371 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:00.267639 13429 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.322391  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.323096  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 19.
I20260501 14:01:00.228085 13397 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.220000 13168 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.291548 13252 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.343696  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.305163 13424 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.338366  7752 raft_consensus.cc:1275] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260501 14:01:00.360934 13424 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.362115  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.265985 13384 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.318760 13133 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.361475 13397 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.363786 13424 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.281577 13292 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.372605  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.375947  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.404098  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.405248  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.300400 13361 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.408687  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:00.383284  7748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.409523  7826 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:00.409754  7748 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 10: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:00.367864  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.367487  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.370121  7754 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 20: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:00.372529  7821 raft_consensus.cc:1275] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260501 14:01:00.411188  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:00.399067  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.366506  7747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60268 (request call id 2353) took 1044 ms. Trace:
I20260501 14:01:00.399354  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.296265 13403 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.407567  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.418641  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.418951  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.413401  7747 rpcz_store.cc:276] 0501 14:00:59.322367 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:59.325923 (+  3556us) service_pool.cc:224] Handling call
0501 14:00:59.326210 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:01:00.148939 (+822729us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:00.366276 (+217337us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400116554. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:01:00.366447 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866123008}
I20260501 14:01:00.412761  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.419781  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.365823 13384 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.368868 13168 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.427189  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.427211  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.432400  7828 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 16.
I20260501 14:01:00.335240 13429 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.435119  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.375453 13269 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.369764 13133 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.437183  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.440871  7752 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:01:00.382867  8380 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:01:00.408432 13252 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.434499 13436 consensus_queue.cc:1059] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260501 14:01:00.425773 13233 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:00.425493 13350 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:00.376511 13205 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.439424  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.368019 13123 consensus_queue.cc:1048] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260501 14:01:00.412931 13424 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.453326 13257 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:00.453989 13397 consensus_queue.cc:1048] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260501 14:01:00.455058 13292 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.434854 13428 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:01:00.458937  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.444612  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.460155 13436 consensus_queue.cc:1243] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer ca8dd10afb304b4c96cfcec7e2309947 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260501 14:01:00.439654 13391 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.464952  7821 raft_consensus.cc:1275] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260501 14:01:00.445770  8371 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:01:00.452652  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.447345  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.434759 13437 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.453136 13294 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:01:00.478504 13294 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:00.479038 13294 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:00.479707  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.435693 13261 consensus_queue.cc:1048] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260501 14:01:00.470201  7826 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 20.
I20260501 14:01:00.488986  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.493636  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.495474  7718 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.501082  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.484601 13265 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.494843 13257 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.494470 13428 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.495240 13409 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:00.497634 13437 raft_consensus.cc:2804] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:01:00.534325  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.502265 13350 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.522091  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.533407  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.533401  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.507324 13407 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260501 14:01:00.504626 13384 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:01:00.537098  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.537989  8374 raft_consensus.cc:2410] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260501 14:01:00.541311  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.542824  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.543318  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.500140 13325 consensus_queue.cc:1048] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260501 14:01:00.551246  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.555620  8374 raft_consensus.cc:2410] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260501 14:01:00.551914  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.552057  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.559384  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.562078  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.534871 13437 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:00.540004 13124 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:00.616207  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.552858 13257 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:01:00.550627 13384 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:00.535655 13428 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.614756 13437 raft_consensus.cc:3060] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:00.613453 13232 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.549283 13350 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.619240 13406 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.634770  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.620380 13257 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.621946 13403 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.640435  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.625070 13361 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.642756  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.646232  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.648301  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 198240us
I20260501 14:01:00.648906  7752 raft_consensus.cc:2393] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 16: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:00.650151  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.635181 13429 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.651383  7754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3650) took 1245 ms. Trace:
I20260501 14:01:00.651262  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:00.653573  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:00.637915 13257 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:00.651870  7754 rpcz_store.cc:276] 0501 14:00:59.406135 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:59.492029 (+ 85894us) service_pool.cc:224] Handling call
0501 14:01:00.651163 (+1159134us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b540012c5d4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:01:00.651320 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015598848}
I20260501 14:01:00.655167  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.664269  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.668151  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.647882 13436 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.633538 13232 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.671983  7754 raft_consensus.cc:2410] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260501 14:01:00.676483  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.653752 13390 raft_consensus.cc:2764] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260501 14:01:00.639709 13406 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.677279  7747 raft_consensus.cc:2468] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 12.
I20260501 14:01:00.681484  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.684554  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.685161  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.745913  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 244931us
I20260501 14:01:00.798357  7754 raft_consensus.cc:2410] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260501 14:01:00.740885  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.697018 13448 log.cc:927] Time spent T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260501 14:01:00.680184 13436 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:00.695885 13440 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260501 14:01:00.755788 13437 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.743023 13350 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:00.768999 13447 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260501 14:01:00.776428 13252 raft_consensus.cc:3055] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Stepping down as leader of term 11
I20260501 14:01:00.785917 13232 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:00.663218 13384 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.793460 13294 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.668174 13338 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:00.684554  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.798946  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.801399  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.805783  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.846568  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:00.835935 13454 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260501 14:01:00.808630  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:00.818437  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.818693  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.820268  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.853631  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:00.835693  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.855737  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 56923.2us
I20260501 14:01:00.857189  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.839998 13133 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:00.837903 13252 raft_consensus.cc:740] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:00.859155  7820 raft_consensus.cc:2393] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:00.838150 13265 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:00.860972  7828 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:01:00.805770  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:00.862939 13332 consensus_meta.cc:287] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.001s
I20260501 14:01:00.910633  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.862198 13224 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:00.911733  8371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.909478  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:00.913547  8374 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:00.914682  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.910220  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:00.916803  7643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:00.922333  8371 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260501 14:01:00.930737  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:00.931478  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:00.884595 13407 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:00.906895 13350 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:00.911898 13428 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.865973 13133 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.905723 13265 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:00.935539 13404 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:00.919390 13332 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:00.935911 13424 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:00.994558 13294 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:00.969427  8374 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 20.
W20260501 14:01:01.000478 13457 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260501 14:01:01.001147 13436 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.010329 13265 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.011332 13437 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:01.025628  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 346320us
I20260501 14:01:00.963446 13350 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:01.063164 13350 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.063795 13252 consensus_queue.cc:260] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:01.026180 13424 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.118331  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.070621 13252 raft_consensus.cc:3060] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:01.122962  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.130371  7643 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:01:01.132992  7792 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.132609  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 178945us
I20260501 14:01:01.117444 13350 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:01.136725  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 184019us
W20260501 14:01:01.138160  7792 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.139431  7792 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.138201  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.140311  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.140565  7792 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.141424  8344 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.141670  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.141844  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.139689  7718 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.563s (SENT)
I20260501 14:01:01.142280  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:01.143689  7792 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.145216  7792 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:01.146682  7792 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.147114  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.117825 13437 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:01.148125  7792 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.124182 13428 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.158684  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:01.135143 13429 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.205144  8377 raft_consensus.cc:1240] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 12. Current term is 13. Ops: []
I20260501 14:01:01.153342 13124 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.226164 13428 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:01.123808 13436 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260501 14:01:01.234185  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:01.153529 13294 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.150080 13463 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:01.241390  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 72226.1us
I20260501 14:01:01.169498 13474 consensus_queue.cc:1059] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
W20260501 14:01:01.244976 13468 log.cc:927] Time spent T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260501 14:01:01.245657 13424 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:01.246532 13470 log.cc:927] Time spent T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260501 14:01:01.227182 13428 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:01.248612  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 52036.9us
W20260501 14:01:01.232641 13257 consensus_meta.cc:287] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.004s
W20260501 14:01:01.254148  8344 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.242381 13133 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.159022 13350 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:01.261457 13453 log.cc:927] Time spent T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260501 14:01:01.163961 13437 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.229043 13429 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:01:01.229313 13390 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:01.163093 13397 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
W20260501 14:01:01.262120 13451 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260501 14:01:01.262032 13465 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260501 14:01:01.293344  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:01.299019  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44921.6us
I20260501 14:01:01.301195  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.268182 13424 raft_consensus.cc:3055] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:01:01.270740 13133 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:01.312346  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.315460  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:01.315779  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 185476us
I20260501 14:01:01.280637 13390 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:01.262152 13257 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.285754 13332 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:01.284858 13429 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.305130 13424 raft_consensus.cc:740] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.319140  7643 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.331334  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.345412  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.318478 13463 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.343086  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.347437  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.348920  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.327742 13390 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:01.316928 13479 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.365917  7753 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 17: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
W20260501 14:01:01.343371 13452 log.cc:927] Time spent T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.573s	user 0.008s	sys 0.000s
I20260501 14:01:01.335846 13391 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:01.377597  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.324024 13133 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.431646  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:01.432649  8379 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 13
I20260501 14:01:01.409827 13474 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.440855 13384 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:01.446928 13465 log.cc:927] Time spent T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260501 14:01:01.438139 13350 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.425925 13391 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.478066 13391 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:01.480973 13480 log.cc:927] Time spent T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260501 14:01:01.481328  8376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 860) took 1182 ms. Trace:
I20260501 14:01:01.481881  8376 rpcz_store.cc:276] 0501 14:01:00.298788 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.363159 (+ 64371us) service_pool.cc:224] Handling call
0501 14:01:00.370499 (+  7340us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:01:00.377102 (+  6603us) raft_consensus.cc:1534] Early marking committed up to index 13
0501 14:01:00.646531 (+269429us) log.cc:844] Serialized 14 byte log entry
0501 14:01:00.980583 (+334052us) log.cc:844] Serialized 14 byte log entry
0501 14:01:00.992858 (+ 12275us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:01:01.121294 (+128436us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b2c0001ced8. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f8fdbc81 00007fb2f8feb5e2 00007fb2fa71cde1 00007fb2fa6e181a 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22
0501 14:01:01.134731 (+ 13437us) log.cc:844] Serialized 26 byte log entry
0501 14:01:01.135054 (+   323us) raft_consensus.cc:1645] Marking committed up to 13
0501 14:01:01.135115 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:01.135293 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:01:01.481012 (+345719us) raft_consensus.cc:1685] finished
0501 14:01:01.481058 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:01:01.481245 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30295,"prepare.queue_time_us":108684,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":2450,"raft.queue_time_us":36412,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":24072,"spinlock_wait_cycles":6892416,"thread_start_us":573656,"threads_started":2,"wal-append.queue_time_us":416579}
I20260501 14:01:01.503963 13428 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:01.457509 13482 raft_consensus.cc:3060] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
W20260501 14:01:01.510452  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 161609us
W20260501 14:01:01.515519 13471 log.cc:927] Time spent T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
W20260501 14:01:01.524407  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 110541us
I20260501 14:01:01.445842 13424 consensus_queue.cc:260] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.521010  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.517336 13437 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.540585  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.548360  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.553036  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.510049 13429 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.555876  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.557354  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 227805us
I20260501 14:01:01.557850  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.548789 13437 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.547986  8379 raft_consensus.cc:2468] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:01.559593  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.546873 13257 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.535581 13428 consensus_queue.cc:1059] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260501 14:01:01.544895 13490 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.558830 13487 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.558858 13474 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260501 14:01:01.559491 13350 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:01.561290 13488 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.006s
I20260501 14:01:01.563201 13437 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.574990  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.577734 13491 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.566550 13406 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:01.566848 13428 consensus_queue.cc:1243] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260501 14:01:01.586763  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51762 (request call id 854) took 1293 ms. Trace:
I20260501 14:01:01.587411  8377 rpcz_store.cc:276] 0501 14:01:00.293093 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.293796 (+   703us) service_pool.cc:224] Handling call
0501 14:01:00.294248 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0501 14:01:01.232885 (+938637us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:01.586459 (+353574us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400659354. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:01:01.586695 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710996736}
I20260501 14:01:01.589911 13390 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.595038  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:01.561780 13265 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:01.607009  7825 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 17. Current term is 18. Ops: []
I20260501 14:01:01.579670  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.620613  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.621492  8373 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 9.
I20260501 14:01:01.619192  8379 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260501 14:01:01.631182  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:01.594378 13133 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:01.636145  7718 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.172s (SENT)
I20260501 14:01:01.640909  7820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 2195) took 1101 ms. Trace:
W20260501 14:01:01.642544  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 1.806s (SENT)
I20260501 14:01:01.640910  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:01.641577  7820 rpcz_store.cc:276] 0501 14:01:00.532897 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.533019 (+   122us) service_pool.cc:224] Handling call
0501 14:01:01.634466 (+1101447us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b540028e954. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:01:01.634643 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723062016}
I20260501 14:01:01.639025 13489 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:01.613394 13265 consensus_queue.cc:1059] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260501 14:01:01.648941  7792 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:01.672129  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.677563  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:01:01.678887  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 121096us
I20260501 14:01:01.680673  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.684397  7644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:01.668098 13499 raft_consensus.cc:2804] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader election won for term 13
I20260501 14:01:01.668157 13493 raft_consensus.cc:3055] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Stepping down as leader of term 12
I20260501 14:01:01.687415  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.688880  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.688299 13252 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.690922 13482 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:01.694918 13265 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:01:01.692044 13493 raft_consensus.cc:740] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:01.715328  7643 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.700116 13429 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:01.717796  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.720293  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.724684  7643 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.718021 13265 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:01.720947 13350 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:01.736608 13500 log.cc:927] Time spent T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260501 14:01:01.724453 13252 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.725683 13474 raft_consensus.cc:2804] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260501 14:01:01.716979 13437 consensus_queue.cc:1059] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260501 14:01:01.736940 13265 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:01:01.737306 13429 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.740309 13390 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.759333 13474 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:01.736351 13493 consensus_queue.cc:260] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:01.788353 13502 log.cc:927] Time spent T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260501 14:01:01.789166 13496 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260501 14:01:01.776717 13437 consensus_queue.cc:1243] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Peer 109c9ba263c34ff8aee17bc446cf258e log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260501 14:01:01.823210  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.824543  7747 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:01:01.825531  7824 raft_consensus.cc:1240] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 11. Current term is 12. Ops: []
I20260501 14:01:01.826396  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:01.824422  8380 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 9.
I20260501 14:01:01.830273  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:01.832233  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.838774  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.840058  8380 raft_consensus.cc:2393] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 13: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:01:01.840812  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.841343  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.791291 13474 raft_consensus.cc:3060] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:01.843621  7824 raft_consensus.cc:1240] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 16. Current term is 17. Ops: []
W20260501 14:01:01.854362  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 176877us
I20260501 14:01:01.855952 13436 raft_consensus.cc:3055] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Stepping down as leader of term 10
I20260501 14:01:01.856451 13436 raft_consensus.cc:740] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.856207 13127 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:01:01.857331 13436 consensus_queue.cc:260] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.858915  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.860080  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.862344  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.863922  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.865641  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.867405  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:01.861976  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.872121  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.877470  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.882603  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:01.861353 13493 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Advancing to term 13
I20260501 14:01:01.884135  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.884203  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.888582  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:01.870843 13499 raft_consensus.cc:697] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
W20260501 14:01:01.909358 13505 log.cc:927] Time spent T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260501 14:01:01.914026  7643 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.915933  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.918260  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.920985  7643 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.921763  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.924543  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.927402  7562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 93967.3us
I20260501 14:01:01.922643 13325 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260501 14:01:01.918460 13252 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:01.919931 13437 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.927386 13519 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260501 14:01:01.935667 13265 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:01.939226  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 239565us
I20260501 14:01:01.921851 13350 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:01.940445  7718 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.007s (SENT)
I20260501 14:01:01.942451  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.944540  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Timed out: RequestConsensusVote RPC to 127.6.77.129:36443 timed out after 2.080s (SENT)
I20260501 14:01:01.947489  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.947141  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:01.927560 13429 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:01.948127 13437 raft_consensus.cc:3060] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:01:01.957021 13436 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:01:01.961107  7753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60274 (request call id 3680) took 1286 ms. Trace:
I20260501 14:01:01.945012 13482 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.961565  7753 rpcz_store.cc:276] 0501 14:01:00.674503 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.675355 (+   852us) service_pool.cc:224] Handling call
0501 14:01:01.960909 (+1285554us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540012cad4. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e56da 00007fb2ff6b51d7 00007fb2f8c22834 00007fb2f8c227c2 00007fb2f8c226f1 00007fb2f8c2266c 00007fb2f8c21922 00007fb2f8a1bbcc 00007fb2f8a1b006 00007fb2f8a1a9af
0501 14:01:01.961037 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304740224}
I20260501 14:01:01.964449 13501 raft_consensus.cc:3055] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:01:01.964972 13501 raft_consensus.cc:740] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:01.965926 13501 consensus_queue.cc:260] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:01.967326 13501 raft_consensus.cc:3060] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:01.938968 13499 consensus_queue.cc:237] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.970129  7745 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 16. Current term is 17. Ops: []
I20260501 14:01:01.973336  7643 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.975247  7754 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:01.972841  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:01.942370 13124 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:01.978410 13482 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260501 14:01:01.979143  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:01.979986  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:01.982560 13350 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.982791  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:01.981828  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.976440 13429 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:01.985997 13350 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:01.980543 13124 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:01.988183 13265 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:01.980296 13203 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:01.987246  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:01.991287  7747 raft_consensus.cc:2410] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260501 14:01:01.991441  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:01.994475 13124 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:01.994735 13467 log.cc:927] Time spent T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.828s	user 0.003s	sys 0.004s
I20260501 14:01:01.997031  7827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50954 (request call id 2587) took 1358 ms. Trace:
I20260501 14:01:01.997130 13350 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:01.997493  7827 rpcz_store.cc:276] 0501 14:01:00.638455 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:00.638591 (+   136us) service_pool.cc:224] Handling call
0501 14:01:00.638928 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:01:00.740246 (+101318us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:01:00.740283 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:01:00.743073 (+  2790us) log.cc:844] Serialized 26 byte log entry
0501 14:01:01.022725 (+279652us) raft_consensus.cc:1645] Marking committed up to 8
0501 14:01:01.022790 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:01.450599 (+427809us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400297f54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6e21e1 00007fb2fa6e0c1e 00007fb2ff6b3ad9 00007fb2f8c1dd34 00007fb2f8c1dcc2 00007fb2f8c1dbf1 00007fb2f8c1db6c 00007fb2f8c1ce22 00007fb2f8a1bbcc 00007fb2f8a1b006
0501 14:01:01.450669 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:01:01.994082 (+543413us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b440002534c. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2f7481941 00007fb2f7550375 00007fb2f7550d92 00007fb2fa28c57b 00007fb2fa287e4f 00007fb2fa27bc0e 00007fb2fa27af56 00007fb2fa27ab78 00007fb2fa2845c1 00007fb2fa284579 00007fb2fa284509
0501 14:01:01.996767 (+  2685us) raft_consensus.cc:1685] finished
0501 14:01:01.996797 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:01:01.996939 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":11460,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":433912576,"thread_start_us":279142,"threads_started":1,"wal-append.queue_time_us":341917}
I20260501 14:01:02.004323  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.033044  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.059142  8376 raft_consensus.cc:1240] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Rejecting Update request from peer bc1b0a0a152e46fea4bd4934ba9976ed for earlier term 10. Current term is 11. Ops: []
I20260501 14:01:02.066988 13350 raft_consensus.cc:3060] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:01:02.068604  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 53447.2us
I20260501 14:01:02.071339 13437 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:02.072613  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 70811us
W20260501 14:01:02.073422  7718 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.074755  7718 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.075795  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.118009  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.118914  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.119650  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.120283  7718 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.120927  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
W20260501 14:01:02.121336  7718 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.121989  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.122833 13265 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:02.123451  7718 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.124653  7718 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.125591  7718 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.126564  7718 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.128234  7718 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.129371  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.130021  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.132763 13437 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260501 14:01:02.135567 13437 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:02.135978 13437 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 10 FOLLOWER]: Advancing to term 11
I20260501 14:01:02.132483  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.137795 13429 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.140354  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.142436 13350 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.146368 13437 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.149708 13437 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.132967  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.150524  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.152077 13493 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.153852  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.154446  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.156344  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 77553.1us
W20260501 14:01:02.158687  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 95989.6us
I20260501 14:01:02.164188  7826 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260501 14:01:02.115231 13501 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:02.167618  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.170830  7643 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.172009 13437 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.172442  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.173504 13437 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.174124  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.175181 13437 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.169888  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.157667 13265 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.167506 13493 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:02.167989  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.159083 13429 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:02.175786  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:02.177086  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.306653  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 129471us
I20260501 14:01:02.182600  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.308125  7792 consensus_peers.cc:407] unable to start election on peer bc1b0a0a152e46fea4bd4934ba9976ed: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.188408 13436 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.205503 13474 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.178781 13501 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.319216 13474 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.310721  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 142578us
I20260501 14:01:02.310883 13409 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.312492 13436 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:02.314661  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 138803us
I20260501 14:01:02.315549 13429 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.330205  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.182420 13493 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.331699 13429 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.333177  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.334133 13493 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.334342  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.204188 13514 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.106s
I20260501 14:01:02.335425  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.335743  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.322942  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.338140  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.338318  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.339505 13409 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:01:02.340760  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.342926  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.330916 13436 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.344485 13501 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.227677 13203 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.348258 13224 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Stepping down as leader of term 17
I20260501 14:01:02.348866 13224 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
W20260501 14:01:02.357926  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.358867  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.361771 13424 raft_consensus.cc:3060] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:01:02.366174 13503 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.603s	user 0.000s	sys 0.006s
I20260501 14:01:02.367985 13436 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:02.372852 13504 log.cc:927] Time spent T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.632s	user 0.003s	sys 0.004s
W20260501 14:01:02.367494  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.350862 13224 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.380529 13332 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.383980 13436 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.385035 13436 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.389351 13436 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.373785  7643 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:02.407157  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.408004  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:02.410646  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.413671  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.413234  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.415148 13428 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
W20260501 14:01:02.415462  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.416267  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.417083  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.419957  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.420620  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.412567 13332 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.421794 13519 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.423444 13519 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.425307  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.428241  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.429270  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.429452  7745 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:01:02.431136 13428 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:02.432665  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.433528  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.434461  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.417692 13436 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Advancing to term 13
W20260501 14:01:02.439023  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.440972 13224 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:02.434631 13428 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:02.449385  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.461179  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.473526 13519 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:02.479404  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:02.481060  7749 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 11: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:02.489270  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:02.490127  8377 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Advancing to term 11
I20260501 14:01:02.500720  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.501205  8379 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260501 14:01:02.501005  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:02.504916  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.506245  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.506363  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.507972  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.508205  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:02.508721  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:02.508006  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 80179.7us
I20260501 14:01:02.516027  7577 catalog_manager.cc:5671] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12, leader changed from <none> to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:02.524345  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 85450.1us
W20260501 14:01:02.526530  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.527211  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:02.510051  8344 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.529341  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.530606 13332 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:02.534947  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.535624  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:02.537652  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.538945 13406 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.564124  7574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33244 (request call id 200) took 11265 ms (client timeout 15000 ms). Trace:
I20260501 14:01:02.569011  7577 catalog_manager.cc:5671] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 7 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.543609  7792 leader_election.cc:336] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.571873 13436 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.573137  8377 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc1b0a0a152e46fea4bd4934ba9976ed in term 11.
I20260501 14:01:02.574610  7577 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.578043 13332 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:01:02.585825  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.583206  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.589135  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:02.589962  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.564771  7574 rpcz_store.cc:269] 0501 14:00:51.298263 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:51.315309 (+ 17046us) service_pool.cc:224] Handling call
0501 14:01:02.563866 (+11248557us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:00:57.474831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:00:57.475518 (+   687us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:00:57.475584 (+    66us) write_op.cc:435] Acquired schema lock
0501 14:00:57.475614 (+    30us) tablet.cc:662] Decoding operations
0501 14:00:57.556233 (+ 80619us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:00:57.556316 (+    83us) write_op.cc:641] Partition lock acquired for write op
0501 14:00:57.556347 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0501 14:00:57.563276 (+  6929us) tablet.cc:701] Row locks acquired
0501 14:00:57.564234 (+   958us) write_op.cc:260] PREPARE: finished
0501 14:00:57.577413 (+ 13179us) write_op.cc:270] Start()
0501 14:00:57.592763 (+ 15350us) write_op.cc:276] Timestamp: P: 1777644057575732 usec, L: 0
0501 14:00:57.592786 (+    23us) op_driver.cc:348] REPLICATION: starting
0501 14:00:57.656679 (+ 63893us) log.cc:844] Serialized 5474 byte log entry
0501 14:00:59.131117 (+1474438us) op_driver.cc:464] REPLICATION: finished
0501 14:00:59.487319 (+356202us) write_op.cc:301] APPLY: starting
0501 14:00:59.494176 (+  6857us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:00.179627 (+685451us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:00.179754 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:01.246698 (+1066944us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:01.247008 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0501 14:01:01.247053 (+    45us) write_op.cc:312] APPLY: finished
0501 14:01:01.247419 (+   366us) log.cc:844] Serialized 129 byte log entry
0501 14:01:01.379332 (+131913us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:01.430877 (+ 51545us) write_op.cc:454] Released schema lock
0501 14:01:01.443910 (+ 13033us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:01.468126 (+ 24216us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:01.469505 (+  1379us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":621247,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":260414,"apply.run_cpu_time_us":79385,"apply.run_wall_time_us":2050214,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62563,"num_ops":14,"prepare.queue_time_us":181238,"prepare.run_cpu_time_us":35602,"prepare.run_wall_time_us":426614,"raft.queue_time_us":800914,"raft.run_cpu_time_us":12025,"raft.run_wall_time_us":87785,"replication_time_us":1529911,"thread_start_us":931827,"threads_started":5,"wal-append.queue_time_us":584341,"wal-append.run_cpu_time_us":23798,"wal-append.run_wall_time_us":3048542}]]}
I20260501 14:01:02.599673 13332 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.603739  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.593989  7577 catalog_manager.cc:5671] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 13, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:02.605628 13406 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.606884  8344 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.607739  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:02.612685  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.613517  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.614198  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.614668  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.616093  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:02.618183  7718 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.618793  7718 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.619678 13332 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:02.621024 13514 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 10 FOLLOWER]: Advancing to term 11
W20260501 14:01:02.625322  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.625945  7792 leader_election.cc:336] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.626545  7792 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.626186  7577 catalog_manager.cc:5671] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 13, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.627676 13406 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:02.628513  7792 leader_election.cc:336] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.628731  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.640434  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.641322  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.642102 13436 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:01:02.642756  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.643435  7643 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 
I20260501 14:01:02.640398  7792 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.651630 13406 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.644383  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.652734  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.653558  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.648041 13436 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader election won for term 11
I20260501 14:01:02.656339  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.656836 13436 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Becoming Leader. State: Replica: bc1b0a0a152e46fea4bd4934ba9976ed, State: Running, Role: LEADER
I20260501 14:01:02.657392 13534 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.658181  7718 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.648548  7577 catalog_manager.cc:5671] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 14 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.655704  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.645649  7643 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.660111  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.661679  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.658429 13436 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.663096 13424 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:02.666774 13406 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:02.668021  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:02.668102 13534 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.669157  7718 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.669835  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.668639  7577 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 17, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 17 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.674623  7577 catalog_manager.cc:5671] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.671751  7718 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.668187  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.679665  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.679704  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.676241 13534 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.684456 13517 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.684835  7643 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.687449 13519 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:02.690045  7643 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.690683 13519 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.691038 13428 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260501 14:01:02.686256  7577 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 16, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.694072 13390 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.694458 13479 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.681627 13424 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260501 14:01:02.695109 13479 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.695145  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.695545 13409 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260501 14:01:02.701577  7643 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.695508 13436 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.700858 13463 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:01:02.704257 13463 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:01:02.701009 13428 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.700866 13519 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:02.703146 13429 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:02.705619 13463 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:02.724189  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.724723  7625 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.725026  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.705596  7577 catalog_manager.cc:5671] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.740028 13436 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:02.741492 13436 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.718268 13463 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:02.749559  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:02.740765  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 69081.1us
W20260501 14:01:02.751627  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.752416  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.740485 13479 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:02.742523  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 74424.1us
I20260501 14:01:02.752928  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.760578 13534 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:02.761160  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.761741  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.762553 13534 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.760560  7577 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 11 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:02.763218  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.764822 13436 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:02.764544  7577 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 15, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 15 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.766400  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:02.716398 13514 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260501 14:01:02.755288  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.768338  7643 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.770970 13406 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260501 14:01:02.771452 13436 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:02.773785  7577 catalog_manager.cc:5671] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.771746  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 73654us
I20260501 14:01:02.809569  7577 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 11, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:02.818991  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:02.820020  8381 raft_consensus.cc:2393] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 11: Already voted for candidate bc1b0a0a152e46fea4bd4934ba9976ed in this term.
I20260501 14:01:02.819065  7577 catalog_manager.cc:5671] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:02.822677  7577 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.837018  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:02.850262  7824 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer 91854d93e96c4756834efe8b2ef59fce for earlier term 16. Current term is 17. Ops: []
I20260501 14:01:02.856906  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.859498  7750 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:01:02.867271  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.870487  7754 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.878710  7577 catalog_manager.cc:5671] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 15, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 15 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:02.890509  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.896236  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.897836  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.898550  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.897634  7577 catalog_manager.cc:5671] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 8 to 9, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 9 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:02.900570  7577 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 14, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.899055  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.902791  7577 catalog_manager.cc:5671] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:01:02.908900  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.909684  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.910730 13409 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.912376  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.912638  8375 raft_consensus.cc:1275] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:01:02.912945  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.909000 13539 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.915436 13397 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260501 14:01:02.909004  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.920792  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:02.930680  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.933480  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.934082  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.936022 13397 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:02.943969  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.945164 13388 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:02.945632  7792 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:02.946779  7792 leader_election.cc:336] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.947227  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.948256 13429 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.948585  7824 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260501 14:01:02.948941 13429 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:02.954365  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:02.956408  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.958138  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.959486 13224 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260501 14:01:02.962256  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.962352  7643 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:02.962774  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:02.965209 13424 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.951313 13429 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:02.960438 13388 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:02.960919 13224 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:02.966555 13224 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:02.965797 13424 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.968231  7577 catalog_manager.cc:5671] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:02.969486 13424 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:02.969950  7577 catalog_manager.cc:5671] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.976974 13224 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.981118  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:02.981364 13224 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:02.971432  7577 catalog_manager.cc:5671] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 16, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:02.977890 13424 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:02.978049 13463 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:02.979458  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:02.987865  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:02.988572  7749 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:02.989384 13424 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:02.989985 13424 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:02.991782  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:02.992185 13424 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:02.993978  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:02.994565  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:02.997795 13424 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:03.001947 13514 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260501 14:01:03.003051  8344 leader_election.cc:336] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.020160  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:03.021559  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:03.022158  7643 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.023424 13424 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:03.025597  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.026134  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:03.027107 13388 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.036283  7749 raft_consensus.cc:2468] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:01:03.040688  8344 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:03.041709 13224 raft_consensus.cc:2804] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:01:03.042337 13224 raft_consensus.cc:697] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:01:03.043398 13224 consensus_queue.cc:237] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.053946  8377 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:01:03.055404 13424 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260501 14:01:03.088547 13424 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.089216 13424 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.091392 13424 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.096688  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.099007  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.099758  7749 raft_consensus.cc:2393] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc1b0a0a152e46fea4bd4934ba9976ed in current term 12: Already voted for candidate 91854d93e96c4756834efe8b2ef59fce in this term.
I20260501 14:01:03.124318  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:03.129949  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 53758.4us
I20260501 14:01:03.132120 13429 raft_consensus.cc:493] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.132896 13429 raft_consensus.cc:515] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.135149 13429 leader_election.cc:290] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.142191  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.143675  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3422d02d5408caed8cf6c79922e21" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.131676 13424 raft_consensus.cc:3060] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:03.159749  7643 leader_election.cc:304] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.164743 13429 raft_consensus.cc:2749] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.187590 13384 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:03.199311  7824 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:03.209594 13428 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.210556  7754 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Refusing update from remote peer bc1b0a0a152e46fea4bd4934ba9976ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260501 14:01:03.210470 13428 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.213367 13428 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.215400  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.215641  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.218116 13428 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.218792 13428 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.222443 13428 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.228415 13428 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:01:03.231151  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.231802  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.236516 13424 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:03.236611  7643 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.239643  7643 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.243243 13428 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:03.243836 13436 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.242594 13424 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.244519 13436 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.251891 13436 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:03.256744  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet c91be7730b684fbd94e69655ab35fd61, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:03.257207  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet c91be7730b684fbd94e69655ab35fd61, TS bc1b0a0a152e46fea4bd4934ba9976ed -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.261508 13514 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.262125 13514 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.264719 13514 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.265296 13553 consensus_queue.cc:1048] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:01:03.266790  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.267488  8377 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 13.
I20260501 14:01:03.267921  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.268800  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:03.269069  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.269851 13384 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:01:03.270463 13384 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:03.271229 13384 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
W20260501 14:01:03.275159  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.279975  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.283176 13424 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:03.285144  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:03.295859  7625 auto_rebalancer.cc:806] Removing replace marker failed: Replica 109c9ba263c34ff8aee17bc446cf258e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
W20260501 14:01:03.296574  7625 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet ac3b0214563f48f689fc427a69b7b5dd, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:03.297326  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet ac3b0214563f48f689fc427a69b7b5dd, TS ca8dd10afb304b4c96cfcec7e2309947 -> TS 91854d93e96c4756834efe8b2ef59fce move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.330261 13384 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.358139  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:03.359833  8377 raft_consensus.cc:3060] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:03.363952 13384 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:03.390977  7718 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:03.393194  8377 raft_consensus.cc:2468] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:01:03.395298  7718 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:03.397044 13384 raft_consensus.cc:2804] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader election won for term 14
I20260501 14:01:03.397760 13384 raft_consensus.cc:697] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:03.399121 13384 consensus_queue.cc:237] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.423902 13517 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.424875 13517 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.431190  7754 raft_consensus.cc:1275] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:01:03.432535 13517 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.435215  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.435963  8377 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:01:03.436858  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:03.437075 13224 consensus_queue.cc:1048] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260501 14:01:03.440096  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.449821  7824 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:03.442386 13534 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:03.453423 13534 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.453843 13534 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:03.534165 13534 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.536759 13534 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.553357  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:03.554486  7824 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:03.553539  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:03.568022  8377 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:01:03.570719 13424 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.571388 13424 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.572834  7718 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.577525 13563 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:01:03.578120 13563 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:03.573758 13424 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.579147 13563 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.589340  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.591962  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:03.594381  6454 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 7704)
I20260501 14:01:03.597744  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.598878 13424 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:03.600755  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:03.604373  7577 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57618 (request call id 317) took 5601 ms. Trace:
I20260501 14:01:03.599889  7575 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:03.609310  7577 rpcz_store.cc:276] 0501 14:00:58.003154 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:58.059923 (+ 56769us) service_pool.cc:224] Handling call
0501 14:01:03.604272 (+5544349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:01:03.076726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:01:03.077527 (+   801us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:01:03.077583 (+    56us) write_op.cc:435] Acquired schema lock
0501 14:01:03.077611 (+    28us) tablet.cc:662] Decoding operations
0501 14:01:03.079414 (+  1803us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:01:03.079531 (+   117us) write_op.cc:641] Partition lock acquired for write op
0501 14:01:03.079571 (+    40us) tablet.cc:685] Acquiring locks for 23 operations
0501 14:01:03.086229 (+  6658us) tablet.cc:701] Row locks acquired
0501 14:01:03.086250 (+    21us) write_op.cc:260] PREPARE: finished
0501 14:01:03.086424 (+   174us) write_op.cc:270] Start()
0501 14:01:03.086584 (+   160us) write_op.cc:276] Timestamp: P: 1777644063086353 usec, L: 0
0501 14:01:03.086644 (+    60us) op_driver.cc:348] REPLICATION: starting
0501 14:01:03.087437 (+   793us) log.cc:844] Serialized 9053 byte log entry
0501 14:01:03.251208 (+163771us) op_driver.cc:464] REPLICATION: finished
0501 14:01:03.319039 (+ 67831us) write_op.cc:301] APPLY: starting
0501 14:01:03.319137 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:03.400367 (+ 81230us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:03.400537 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:03.455389 (+ 54852us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:03.456180 (+   791us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0501 14:01:03.456252 (+    72us) write_op.cc:312] APPLY: finished
0501 14:01:03.456853 (+   601us) log.cc:844] Serialized 204 byte log entry
0501 14:01:03.474335 (+ 17482us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.495715 (+ 21380us) write_op.cc:454] Released schema lock
0501 14:01:03.515528 (+ 19813us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:03.528229 (+ 12701us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.528276 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18126,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":65462,"apply.run_cpu_time_us":33966,"apply.run_wall_time_us":209043,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":81483,"prepare.run_cpu_time_us":16886,"prepare.run_wall_time_us":84564,"raft.queue_time_us":73163,"raft.run_cpu_time_us":7663,"raft.run_wall_time_us":65039,"replication_time_us":164339,"thread_start_us":223093,"threads_started":4,"wal-append.queue_time_us":65433}]]}
I20260501 14:01:03.623742 13424 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.623991 13436 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.611971  7575 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 14 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 15 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.624792 13436 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.626210  7575 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 14 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 15 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.624707 13424 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.629560 13424 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.627275 13436 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.629622  7575 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed reported cstate change: term changed from 9 to 10, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 10 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:03.633196  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.633757  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.635051  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.635381  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.645953  7643 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.646857 13436 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:03.648263  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.649217 13436 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:03.721750  7575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57594 (request call id 305) took 11414 ms (client timeout 15000 ms). Trace:
I20260501 14:01:03.722741  7574 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 14, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129). New cstate: current_term: 14 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.734386 13436 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.735116 13436 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.735229  7574 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 17 to 20, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.737401 13436 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.738287  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.738546 13428 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.739131 13428 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.739735  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.741050  7643 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.741768 13428 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.741979 13436 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.737658  7574 catalog_manager.cc:5671] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.744225  7574 catalog_manager.cc:5671] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.745999  7574 catalog_manager.cc:5671] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:03.734452  7575 rpcz_store.cc:269] 0501 14:00:52.307041 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:52.307380 (+   339us) service_pool.cc:224] Handling call
0501 14:01:03.721663 (+11414283us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:01:03.650916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:01:03.651531 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:01:03.651572 (+    41us) write_op.cc:435] Acquired schema lock
0501 14:01:03.651593 (+    21us) tablet.cc:662] Decoding operations
0501 14:01:03.652260 (+   667us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:01:03.652331 (+    71us) write_op.cc:641] Partition lock acquired for write op
0501 14:01:03.652362 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0501 14:01:03.652803 (+   441us) tablet.cc:701] Row locks acquired
0501 14:01:03.652824 (+    21us) write_op.cc:260] PREPARE: finished
0501 14:01:03.652982 (+   158us) write_op.cc:270] Start()
0501 14:01:03.653109 (+   127us) write_op.cc:276] Timestamp: P: 1777644063652929 usec, L: 0
0501 14:01:03.653129 (+    20us) op_driver.cc:348] REPLICATION: starting
0501 14:01:03.653821 (+   692us) log.cc:844] Serialized 1684 byte log entry
0501 14:01:03.661380 (+  7559us) op_driver.cc:464] REPLICATION: finished
0501 14:01:03.662569 (+  1189us) write_op.cc:301] APPLY: starting
0501 14:01:03.662675 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:03.665376 (+  2701us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:03.665476 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:03.675512 (+ 10036us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:03.675740 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0501 14:01:03.675796 (+    56us) write_op.cc:312] APPLY: finished
0501 14:01:03.676135 (+   339us) log.cc:844] Serialized 49 byte log entry
0501 14:01:03.678273 (+  2138us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.678391 (+   118us) write_op.cc:454] Released schema lock
0501 14:01:03.678438 (+    47us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:03.678895 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:03.678923 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":319451,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":928,"apply.run_cpu_time_us":6819,"apply.run_wall_time_us":16277,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":309,"prepare.run_cpu_time_us":3261,"prepare.run_wall_time_us":14396,"replication_time_us":8080}]]}
I20260501 14:01:03.760813  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.766371  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.753252  7574 catalog_manager.cc:5671] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 13, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.778380  7574 catalog_manager.cc:5671] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.788552  7574 catalog_manager.cc:5671] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.793326 13436 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:03.798707  7643 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.800385  7574 catalog_manager.cc:5671] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 11, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.802168  7574 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.805996 13428 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:03.806283  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:03.802727 13436 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.810976 13436 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.812443  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.813689  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.814330  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.815078  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.815023  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.823616  7643 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.824783 13428 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.826859 13428 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.827486 13428 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.827785  6454 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.831940  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.852809  6454 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.833218  8377 raft_consensus.cc:1275] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260501 14:01:03.853614  6454 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.838994  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.850850 13436 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.856720 13517 consensus_queue.cc:1048] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:01:03.857834 13436 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.831105 13428 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.860631 13436 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.863998  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.808391  7574 catalog_manager.cc:5671] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 13 to 14, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.870499  7574 catalog_manager.cc:5671] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 13, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.876380  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.888592 13436 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.889127  7643 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.873152  7574 catalog_manager.cc:5671] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:03.889446 13436 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.890736 13428 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:03.890532  7574 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:03.890717  7643 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.889415  6454 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.892880 13428 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.897990 13436 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.898152  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.898665 13436 raft_consensus.cc:493] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:03.900696  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.899264 13436 raft_consensus.cc:515] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.901808  6454 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.902812  6454 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.903707 13436 leader_election.cc:290] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.905367  7643 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.911432  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.912451  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c720014934abe950ad611625f9bc9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.913792 13428 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:03.916525 13424 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.917886 13424 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.923794 13424 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.927107  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.928411  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.929801  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.930518 13424 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.931074 13424 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:03.933252 13424 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:03.933943  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.935137  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.936362  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.927306  7643 leader_election.cc:304] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.944389  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.944517  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:03.946121 13424 raft_consensus.cc:2749] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:03.947798  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:03.952224  6454 tablet_replica.cc:333] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.953438  6454 raft_consensus.cc:2243] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.954203  6454 raft_consensus.cc:2272] T b1911462b92946d6b35f09cf9509128d P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.957944  6454 tablet_replica.cc:333] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.959860  7643 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:03.960752  7643 raft_consensus.cc:2686] T 23c164f5975a45b495c25c9e99b628d3 P bc1b0a0a152e46fea4bd4934ba9976ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260501 14:01:03.961452  7643 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:03.962249 13436 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:03.958913  6454 raft_consensus.cc:2243] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:03.969614  6454 pending_rounds.cc:70] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:03.969894  6454 pending_rounds.cc:77] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7281230012093726720 op_type: NO_OP noop_request { }
I20260501 14:01:03.970501  6454 raft_consensus.cc:2889] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:03.970937  6454 raft_consensus.cc:2272] T 294b76c5890f455f97130fdbedace9af P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:03.973429 13436 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:03.974092 13436 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:03.981587  8377 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260501 14:01:03.982579 13436 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:03.984608 13534 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:01:03.984854  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:03.986771  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:03.988915  6454 tablet_replica.cc:333] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:03.992362  7643 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:03.993566 13436 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:04.003566  6454 raft_consensus.cc:2243] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.004737  6454 raft_consensus.cc:2272] T 484e3aa806394c42a224a8dbb213dd30 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.009502 13436 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.010162 13436 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.012465 13436 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.014952  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.014798  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962840f0434049bbb395d330e010962d" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.026732  7643 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.029686 13388 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.030349 13388 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.028460 13436 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:04.035723 13388 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.032522  7576 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 11 to 12, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 12 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:04.040256  6454 tablet_replica.cc:333] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.041612  6454 raft_consensus.cc:2243] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.045634  6454 raft_consensus.cc:2272] T 962840f0434049bbb395d330e010962d P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.047631  8377 consensus_queue.cc:237] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.063361  7824 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260501 14:01:04.064826 13436 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.065506 13436 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.066936 13534 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:01:04.069963 13436 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.080821  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.084314  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.085467  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.086488  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.087248  7643 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.088143 13436 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.085803 13384 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.088936 13384 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.091233 13384 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.092693  7819 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260501 14:01:04.095463  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.095932  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.096232  8376 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:01:04.096616  7819 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 17.
I20260501 14:01:04.099752 13539 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260501 14:01:04.103529  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:04.104771 13563 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:04.104817  7745 raft_consensus.cc:1275] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260501 14:01:04.105289 13563 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:04.105867 13563 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:04.107441 13332 consensus_queue.cc:1048] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:01:04.134948 13436 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.135995 13436 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.172822 13424 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.173496 13424 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.175769 13424 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.175858  7577 catalog_manager.cc:5671] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 17, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.177407  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.181679  7577 catalog_manager.cc:5671] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 17, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.186385  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.188719  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.189044  8375 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:01:04.188186 13436 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.087493  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.190428  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 13, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.192811  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.192535  7577 catalog_manager.cc:5671] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.194224  7643 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.195209 13436 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:04.185748  7576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 286) took 8791 ms. Trace:
I20260501 14:01:04.194336  7577 catalog_manager.cc:5671] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.202323  7577 catalog_manager.cc:5671] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 16, leader changed from ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.206403  7577 catalog_manager.cc:5671] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.210613  7577 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.214681  6454 tablet_replica.cc:333] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.214850  7577 catalog_manager.cc:5671] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.216256  6454 raft_consensus.cc:2243] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.197988  7576 rpcz_store.cc:276] 0501 14:00:55.394166 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:00:55.395443 (+  1277us) service_pool.cc:224] Handling call
0501 14:01:04.185663 (+8790220us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0501 14:01:04.055995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0501 14:01:04.056570 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0501 14:01:04.056614 (+    44us) write_op.cc:435] Acquired schema lock
0501 14:01:04.056632 (+    18us) tablet.cc:662] Decoding operations
0501 14:01:04.057043 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0501 14:01:04.057103 (+    60us) write_op.cc:641] Partition lock acquired for write op
0501 14:01:04.057129 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0501 14:01:04.057335 (+   206us) tablet.cc:701] Row locks acquired
0501 14:01:04.057353 (+    18us) write_op.cc:260] PREPARE: finished
0501 14:01:04.057511 (+   158us) write_op.cc:270] Start()
0501 14:01:04.057621 (+   110us) write_op.cc:276] Timestamp: P: 1777644064057461 usec, L: 0
0501 14:01:04.057640 (+    19us) op_driver.cc:348] REPLICATION: starting
0501 14:01:04.058332 (+   692us) log.cc:844] Serialized 533 byte log entry
0501 14:01:04.060210 (+  1878us) op_driver.cc:464] REPLICATION: finished
0501 14:01:04.061954 (+  1744us) write_op.cc:301] APPLY: starting
0501 14:01:04.062039 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0501 14:01:04.062920 (+   881us) tablet.cc:1370] finished BulkCheckPresence
0501 14:01:04.063014 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0501 14:01:04.064855 (+  1841us) tablet.cc:1383] finished ApplyRowOperation cycle
0501 14:01:04.065052 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0501 14:01:04.065104 (+    52us) write_op.cc:312] APPLY: finished
0501 14:01:04.065305 (+   201us) log.cc:844] Serialized 25 byte log entry
0501 14:01:04.066301 (+   996us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:04.066401 (+   100us) write_op.cc:454] Released schema lock
0501 14:01:04.066447 (+    46us) write_op.cc:341] FINISH: Updating metrics
0501 14:01:04.068467 (+  2020us) write_op.cc:489] Releasing partition, row and schema locks
0501 14:01:04.068500 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":1494,"apply.run_cpu_time_us":3041,"apply.run_wall_time_us":4829,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2691,"prepare.run_wall_time_us":2690,"replication_time_us":2437}]]}
I20260501 14:01:04.219349  7577 catalog_manager.cc:5671] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.223287  7577 catalog_manager.cc:5671] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 10 to 11, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 11 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.227574  7577 catalog_manager.cc:5671] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.232803  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.234763  7643 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.234181  7577 catalog_manager.cc:5671] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 15 to 16, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 16 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.242121  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:04.238245  7577 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index -1 to 14, term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } }
I20260501 14:01:04.248945  6454 raft_consensus.cc:2272] T 43e99f3322c2477888132a818eae4971 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.241823 13436 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:04.247129 13390 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:04.251874 13390 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:04.252391 13390 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:04.219064 13563 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:04.266891  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 49338.7us
I20260501 14:01:04.272699 13563 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Requested vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.278450  6454 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.279572  6454 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.280570  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947"
I20260501 14:01:04.283991  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.290027 13436 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.293767 13539 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.298990  7819 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.302809  7753 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 18: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:04.307179  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:04.307869  8377 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:04.311378 13428 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.311980 13428 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.312039 13436 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.314898  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:04.316099 13436 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.317253  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.314128 13428 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.322106  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.325245  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.325378  7643 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.326630 13428 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.327448  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.328225  6454 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.328294 13428 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.331183  6454 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.334596 13390 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.336182  7824 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 109c9ba263c34ff8aee17bc446cf258e in current term 18: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:04.335942  8377 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 18.
I20260501 14:01:04.366707  7718 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:04.368036 13397 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:01:04.369185 13397 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:04.377523  6454 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.373361 13397 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.400344 13390 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.402209  7746 raft_consensus.cc:2955] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.404810  6454 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.408419  6454 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.409337  6454 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.409945  6454 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.425348  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 93b661856a9e45bf823981177d99ae0c with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260501 14:01:04.427484  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:04.429756  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:04.431684  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:04.432519  8377 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca8dd10afb304b4c96cfcec7e2309947 in current term 18: Already voted for candidate 109c9ba263c34ff8aee17bc446cf258e in this term.
I20260501 14:01:04.433365  6454 tablet_replica.cc:333] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.434931  6454 raft_consensus.cc:2243] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.436582 13428 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.437224 13428 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.439342 13428 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.443536  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.455448  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.456305  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.456526 13388 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260501 14:01:04.458050  7643 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.458801 13428 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:04.474750  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:04.481089  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:04.486447  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:04.481350  6454 raft_consensus.cc:2272] T ee17e865655f4db7affb37902439a8be P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.491114  6454 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.509030  7574 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 17 to 18, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 18 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.511803  7574 catalog_manager.cc:5671] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 10 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.514870  7574 catalog_manager.cc:5671] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.516350 13428 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.510175  6454 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.527088 13428 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.527581  6454 pending_rounds.cc:70] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:04.528911  6454 pending_rounds.cc:77] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 8 index: 8 } timestamp: 7281230018853801984 op_type: NO_OP noop_request { }
I20260501 14:01:04.529259  6454 raft_consensus.cc:2889] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:04.529693  6454 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P bc1b0a0a152e46fea4bd4934ba9976ed [term 9 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.534550 13428 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.536259  7574 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:04.545840  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.550259  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.557000  7643 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.557886 13428 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:04.587039 13428 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.587690 13428 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:04.589948 13428 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:04.586695  6454 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.594022  7746 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:04.594949  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:04.596686  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.602337  6454 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.604770  6454 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.610478  7643 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:04.614578  6454 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:04.616688 13428 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:04.615621  6454 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.626606  6454 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:04.666208  7819 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260501 14:01:04.679468 13563 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260501 14:01:04.682677  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c91be7730b684fbd94e69655ab35fd61. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:04.682211  7575 catalog_manager.cc:5671] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 12 to 14, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 14 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:04.695274  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
W20260501 14:01:04.696017  8344 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 257 similar messages]
I20260501 14:01:04.696488  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:04.712827  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:04.853816  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:04.868410 13587 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.861195 13590 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:04.872131 13590 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.879107 13590 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.872223 13587 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.881631 13587 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.890484 13590 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:04.891491 13590 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:04.896741 13590 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:04.924809  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:04.928370  7562 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 88592.9us
I20260501 14:01:04.972750  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:04.981861  6454 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
W20260501 14:01:04.988411  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:04.992478  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:05.003806  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.008627  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 16 to 18, leader changed from 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 18 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.020977  6454 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:05.027392  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.034205  6454 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.033732  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:05.039964  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260501 14:01:05.069096  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.061343 13592 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:05.093298  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 54768.9us
I20260501 14:01:05.119408  8377 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260501 14:01:05.119462  6454 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.121904  6454 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.122541  6454 pending_rounds.cc:70] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.122802  6454 pending_rounds.cc:77] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7281230012247425024 op_type: NO_OP noop_request { }
I20260501 14:01:05.123149  6454 raft_consensus.cc:2889] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.126639  6454 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.134630  7819 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260501 14:01:05.140717  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.095745 13592 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:05.156641  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.158466  7643 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.159796  7643 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.162752 13587 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:05.117625 13595 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.173750 13592 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.176568  7643 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.179752  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.183926  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:05.184739  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.191895 13587 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:05.195766  7643 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.185492 13592 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:05.203246  6454 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.204290  6454 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:05.205513  6454 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.208005  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.210420 13592 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:05.213083  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.213721  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.215575  6454 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.216668  6454 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.217696  6454 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.220795  6454 tablet_replica.cc:333] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.234874  6454 raft_consensus.cc:2243] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.234169  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 14 to 15, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.235541  6454 pending_rounds.cc:70] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.235800  6454 pending_rounds.cc:77] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 16 index: 9 } timestamp: 7281230056671744000 op_type: NO_OP noop_request { }
I20260501 14:01:05.236172  6454 raft_consensus.cc:2889] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.236536  6454 raft_consensus.cc:2272] T f9b540df5a794f06ab617858163d4297 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.242470 13592 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.243018 13592 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:05.245136 13592 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.252025  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.261778  7826 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.239707  6454 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.266909  6454 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.273808  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.276633  7643 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.278855 13592 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:05.279147 13605 ts_tablet_manager.cc:933] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:05.281163  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.282634  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.283386  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.287003 13603 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260501 14:01:05.293558  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.295356  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.302596  6454 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.309187  6454 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.308200 13603 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260501 14:01:05.310261  6454 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.310901  6454 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.312315 13605 tablet_copy_client.cc:323] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:01:05.315424  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet c91be7730b684fbd94e69655ab35fd61 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:01:05.316051  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet c91be7730b684fbd94e69655ab35fd61 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-c91be7730b684fbd94e69655ab35fd61
I20260501 14:01:05.327168  7764 tablet_copy_source_session.cc:215] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
W20260501 14:01:05.330821  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.335453  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.336755  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.333596 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c91be7730b684fbd94e69655ab35fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:05.341572 13592 raft_consensus.cc:493] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.342142 13592 raft_consensus.cc:515] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:05.341903  7753 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:05.344184 13592 leader_election.cc:290] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:05.334106  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.345577  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.346381  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.346984  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.347599  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.349938  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.354256  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a0dc7ba0d34f5c9d9eb78874fd40bc" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:05.363113  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.362322  7643 leader_election.cc:304] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:05.370738  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.371749  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:05.367923  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.372740 13592 raft_consensus.cc:2749] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:05.374118 13592 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.374606 13592 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:05.376433  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.377605  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.376590 13592 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.383733  6454 pending_rounds.cc:70] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.383420  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.384202  6454 pending_rounds.cc:77] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7281230000561123328 op_type: NO_OP noop_request { }
I20260501 14:01:05.384913  6454 raft_consensus.cc:2889] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.385919  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.388571  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.389925  7824 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260501 14:01:05.390619  7643 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:05.391306  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.392961 13592 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:05.395164  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.397136 13594 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260501 14:01:05.401371  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47951612b03c496aa487574a115ca380. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:05.408891  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.417897  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:05.423511  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.434108  6454 tablet_replica.cc:333] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
W20260501 14:01:05.438125  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.438959 13592 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.439617 13592 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:05.441741 13592 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.439137  6454 raft_consensus.cc:2243] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.443569  6454 raft_consensus.cc:2272] T ac3b0214563f48f689fc427a69b7b5dd P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.445580  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.458218  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.462159 13605 tablet_copy_client.cc:806] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:05.462957 13605 tablet_copy_client.cc:670] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:05.463406  7643 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.464429 13592 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:05.466650  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.475241  6454 tablet_replica.cc:333] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.476310  6454 raft_consensus.cc:2243] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.476866  6454 raft_consensus.cc:2272] T 365625e9a5a1458e951f04698e1cc682 P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.478343 13605 tablet_copy_client.cc:538] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:05.478992 13595 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 14:01:05.489003  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.489658  6454 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.491869  7826 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
W20260501 14:01:05.493152  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.494292  6454 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.494949  6454 pending_rounds.cc:70] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.495253  6454 pending_rounds.cc:77] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7281230040542085120 op_type: NO_OP noop_request { }
I20260501 14:01:05.495622  6454 raft_consensus.cc:2889] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.496042  6454 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.499514  6454 tablet_replica.cc:333] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.500387  6454 raft_consensus.cc:2243] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.500986  6454 raft_consensus.cc:2272] T 5ecf82e363814b0084cab2799c85ee9d P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.504443  6454 tablet_replica.cc:333] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.505424  6454 raft_consensus.cc:2243] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.506435  6454 raft_consensus.cc:2272] T a7e6863e401d47c485d22868ddfb6a08 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.510191  6454 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.511077  6454 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.511622  6454 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.514829  6454 tablet_replica.cc:333] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.515772  6454 raft_consensus.cc:2243] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.516296 13592 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:05.517060 13592 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:05.519065 13592 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:05.520608  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.523259  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:05.524756  7643 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:05.526003 13592 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:05.533754  6454 raft_consensus.cc:2272] T 2a2975a86035451cb56a7caf76296505 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.540767  7824 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 14:01:05.544508  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.549556  7576 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 9, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.552098 13605 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 14:01:05.564493  6454 tablet_replica.cc:333] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.572728  6454 raft_consensus.cc:2243] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.573756  6454 pending_rounds.cc:70] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 1 pending ops.
I20260501 14:01:05.574046  6454 pending_rounds.cc:77] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7281229956481773568 op_type: NO_OP noop_request { }
I20260501 14:01:05.574498  6454 raft_consensus.cc:2889] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.574909  6454 raft_consensus.cc:2272] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.599200  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.602998  7747 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260501 14:01:05.605111  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f623f4077ef4ffdad05ca3c40797b9f. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.608609 13406 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260501 14:01:05.612084  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.616287  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.617388  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.618178  6454 pending_rounds.cc:70] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 2 pending ops.
I20260501 14:01:05.618464  6454 pending_rounds.cc:77] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7281229952021377024 op_type: NO_OP noop_request { }
I20260501 14:01:05.624356  6454 raft_consensus.cc:2889] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.624727  6454 pending_rounds.cc:77] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 7 index: 7 } timestamp: 7281229908334153728 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c445f628c10d40b5a232bb391c4c92de" old_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } } }
I20260501 14:01:05.631495  6454 raft_consensus.cc:2917] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted
I20260501 14:01:05.632006  6454 raft_consensus.cc:2889] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.632349  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.635499  6454 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.636410  6454 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.637203  6454 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.640347  6454 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.641902  6454 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:05.642794  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.644142  6454 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.648993 13585 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.653429  6454 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.654421  6454 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.655097  6454 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.658414  6454 tablet_replica.cc:333] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.664476  7747 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.678455  6454 raft_consensus.cc:2243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.679387  6454 raft_consensus.cc:2272] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.689962  6454 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.690899  6454 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.693842  6454 pending_rounds.cc:70] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 2 pending ops.
I20260501 14:01:05.694460  6454 pending_rounds.cc:77] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7281229974682984448 op_type: NO_OP noop_request { }
I20260501 14:01:05.694952  6454 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.697265  7576 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index -1 to 8, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.700569  6454 pending_rounds.cc:77] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7281229922317611008 op_type: NO_OP noop_request { }
I20260501 14:01:05.701092  6454 raft_consensus.cc:2889] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.701493  6454 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P bc1b0a0a152e46fea4bd4934ba9976ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.704658  6454 tablet_replica.cc:333] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.712864  6454 raft_consensus.cc:2243] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.713713  6454 raft_consensus.cc:2272] T c1e64ae6fa3e42b5be743466a0338478 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.722558  7747 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
W20260501 14:01:05.747807  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.765574  6454 tablet_replica.cc:333] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.775884  6454 raft_consensus.cc:2243] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.776736  6454 raft_consensus.cc:2272] T 3df4d60525ad4852996138e9e813b608 P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.808246  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:05.815259  6454 tablet_replica.cc:333] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.815706  7824 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260501 14:01:05.829519  6454 raft_consensus.cc:2243] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.830626  6454 raft_consensus.cc:2272] T eed0026bd9c541b7b89c956e31761d54 P bc1b0a0a152e46fea4bd4934ba9976ed [term 15 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:05.823676  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155): Couldn't send request to peer 91854d93e96c4756834efe8b2ef59fce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 959ae22d6e614940b93df344dbf7fa20. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.840415  6454 tablet_replica.cc:333] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.841410  6454 raft_consensus.cc:2243] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.842124  6454 raft_consensus.cc:2272] T fed0245aa0064b4c8685aeb38d1de9c0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.846681 13563 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260501 14:01:05.854604 13605 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:01:05.855908 13605 tablet_bootstrap.cc:492] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:05.856832 13605 ts_tablet_manager.cc:1403] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.349s	user 0.049s	sys 0.021s
W20260501 14:01:05.874256  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:05.880978 13618 ts_tablet_manager.cc:933] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:05.892746 13592 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:05.893908 13592 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:05.901284  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:05.898947  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.909674  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:05.910558  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.912338  7643 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc1b0a0a152e46fea4bd4934ba9976ed; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:05.897771 13592 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:05.914582 13592 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:05.915490 13618 tablet_copy_client.cc:323] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:01:05.917352  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 47951612b03c496aa487574a115ca380 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:01:05.917893  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 47951612b03c496aa487574a115ca380 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-47951612b03c496aa487574a115ca380
I20260501 14:01:05.925312  6454 pending_rounds.cc:70] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Trying to abort 3 pending ops.
I20260501 14:01:05.925684  6454 pending_rounds.cc:77] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7281229884388577280 op_type: NO_OP noop_request { }
I20260501 14:01:05.926151  6454 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.926486  6454 pending_rounds.cc:77] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7281229866539462656 op_type: NO_OP noop_request { }
I20260501 14:01:05.926833  6454 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.927130  6454 pending_rounds.cc:77] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7281229836714962944 op_type: NO_OP noop_request { }
I20260501 14:01:05.927465  6454 raft_consensus.cc:2889] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260501 14:01:05.928623  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P bc1b0a0a152e46fea4bd4934ba9976ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.892916 13605 raft_consensus.cc:359] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:05.931982  6454 tablet_replica.cc:333] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:05.937633  6454 raft_consensus.cc:2243] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:05.936668 13605 raft_consensus.cc:740] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:05.941372 13605 consensus_queue.cc:260] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:05.943496 13563 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 8 to 11, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.947054  7764 tablet_copy_source_session.cc:215] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:01:05.959180 13605 ts_tablet_manager.cc:1434] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.004s
I20260501 14:01:05.946941  7825 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 8 to 11, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } } }
I20260501 14:01:05.964408  6454 raft_consensus.cc:2272] T 39ab56a6d5d641c4b64cc945f297bd2b P bc1b0a0a152e46fea4bd4934ba9976ed [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:05.978739  7576 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 8 to 11, NON_VOTER 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) added. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:05.983273 13618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47951612b03c496aa487574a115ca380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:05.998267  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-c91be7730b684fbd94e69655ab35fd61 received from {username='slave'} at 127.0.0.1:42716
I20260501 14:01:06.000469  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-c91be7730b684fbd94e69655ab35fd61 on tablet c91be7730b684fbd94e69655ab35fd61 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:06.004241  6454 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:06.007341  6454 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:06.008035  6454 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:06.011000  6454 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:06.030992  6454 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:06.056041  6454 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P bc1b0a0a152e46fea4bd4934ba9976ed [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:06.085608  6454 tablet_replica.cc:333] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed: stopping tablet replica
I20260501 14:01:06.086344  6454 raft_consensus.cc:2243] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:06.086998  6454 raft_consensus.cc:2272] T c6b7bef99f44450d853fce321082a78b P bc1b0a0a152e46fea4bd4934ba9976ed [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:06.103541  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 66613.3us
W20260501 14:01:06.121217  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:06.156042 13618 tablet_copy_client.cc:806] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:06.156862 13618 tablet_copy_client.cc:670] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:06.179775  8376 raft_consensus.cc:1217] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
I20260501 14:01:06.194962 13605 ts_tablet_manager.cc:933] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:06.204973 13618 tablet_copy_client.cc:538] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:06.243253 13618 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
I20260501 14:01:06.272454 13605 tablet_copy_client.cc:323] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.131:35015
I20260501 14:01:06.282177  7838 tablet_copy_service.cc:140] P ca8dd10afb304b4c96cfcec7e2309947: Received BeginTabletCopySession request for tablet 0f623f4077ef4ffdad05ca3c40797b9f from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:45436)
I20260501 14:01:06.282802  7838 tablet_copy_service.cc:161] P ca8dd10afb304b4c96cfcec7e2309947: Beginning new tablet copy session on tablet 0f623f4077ef4ffdad05ca3c40797b9f from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:45436: session id = 91854d93e96c4756834efe8b2ef59fce-0f623f4077ef4ffdad05ca3c40797b9f
I20260501 14:01:06.300866  7838 tablet_copy_source_session.cc:215] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:01:06.304888 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f623f4077ef4ffdad05ca3c40797b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:06.306664 13626 ts_tablet_manager.cc:933] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Initiating tablet copy from peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:06.323971 13626 tablet_copy_client.cc:323] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Beginning tablet copy session from remote peer at address 127.6.77.130:41997
I20260501 14:01:06.331117  7764 tablet_copy_service.cc:140] P 109c9ba263c34ff8aee17bc446cf258e: Received BeginTabletCopySession request for tablet 959ae22d6e614940b93df344dbf7fa20 from peer 91854d93e96c4756834efe8b2ef59fce ({username='slave'} at 127.0.0.1:42716)
I20260501 14:01:06.331758  7764 tablet_copy_service.cc:161] P 109c9ba263c34ff8aee17bc446cf258e: Beginning new tablet copy session on tablet 959ae22d6e614940b93df344dbf7fa20 from peer 91854d93e96c4756834efe8b2ef59fce at {username='slave'} at 127.0.0.1:42716: session id = 91854d93e96c4756834efe8b2ef59fce-959ae22d6e614940b93df344dbf7fa20
I20260501 14:01:06.341646  7764 tablet_copy_source_session.cc:215] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: Tablet Copy: opened 0 blocks and 1 log segments
I20260501 14:01:06.353554 13626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959ae22d6e614940b93df344dbf7fa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:06.382043 13605 tablet_copy_client.cc:806] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:06.382927 13605 tablet_copy_client.cc:670] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:06.389230 13605 tablet_copy_client.cc:538] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:06.424685 13563 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.425390 13563 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.427486 13563 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:06.434064  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:06.437371  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:06.447077  7562 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 51280.4us
I20260501 14:01:06.451634 13605 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
W20260501 14:01:06.458642  7718 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.460539  7718 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:06.461484 13624 raft_consensus.cc:2749] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:06.487511 13626 tablet_copy_client.cc:806] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 0 data blocks...
I20260501 14:01:06.493558 13626 tablet_copy_client.cc:670] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Starting download of 1 WAL segments...
I20260501 14:01:06.496685 13622 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.497385 13622 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.501539  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:06.502285  7752 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 11.
I20260501 14:01:06.499567 13622 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:06.504329  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
W20260501 14:01:06.506237  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260501 14:01:06.506572 13624 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.508553 13624 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.510308 13622 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260501 14:01:06.510747 13626 tablet_copy_client.cc:538] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260501 14:01:06.510869 13624 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:06.512241  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:06.513195  8375 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 14.
I20260501 14:01:06.510807 13622 raft_consensus.cc:493] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.518416 13622 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:06.515864  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: 
I20260501 14:01:06.523568 13563 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:06.524005 13563 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting leader election (detected failure of leader bc1b0a0a152e46fea4bd4934ba9976ed)
I20260501 14:01:06.524371 13563 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:06.528254 13618 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260501 14:01:06.529119  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.529418 13618 tablet_bootstrap.cc:492] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:06.530318 13618 ts_tablet_manager.cc:1403] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.287s	user 0.031s	sys 0.013s
W20260501 14:01:06.534396  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.539655 13618 raft_consensus.cc:359] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.550490 13563 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.558020 13622 raft_consensus.cc:515] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.563012 13563 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:06.564114 13626 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap starting.
W20260501 14:01:06.567970  7718 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.570655  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:06.571288  8375 raft_consensus.cc:3060] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:06.580874  8344 leader_election.cc:336] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:06.540731 13618 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:06.585017 13622 leader_election.cc:290] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Requested vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:06.586897  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a337f1f80f84ec1b4f2ed376a8436ea" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e"
I20260501 14:01:06.587534  7752 raft_consensus.cc:3060] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Advancing to term 12
I20260501 14:01:06.594897  8375 raft_consensus.cc:2468] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 109c9ba263c34ff8aee17bc446cf258e in term 15.
I20260501 14:01:06.583808 13618 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.596694  7752 raft_consensus.cc:2468] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 12.
I20260501 14:01:06.598167 13618 ts_tablet_manager.cc:1434] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260501 14:01:06.598948  7718 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:06.599958 13624 raft_consensus.cc:2804] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:01:06.600455 13624 raft_consensus.cc:697] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Becoming Leader. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:06.598995  8344 leader_election.cc:304] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:06.601732 13622 raft_consensus.cc:2804] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader election won for term 12
I20260501 14:01:06.601305 13624 consensus_queue.cc:237] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.602432 13622 raft_consensus.cc:697] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Becoming Leader. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Running, Role: LEADER
I20260501 14:01:06.603343 13622 consensus_queue.cc:237] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:06.603787  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-47951612b03c496aa487574a115ca380 received from {username='slave'} at 127.0.0.1:42716
I20260501 14:01:06.604306  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-47951612b03c496aa487574a115ca380 on tablet 47951612b03c496aa487574a115ca380 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:06.632114  8376 raft_consensus.cc:1217] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260501 14:01:06.659969  7575 catalog_manager.cc:5671] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: term changed from 14 to 15, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130). New cstate: current_term: 15 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:06.692782 13605 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:01:06.713414  7576 catalog_manager.cc:5671] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce reported cstate change: term changed from 11 to 12, leader changed from bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) to 91854d93e96c4756834efe8b2ef59fce (127.6.77.132). New cstate: current_term: 12 leader_uuid: "91854d93e96c4756834efe8b2ef59fce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260501 14:01:06.744362 13605 tablet_bootstrap.cc:492] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:06.745729 13605 ts_tablet_manager.cc:1403] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.294s	user 0.035s	sys 0.010s
I20260501 14:01:06.792030 13605 raft_consensus.cc:359] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.793962 13605 raft_consensus.cc:740] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:06.794792 13605 consensus_queue.cc:260] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:06.797473 13605 ts_tablet_manager.cc:1434] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260501 14:01:06.805284  7838 tablet_copy_service.cc:342] P ca8dd10afb304b4c96cfcec7e2309947: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-0f623f4077ef4ffdad05ca3c40797b9f received from {username='slave'} at 127.0.0.1:45436
I20260501 14:01:06.805862  7838 tablet_copy_service.cc:434] P ca8dd10afb304b4c96cfcec7e2309947: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-0f623f4077ef4ffdad05ca3c40797b9f on tablet 0f623f4077ef4ffdad05ca3c40797b9f with peer 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:06.856209  7718 connection.cc:744] client connection to 127.6.77.129:36443 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260501 14:01:06.858227  7792 connection.cc:570] client connection to 127.6.77.129:36443 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260501 14:01:06.858530  8344 connection.cc:570] client connection to 127.6.77.129:36443 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260501 14:01:06.912830  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 44457us
W20260501 14:01:06.912446  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 53350.5us
W20260501 14:01:06.994679  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:06.999989 13644 raft_consensus.cc:1064] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.002620 13644 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:07.040093  8375 raft_consensus.cc:1275] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260501 14:01:07.055491 13639 consensus_queue.cc:1048] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260501 14:01:07.091728  8376 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260501 14:01:07.095831  7824 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260501 14:01:07.098436  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:07.116497 13638 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260501 14:01:07.127210  7718 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:07.139484  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:07.156172  8376 raft_consensus.cc:1217] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260501 14:01:07.161159  7745 raft_consensus.cc:1275] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer 91854d93e96c4756834efe8b2ef59fce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260501 14:01:07.170288 13622 consensus_queue.cc:1048] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260501 14:01:07.182116  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 54415.5us
I20260501 14:01:07.215973 13626 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:01:07.217263 13626 tablet_bootstrap.cc:492] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Bootstrap complete.
I20260501 14:01:07.218111 13626 ts_tablet_manager.cc:1403] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Time spent bootstrapping tablet: real 0.683s	user 0.050s	sys 0.029s
I20260501 14:01:07.223469 13638 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260501 14:01:07.253715 13626 raft_consensus.cc:359] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:07.254727 13626 raft_consensus.cc:740] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 91854d93e96c4756834efe8b2ef59fce, State: Initialized, Role: LEARNER
I20260501 14:01:07.255451 13626 consensus_queue.cc:260] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: NON_VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: true } }
I20260501 14:01:07.277609 13626 ts_tablet_manager.cc:1434] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.003s
I20260501 14:01:07.283459  8376 raft_consensus.cc:1217] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260501 14:01:07.315940  7764 tablet_copy_service.cc:342] P 109c9ba263c34ff8aee17bc446cf258e: Request end of tablet copy session 91854d93e96c4756834efe8b2ef59fce-959ae22d6e614940b93df344dbf7fa20 received from {username='slave'} at 127.0.0.1:42716
I20260501 14:01:07.316591  7764 tablet_copy_service.cc:434] P 109c9ba263c34ff8aee17bc446cf258e: ending tablet copy session 91854d93e96c4756834efe8b2ef59fce-959ae22d6e614940b93df344dbf7fa20 on tablet 959ae22d6e614940b93df344dbf7fa20 with peer 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:07.338843 13638 raft_consensus.cc:1064] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.341989 13638 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.363695  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.370923  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.371595  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.381678  8380 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260501 14:01:07.383889  7826 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260501 14:01:07.388872  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.391709  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.412003 13659 log.cc:927] Time spent T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.005s
W20260501 14:01:07.426680 13661 log.cc:927] Time spent T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.008s
W20260501 14:01:07.444607  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 55189.7us
I20260501 14:01:07.476502 13563 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260501 14:01:07.489882  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.492897 13603 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260501 14:01:07.493086 13563 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.487388  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.501752  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.503656  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.521867  7718 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:07.523541  8380 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.557150  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.567052 13645 raft_consensus.cc:1064] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.569700 13645 consensus_queue.cc:237] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:07.572041  7575 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce reported cstate change: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.607057  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.610231  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.610834  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.613629 13641 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.629499  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.642766  7824 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.658025  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.659853  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.668828  8380 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.683195  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.683350  8375 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 LEARNER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260501 14:01:07.686484  7752 raft_consensus.cc:1275] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260501 14:01:07.689654  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:07.692028 13635 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260501 14:01:07.695236 13586 consensus_queue.cc:1048] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260501 14:01:07.704221  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:07.705132  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.716518  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.727020  7824 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.729776 13641 raft_consensus.cc:1064] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: attempting to promote NON_VOTER 91854d93e96c4756834efe8b2ef59fce to VOTER
I20260501 14:01:07.732808 13641 consensus_queue.cc:237] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.765131  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.762470 13586 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.767930  7752 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.780670  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.785458  8377 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 LEARNER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:01:07.794123  7819 raft_consensus.cc:1275] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:01:07.796641 13563 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:07.807576  7747 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.808193  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:07.815779  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.822592  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.820456  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 9 to 10, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: true } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.827147  7826 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260501 14:01:07.833449 13642 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260501 14:01:07.837558 13642 consensus_queue.cc:1048] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:07.842381 13642 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.848603  8380 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260501 14:01:07.857532  7576 catalog_manager.cc:5671] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.867836  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c91be7730b684fbd94e69655ab35fd61 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260501 14:01:07.876533  7826 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:07.897802  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.903759  7745 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:07.906468  7562 catalog_manager.cc:5194] ChangeConfig:REMOVE_PEER RPC for tablet c91be7730b684fbd94e69655ab35fd61 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER failed with leader 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 16 but the committed config has opid_index of 17
I20260501 14:01:07.912238  7575 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 20 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:07.916620  8376 raft_consensus.cc:2955] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.921732 13644 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260501 14:01:07.934760  7824 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260501 14:01:07.938017 13639 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:01:07.944322  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.958500  8380 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Refusing update from remote peer 109c9ba263c34ff8aee17bc446cf258e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260501 14:01:07.962517  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.963342  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:07.970883  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:07.971437 13563 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.966084  8375 raft_consensus.cc:2955] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:07.979949 13639 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260501 14:01:07.980904  6454 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7700)
I20260501 14:01:07.980803  7825 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:08.012225  8376 raft_consensus.cc:2955] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.033407  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.035247 13641 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.050062  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.055552  7819 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.063465  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.079927  7577 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: config changed from index 10 to 11, VOTER bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129) evicted. New cstate: current_term: 13 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
I20260501 14:01:08.093274  7575 catalog_manager.cc:5671] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e reported cstate change: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "109c9ba263c34ff8aee17bc446cf258e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260501 14:01:08.094561  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.107372  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 87708.4us
I20260501 14:01:08.116856  8377 raft_consensus.cc:2955] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 91854d93e96c4756834efe8b2ef59fce (127.6.77.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } } }
W20260501 14:01:08.122797  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:08.148713  7562 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 47951612b03c496aa487574a115ca380 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260501 14:01:08.150117  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.163349  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.240207  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.254669  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.255661  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.429575  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.602062  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.823354  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:08.845779  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 47951612b03c496aa487574a115ca380: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:08.981439  6454 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:09.327649  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.400453  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:09.640372  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46776.5us
W20260501 14:01:09.676142  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 91267.9us
W20260501 14:01:09.699769  7792 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 475 similar messages]
W20260501 14:01:09.739727  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.739966  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.748536  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:09.825944  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.849982  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.894575  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.917759  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.923979  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.978175  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:09.982007  6454 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:10.027640  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.030989  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.043561  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.047749  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.048406  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.049279  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.079704  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.191143  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.210150  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.237382  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.249926  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.263300  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:10.289497  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.329524  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:10.334853  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.340265  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.391175  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.394626  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.404502  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.419376  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.451807  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.484717  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.491974  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:10.503185  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.562783  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.635094  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.704424  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.710834  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.743428  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.836331  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48624.9us
W20260501 14:01:10.854360  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35015, user_credentials={real_user=slave}} blocked reactor thread for 46222.6us
W20260501 14:01:10.868196  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.889374  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.896175  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:10.982540  6454 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:11.021863  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.055548  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.132928  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.268745  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:11.385846  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 50119.6us
W20260501 14:01:11.927327  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:11.942795  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:11.983103  6454 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:12.044150  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.130812  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.136227  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.166299  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.211170  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.223889  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:12.303383  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.423373  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:12.507285  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:36443, user_credentials={real_user=slave}} blocked reactor thread for 49135.6us
W20260501 14:01:12.543771  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.582154  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.614598  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.622877  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.646340  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.676853  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.690066  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.691045  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.691743  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.696451  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.786450  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.810890  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.826864  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.832794  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.874372  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.880191  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:12.919562  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.944696  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:12.984261  6454 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:12.997830  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.036773  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.071470  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.089917  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.116868  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.153345  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:13.155997  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.189810  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.236925  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.268074  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.278710  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.297087  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.349522  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.392750  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.448634  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.514793  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.599931  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.645473  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:13.699363  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 45466.4us
W20260501 14:01:13.984862  6454 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:13.989826  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:14.180544  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:14.243701  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:14.372412  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.562232  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.600178  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.616603  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.706779  8344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260501 14:01:14.724450  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:14.759413  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.823525  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.824623  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.858657  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.966339  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.977592  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:14.985838  6454 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:15.018424  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.115307  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.158092  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.233549  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.241230  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.312170  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.331571  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.384745  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:15.398001  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.408030  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.412535  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.413230  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.456373  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.481004  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.544287  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.573292  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.593894  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.617447  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.618911  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.628577  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.629864  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.661595  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260501 14:01:15.697173  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.722658  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.770648  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.773875  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.855104  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.890616  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.897985  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:15.987354  6454 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 7700)
W20260501 14:01:16.049592  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.118453  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.217177  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.259294  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.575413  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:16.714834  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:16.737422  7718 consensus_peers.cc:597] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:16.738008  7718 consensus_peers.cc:597] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:16.958657  7718 consensus_peers.cc:597] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.062291  7718 consensus_peers.cc:597] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.116359  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:17.548942  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.574361  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:17.707562  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:18.242635 13723 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.244079 13723 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.276892 13723 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.297637 13725 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.298784 13723 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.301868 13723 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:18.299688  7793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.041s	sys 0.058s
W20260501 14:01:18.303900  7793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.041s	sys 0.060s
I20260501 14:01:18.299430 13725 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.291102 13724 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.306139 13724 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.307948 13725 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.305311 13723 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.310151 13724 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.319765 13730 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.320498 13730 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.327046 13730 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.331467 13730 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.332121 13730 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.334406 13730 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.338975 13731 raft_consensus.cc:493] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.339481 13732 raft_consensus.cc:493] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.339663 13731 raft_consensus.cc:515] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.340066 13732 raft_consensus.cc:515] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.342350 13731 leader_election.cc:290] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.342407 13732 leader_election.cc:290] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.357210 13735 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.358011 13735 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.361243 13735 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:18.490715  7791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.018s	sys 0.071s
W20260501 14:01:18.491752  7791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.019s	sys 0.071s
I20260501 14:01:18.493330 13727 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.494038 13727 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.495790 13727 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.499094 13730 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.500655 13730 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.502068 13728 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.502321 13723 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.506798 13733 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.506582 13728 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.507375 13733 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.509006 13728 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.502740 13727 raft_consensus.cc:493] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.511299 13727 raft_consensus.cc:515] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.512327 13733 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.510048 13731 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.513044 13731 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.513502 13727 leader_election.cc:290] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.518217 13731 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.647804 13731 raft_consensus.cc:493] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.648873 13731 raft_consensus.cc:515] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.651899 13731 leader_election.cc:290] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.510711 13737 raft_consensus.cc:493] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.789692 13737 raft_consensus.cc:515] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.792949 13737 leader_election.cc:290] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.710246 13733 raft_consensus.cc:493] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.796281 13733 raft_consensus.cc:515] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.624681 13723 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.799153 13723 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.775981 13732 raft_consensus.cc:493] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.800123 13732 raft_consensus.cc:515] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.510739 13730 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.802654 13732 leader_election.cc:290] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.806268 13733 leader_election.cc:290] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.884299 13730 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.884951 13730 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.887178 13730 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.897681 13737 raft_consensus.cc:493] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.898527 13737 raft_consensus.cc:515] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.901229 13737 leader_election.cc:290] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.902753 13737 raft_consensus.cc:493] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.903537 13737 raft_consensus.cc:515] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.909691 13737 leader_election.cc:290] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.912698 13737 raft_consensus.cc:493] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.910358 13740 raft_consensus.cc:493] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.913899 13740 raft_consensus.cc:515] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.922072 13740 leader_election.cc:290] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.913300 13737 raft_consensus.cc:515] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.924692 13737 leader_election.cc:290] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:18.919595  7718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.012s	sys 0.005s
I20260501 14:01:18.927538 13736 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.928159 13736 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.931280 13736 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.946888 13736 raft_consensus.cc:493] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.947929 13729 raft_consensus.cc:493] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.948184 13731 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.947458 13736 raft_consensus.cc:515] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.948743 13729 raft_consensus.cc:515] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.950930 13736 leader_election.cc:290] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.951052 13729 leader_election.cc:290] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.951530 13736 raft_consensus.cc:493] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.948832 13731 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.947881 13741 raft_consensus.cc:493] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.954562 13731 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.954788 13741 raft_consensus.cc:515] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.952085 13736 raft_consensus.cc:515] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.956933 13741 leader_election.cc:290] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.957430 13741 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.957901 13741 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:18.961221  7792 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.010s
I20260501 14:01:18.962683 13736 leader_election.cc:290] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:18.963179  8345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.003s
W20260501 14:01:18.963708  8345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.003s
W20260501 14:01:18.961725  7792 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.011s
I20260501 14:01:18.971928 13729 raft_consensus.cc:493] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.973196 13729 raft_consensus.cc:515] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.976580 13729 leader_election.cc:290] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.981182 13731 raft_consensus.cc:493] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:18.981882 13731 raft_consensus.cc:515] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.984261 13731 leader_election.cc:290] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:18.988081 13730 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.988708 13730 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.989723 13743 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.990309 13743 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.990847 13728 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.991000 13723 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.991506 13728 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.991658 13723 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.992555 13743 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.993608 13728 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.993817 13723 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.994190 13728 raft_consensus.cc:493] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 91854d93e96c4756834efe8b2ef59fce)
I20260501 14:01:18.994445 13723 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.994751 13728 raft_consensus.cc:515] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:18.994959 13723 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:18.990789 13730 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:18.998198 13723 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:18.999275 13739 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.000026 13739 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.010497 13728 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.011341 13739 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.012883 13744 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
W20260501 14:01:19.026206  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8720 after lost signal to thread 6457
I20260501 14:01:19.026418  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.027834  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800040cc0 after lost signal to thread 7611
W20260501 14:01:19.029970  7849 debug-util.cc:398] Leaking SignalData structure 0x7b0800227220 after lost signal to thread 7778
I20260501 14:01:18.961710 13741 leader_election.cc:290] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:19.033806  7849 debug-util.cc:398] Leaking SignalData structure 0x7b080027d540 after lost signal to thread 7852
I20260501 14:01:19.034464  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.018081  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.024931 13746 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:18.993854 13743 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.033547  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.037147 13743 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.039481 13743 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.039986 13743 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.040509 13743 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.026093 13744 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.043325 13744 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.043860 13744 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.044332 13744 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.046257 13744 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.046747 13744 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.016911 13745 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.048323 13745 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.050369 13745 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.050812 13745 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.051246 13745 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.048347  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecf82e363814b0084cab2799c85ee9d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.047217 13744 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.062341 13748 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.063025  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e99f3322c2477888132a818eae4971" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.079012  7849 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf0e0 after lost signal to thread 8405
I20260501 14:01:19.064849  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.065078  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.084395 13744 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.064626 13745 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.085706 13745 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.086323 13745 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.088088 13622 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.088711 13622 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.090476 13745 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.061031 13746 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.091163 13745 raft_consensus.cc:493] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.092743 13746 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.092530 13745 raft_consensus.cc:515] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.090685 13622 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.094216 13746 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.094820 13746 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.096421 13745 leader_election.cc:290] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015), bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443)
I20260501 14:01:19.085033 13744 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.097132 13746 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.101632  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.064288 13743 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.105209 13744 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.109900 13744 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.063246 13748 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.112725 13748 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.107025  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.124542 13746 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.125576 13746 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.132990  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3b0214563f48f689fc427a69b7b5dd" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.135998 13743 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.136132  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.136749 13743 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.138432 13746 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.146651  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed0245aa0064b4c8685aeb38d1de9c0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.148471 13743 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.161981  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6866ee2ef62c4f999f3e6c7b7a6d7aa9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.162618  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6863e401d47c485d22868ddfb6a08" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.163676 13746 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.164000 13751 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.164295 13746 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.164726 13751 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.165503  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cde3c3e4a3b462b8f274fec8e2adbe3" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.166496 13746 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.168823  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b7bef99f44450d853fce321082a78b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.169386 13745 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.168943 13744 raft_consensus.cc:493] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.169898 13745 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.170090 13744 raft_consensus.cc:515] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.172068 13743 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.172711 13744 leader_election.cc:290] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.172600 13743 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.173274 13744 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.173739 13744 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.174754 13743 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.175294 13743 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.175724 13744 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.177155 13622 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.175733 13743 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.180074 13622 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.181905 13622 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.177556 13748 raft_consensus.cc:493] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.182808  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.182688 13748 raft_consensus.cc:515] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.184482 13743 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:19.184670 13748 leader_election.cc:290] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.185374 13745 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.167209 13751 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.205783  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ab56a6d5d641c4b64cc945f297bd2b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.208181  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1911462b92946d6b35f09cf9509128d" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.210018  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.212114 13751 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.212239  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee17e865655f4db7affb37902439a8be" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.213207  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.213685  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.214792  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.216200  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df4d60525ad4852996138e9e813b608" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.217425  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3031b746c62f413a9da6fed211d638da" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.217757  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed0026bd9c541b7b89c956e31761d54" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.218431 13755 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:19.218995 13755 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.219399  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.220362  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9517b581244993be7b40b089a96bd0" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.221318 13755 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.213631 13751 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.222635  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f9a0d66d094218a7a19cb600d50a75" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.224284 13751 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:19.224846  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.227918  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.230458  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1551821b4ac3438ea79dc8c95256cfde" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.239302  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.240885  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.242342  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.246523  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.249396  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.250787  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.254536  7718 leader_election.cc:336] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.255064  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.255110  7718 leader_election.cc:304] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.257977  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.260425  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365625e9a5a1458e951f04698e1cc682" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.260478  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.261801  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2975a86035451cb56a7caf76296505" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.263043  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.266098  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294b76c5890f455f97130fdbedace9af" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.268296 13741 raft_consensus.cc:2749] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.268388  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.271351  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262547d9184416ab702339797bead6f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.273401  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a769b271cb04497eb1cb86169399ceb2" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.278334  7718 leader_election.cc:336] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.279093  7718 leader_election.cc:304] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.280006 13741 raft_consensus.cc:2749] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.280751  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f875366331345f08d2e236a76c1c71d" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.281138  7718 leader_election.cc:336] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.281697  7718 leader_election.cc:304] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.282589 13741 raft_consensus.cc:2749] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.283237  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.282586  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b540df5a794f06ab617858163d4297" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.284937  7718 leader_election.cc:336] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.285542  7718 leader_election.cc:304] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.286378 13741 raft_consensus.cc:2749] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.287524  7718 leader_election.cc:336] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.290175  7718 leader_election.cc:304] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.290735  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c8497c73c3498ca73ca16b7f2da7cd" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.291054 13740 raft_consensus.cc:2749] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:19.293156  7718 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.293203  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.293855  7718 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.294656 13740 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.295143  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.295631  7718 consensus_peers.cc:597] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.296329  7718 leader_election.cc:336] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.296805  7718 leader_election.cc:304] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.297542 13740 raft_consensus.cc:2749] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:19.299587  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.300938  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.303771  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.304358  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b217e36f6e5e4fc38ba6e4ad89082fc6" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.305166  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d228d3d4af349679aafa8dfdebf1247" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.309636  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.310791  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.310462  7718 leader_election.cc:336] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.311573  7718 leader_election.cc:304] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.312178  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.312480 13740 raft_consensus.cc:2749] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:19.313577  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c469ec5051564ef892cf10d14e1eb6d4" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.313727  7718 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.314373  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.315204 13740 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.316270  7718 leader_election.cc:336] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.316795  7718 leader_election.cc:304] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.317593 13740 raft_consensus.cc:2749] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.318740  7718 leader_election.cc:336] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.319353  7718 leader_election.cc:304] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.322180 13740 raft_consensus.cc:2749] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.323948  7718 leader_election.cc:336] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.324572  7718 leader_election.cc:336] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.325042  7718 leader_election.cc:304] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.325788 13740 raft_consensus.cc:2749] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.327409  7718 consensus_peers.cc:597] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.327972  7718 leader_election.cc:336] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.328423  7718 leader_election.cc:304] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.337447 13741 raft_consensus.cc:2749] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.339238  7718 consensus_peers.cc:597] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.344573  7718 consensus_peers.cc:597] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.345167  7718 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.345669  7718 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.352655  7718 leader_election.cc:336] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.352655 13733 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.355100  7718 leader_election.cc:304] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.356936  7718 leader_election.cc:336] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.363801  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.364691  8380 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:19.359210 13731 raft_consensus.cc:2749] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:19.366309  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.368346  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.368980  8375 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:01:19.369168  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:19.369688  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.370589  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.371014  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.371167  8380 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
I20260501 14:01:19.373543  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.373979  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.374653  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:01:19.376061 13728 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.380331  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.381093  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.384532  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.386930  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.387737 13728 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.394243  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.394901  8373 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
I20260501 14:01:19.396173  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.396730  8373 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:01:19.397950  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8489b3d6a1b74818947d84d7c795a5fb" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.404280  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.404948  8373 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:19.406471  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.409291  8373 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:01:19.410772  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:19.411592  7718 consensus_peers.cc:597] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260501 14:01:19.429159  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.438258 13751 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:19.439560  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.445761 13751 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.447314  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.454509  7718 consensus_peers.cc:597] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.460393 13751 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.460824  8344 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.462041  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.462735 13755 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:19.463256  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.463505 13755 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.464289 13755 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.464404  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.465305 13747 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.465337  8344 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.466684 13755 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.467736  8344 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.468559 13755 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.471882  7792 leader_election.cc:336] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.472523  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.472886  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.473767 13753 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:19.483311  7718 consensus_peers.cc:597] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.487138  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec67fee0d084477a66b6f72a7e73330" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
W20260501 14:01:19.488765  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.496294  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.503429 13753 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.503687  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.504248  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.505666 13753 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.508713  7718 consensus_peers.cc:597] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.515376  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.516065  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac472405b2a42bb98dafbac4e20584b" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.516659  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.529850  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
W20260501 14:01:19.532073  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.533177  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.534130  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b13ab5be933469ba7c57247efb0f8e9" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.537159 13753 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:19.539333  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f623f4077ef4ffdad05ca3c40797b9f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.556704  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b661856a9e45bf823981177d99ae0c" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.558684  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef09d109d10447e796ab96c9a6eddef0" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.560493  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76c50227fdf4363bff9df76fdb05b2f" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:19.564436  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
W20260501 14:01:19.569304  7718 consensus_peers.cc:597] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.569334  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.573809  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c445f628c10d40b5a232bb391c4c92de" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.574642  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.578626  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.578715  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7211edc2aa9543b3996e3279fffe4edc" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.589730  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539945233a6f4f6589f58e774245669e" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.592193  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.593119  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1d6c31dce44935952b27fbc57a2d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.604169  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d27004f21449f5bfdade4d62aeba88" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.609335  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.634214  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2caa4d7579144326a3f173b9182831e8" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:19.623514  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.654057  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:19.656306  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "109c9ba263c34ff8aee17bc446cf258e" is_pre_election: true
I20260501 14:01:19.685928  7718 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.686842 13731 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.691171  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.692590  7718 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.694203  7718 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.693723 13733 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:19.697897 13733 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.700420  7718 leader_election.cc:304] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.708424 13731 raft_consensus.cc:2749] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.708473  7718 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.710636 13742 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.712205  7718 leader_election.cc:304] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.713825 13742 raft_consensus.cc:2749] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:19.719239  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.720444  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.714870  7718 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.723345 13742 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.724774 13755 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:19.726225  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.726801  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.727624 13755 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.728747  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.732820  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.733695 13755 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.734865  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.735414  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:19.736490  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.737926  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.738265  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.739694 13755 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.741034  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.741430  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.741993 13755 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.743152 13755 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:19.743605  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.744102  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.746055 13755 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.746153  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
W20260501 14:01:19.747097  8344 leader_election.cc:336] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.747834 13753 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:01:19.748313 13753 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.748672 13753 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:19.747515  8344 leader_election.cc:304] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:19.750761  7718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 349 similar messages]
I20260501 14:01:19.751799 13755 raft_consensus.cc:2749] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.752887  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.753410  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.764055 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:19.765573  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.766672  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.767678  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.768293  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.768800  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.769747 13755 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260501 14:01:19.770915  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.771412  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.772282 13755 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:19.773409  8344 leader_election.cc:336] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.774019  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.774708  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:19.775220  8344 leader_election.cc:336] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.782351  7792 leader_election.cc:304] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:19.785283 13759 raft_consensus.cc:2749] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.785391  8344 leader_election.cc:304] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.786430 13755 raft_consensus.cc:2749] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.787299  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.788120 13755 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:19.789686  8344 leader_election.cc:304] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.790436 13755 raft_consensus.cc:2749] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:19.795789  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.787297 13753 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.798420 13753 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.799137 13759 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260501 14:01:19.799582 13759 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.801944 13759 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Advancing to term 21
I20260501 14:01:19.803449  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.808789 13755 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:19.810655  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.811511 13755 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:19.812824  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.813601 13755 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:19.814824  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.824280 13755 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:19.826301  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.827075 13755 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260501 14:01:19.836920  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:19.837482  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:19.838254 13755 raft_consensus.cc:2749] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260501 14:01:19.839484  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.842453 13759 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.850971 13759 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.848078  7792 leader_election.cc:304] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:19.853683  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.855181 13723 raft_consensus.cc:2749] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.855332 13753 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260501 14:01:19.855916 13753 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.856321 13753 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:19.862938  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.866062 13723 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260501 14:01:19.867071 13723 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.867581 13723 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:19.874351  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.874068 13753 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:19.879967  8402 debug-util.cc:398] Leaking SignalData structure 0x7b080034bb80 after lost signal to thread 6457
W20260501 14:01:19.906962  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9140 after lost signal to thread 7611
I20260501 14:01:19.907332 13753 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:19.910454  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9a20 after lost signal to thread 7778
W20260501 14:01:19.911830  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9060 after lost signal to thread 7852
W20260501 14:01:19.912460  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9040 after lost signal to thread 7853
W20260501 14:01:19.921214  8402 debug-util.cc:398] Leaking SignalData structure 0x7b08002a48a0 after lost signal to thread 8405
I20260501 14:01:19.923760  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
W20260501 14:01:19.903167  7718 consensus_peers.cc:597] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.892743 13759 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:19.905130 13723 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.892127  7792 leader_election.cc:304] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:19.925904 13759 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.927100 13759 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:19.927395  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.927706 13723 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:19.928385 13723 raft_consensus.cc:2749] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:19.929425  7827 raft_consensus.cc:1240] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:01:19.929811  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:19.930621 13753 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260501 14:01:19.930970 13753 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.931433 13732 consensus_queue.cc:1059] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:19.931447 13753 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:19.932526 13731 raft_consensus.cc:3055] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:01:19.932865 13731 raft_consensus.cc:740] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:19.933729 13731 consensus_queue.cc:260] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:19.935333 13731 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:19.931463 13760 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260501 14:01:19.936339 13760 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:19.936750 13760 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:19.931027  7792 leader_election.cc:304] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:19.947172  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:19.941727 13723 raft_consensus.cc:2749] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:19.958907  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:01:19.963311  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.964046  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:19.965022  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:19.968111  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:19.977128  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:19.988730 13753 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.007282 13753 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:20.015844 13759 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.031481 13759 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:20.026208 13760 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.039346 13760 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:20.043984  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 49052.1us
W20260501 14:01:20.049196  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.058784  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:20.060369  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:20.072494  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:01:20.074407  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:20.074891  7625 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:20.075192  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.077941  7827 raft_consensus.cc:1240] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 20. Current term is 21. Ops: []
I20260501 14:01:20.080698  7827 raft_consensus.cc:1240] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 18. Current term is 19. Ops: []
W20260501 14:01:20.082284  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.083298  7824 raft_consensus.cc:1240] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 14. Current term is 15. Ops: []
W20260501 14:01:20.083285  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.084347  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.086179  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.097365  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.104312  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.115865  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.117821  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.126611 13739 consensus_queue.cc:1059] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260501 14:01:20.122733 13742 consensus_queue.cc:1059] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
W20260501 14:01:20.126320  7718 consensus_peers.cc:597] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.128463  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.144440  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.131767 13739 raft_consensus.cc:3055] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Stepping down as leader of term 18
I20260501 14:01:20.146032  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.132452 13742 raft_consensus.cc:3055] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Stepping down as leader of term 20
I20260501 14:01:20.127445 13732 consensus_queue.cc:1059] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260501 14:01:20.150797 13766 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260501 14:01:20.149449  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.152719  7792 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.153098  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
W20260501 14:01:20.154173  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.154743  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.147364 13739 raft_consensus.cc:740] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:01:20.156721  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.157047 13741 raft_consensus.cc:3055] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Stepping down as leader of term 14
I20260501 14:01:20.157464 13741 raft_consensus.cc:740] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:01:20.157768  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.158203  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.158202 13741 consensus_queue.cc:260] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.159051 13766 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260501 14:01:20.159806 13765 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260501 14:01:20.160769 13741 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:20.161775  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.162180  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.162856 13765 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260501 14:01:20.164769  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.165426  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.165876  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.165879 13739 consensus_queue.cc:260] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.166543  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.167408 13764 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260501 14:01:20.167554 13739 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Advancing to term 19
W20260501 14:01:20.168568  7792 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.169032  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.169806 13764 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260501 14:01:20.170921  7792 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260501 14:01:20.171466  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, 91854d93e96c4756834efe8b2ef59fce
I20260501 14:01:20.172592 13764 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260501 14:01:20.175590  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260501 14:01:20.176353  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.149739 13742 raft_consensus.cc:740] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
W20260501 14:01:20.193614  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.201191  7792 consensus_peers.cc:597] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.202560 13742 consensus_queue.cc:260] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:20.209797  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.242481  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.242981  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.243932  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.256038  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.254364 13742 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Advancing to term 21
W20260501 14:01:20.256857  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.261880  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.263338  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.262938  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.263847  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.266398  7824 raft_consensus.cc:1240] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 18. Current term is 19. Ops: []
I20260501 14:01:20.270247 13741 consensus_queue.cc:1059] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260501 14:01:20.271659  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:20.272784 13731 raft_consensus.cc:3055] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Stepping down as leader of term 18
I20260501 14:01:20.273195 13731 raft_consensus.cc:740] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:20.274027 13731 consensus_queue.cc:260] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.275305 13731 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 18 FOLLOWER]: Advancing to term 19
W20260501 14:01:20.280100  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.286126  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.311425  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.360670  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:20.368960  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:20.381014  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.382486  7827 raft_consensus.cc:1240] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 16. Current term is 17. Ops: []
I20260501 14:01:20.384153 13742 consensus_queue.cc:1059] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260501 14:01:20.385306 13742 raft_consensus.cc:3055] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Stepping down as leader of term 16
I20260501 14:01:20.385982 13742 raft_consensus.cc:740] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:20.386890 13742 consensus_queue.cc:260] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.388418  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:20.388512 13742 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:20.389891  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.396862  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.398269  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.401966  6454 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.403195  6454 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.403870  6454 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.414458  6454 tablet_replica.cc:333] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.415539  6454 raft_consensus.cc:2243] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.416608  6454 raft_consensus.cc:2272] T b1911462b92946d6b35f09cf9509128d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.423053  6454 tablet_replica.cc:333] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.424474  6454 raft_consensus.cc:2243] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.426153  6454 raft_consensus.cc:2272] T 294b76c5890f455f97130fdbedace9af P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.429749  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.430568  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.432546  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.462165  7826 raft_consensus.cc:1240] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Rejecting Update request from peer 109c9ba263c34ff8aee17bc446cf258e for earlier term 13. Current term is 14. Ops: []
I20260501 14:01:20.463572 13731 consensus_queue.cc:1059] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260501 14:01:20.464620 13731 raft_consensus.cc:3055] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Stepping down as leader of term 13
I20260501 14:01:20.464956 13731 raft_consensus.cc:740] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 109c9ba263c34ff8aee17bc446cf258e, State: Running, Role: LEADER
I20260501 14:01:20.465773 13731 consensus_queue.cc:260] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:20.467101 13731 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:20.469687  6454 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.478230  6454 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.482910  6454 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.486094  6454 tablet_replica.cc:333] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.495067  6454 raft_consensus.cc:2243] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.502140  6454 raft_consensus.cc:2272] T 962840f0434049bbb395d330e010962d P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.526266  6454 tablet_replica.cc:333] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.527263  6454 raft_consensus.cc:2243] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.538589  6454 raft_consensus.cc:2272] T 484e3aa806394c42a224a8dbb213dd30 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:20.541043  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.541990  6454 tablet_replica.cc:333] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.565837  6454 raft_consensus.cc:2243] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.572319  6454 raft_consensus.cc:2272] T 365625e9a5a1458e951f04698e1cc682 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.577742  6454 tablet_replica.cc:333] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.578717  6454 raft_consensus.cc:2243] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.584496  6454 raft_consensus.cc:2272] T ac3b0214563f48f689fc427a69b7b5dd P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.589679  6454 tablet_replica.cc:333] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.595784  6454 raft_consensus.cc:2243] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.606813  6454 raft_consensus.cc:2272] T 43e99f3322c2477888132a818eae4971 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.624939  6454 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.628221  6454 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.628872  6454 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P 109c9ba263c34ff8aee17bc446cf258e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.633076  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.633966  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.643587  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.646720  6454 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.656598  6454 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.657918  6454 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.661561  6454 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.662461  6454 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.663148  6454 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.687944  6454 tablet_replica.cc:333] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.689128  6454 raft_consensus.cc:2243] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.689941  6454 raft_consensus.cc:2272] T ee17e865655f4db7affb37902439a8be P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.692907  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.712451  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:20.724097  7718 consensus_peers.cc:597] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:20.726938  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.734740  6454 tablet_replica.cc:333] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.739635  6454 raft_consensus.cc:2243] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.741940  6454 raft_consensus.cc:2272] T f9b540df5a794f06ab617858163d4297 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.770365  6454 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.780718  6454 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.782186  6454 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 109c9ba263c34ff8aee17bc446cf258e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.785872  6454 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.788805  6454 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.789448  6454 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.807593  6454 tablet_replica.cc:333] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.808646  6454 raft_consensus.cc:2243] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.809489  6454 raft_consensus.cc:2272] T 39ab56a6d5d641c4b64cc945f297bd2b P 109c9ba263c34ff8aee17bc446cf258e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.812621  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.813575  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.814814  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P 109c9ba263c34ff8aee17bc446cf258e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.818017  6454 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.818902  6454 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.829563  6454 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.862600  6454 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.863478  6454 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:20.867874  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.878576  6454 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.883790  6454 tablet_replica.cc:333] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.884709  6454 raft_consensus.cc:2243] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.891517  6454 raft_consensus.cc:2272] T 2a2975a86035451cb56a7caf76296505 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.895378  6454 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.896409  6454 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.897089  6454 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.900306  6454 tablet_replica.cc:333] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.901149  6454 raft_consensus.cc:2243] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.901993  6454 raft_consensus.cc:2272] T 5ecf82e363814b0084cab2799c85ee9d P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.909310  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.910673  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.911319  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.918583  6454 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.919516  6454 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.920840  6454 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.924324  6454 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.931053  6454 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.932003  6454 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.935233  6454 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.936173  6454 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.937568  6454 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.941027  6454 tablet_replica.cc:333] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.941972  6454 raft_consensus.cc:2243] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.942755  6454 raft_consensus.cc:2272] T eed0026bd9c541b7b89c956e31761d54 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.946106  6454 tablet_replica.cc:333] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.947039  6454 raft_consensus.cc:2243] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.947844  6454 raft_consensus.cc:2272] T fed0245aa0064b4c8685aeb38d1de9c0 P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.951210  6454 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.952155  6454 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.953365  6454 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:20.956513  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:20.957906  6454 tablet_replica.cc:333] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.957803 13731 raft_consensus.cc:493] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:20.959081  6454 raft_consensus.cc:2243] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.958820 13731 raft_consensus.cc:515] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:20.960937 13731 leader_election.cc:290] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:20.961416  6454 raft_consensus.cc:2272] T c6b7bef99f44450d853fce321082a78b P 109c9ba263c34ff8aee17bc446cf258e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.963557  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e64ae6fa3e42b5be743466a0338478" candidate_uuid: "109c9ba263c34ff8aee17bc446cf258e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:20.964778  6454 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.965803  6454 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
W20260501 14:01:20.966221  7718 leader_election.cc:336] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:20.966678  7718 leader_election.cc:304] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 109c9ba263c34ff8aee17bc446cf258e; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:20.967329  6454 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.970350  6454 tablet_replica.cc:333] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.969725 13731 raft_consensus.cc:2749] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:20.971752  6454 raft_consensus.cc:2243] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.974726  6454 raft_consensus.cc:2272] T c1e64ae6fa3e42b5be743466a0338478 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.977847  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.978716  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.979415  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.982504  6454 tablet_replica.cc:333] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.983332  6454 raft_consensus.cc:2243] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.984185  6454 raft_consensus.cc:2272] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.987390  6454 tablet_replica.cc:333] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.988308  6454 raft_consensus.cc:2243] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:20.989017  6454 raft_consensus.cc:2272] T 3df4d60525ad4852996138e9e813b608 P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.992026  6454 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.992928  6454 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:20.994454  6454 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P 109c9ba263c34ff8aee17bc446cf258e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:20.998464  6454 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:20.999485  6454 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.000109  6454 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.003151  6454 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.004124  6454 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.004812  6454 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P 109c9ba263c34ff8aee17bc446cf258e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.008193  6454 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.009048  6454 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:21.010442  6454 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P 109c9ba263c34ff8aee17bc446cf258e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.013311  6454 tablet_replica.cc:333] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.014454  6454 raft_consensus.cc:2243] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.015251  6454 raft_consensus.cc:2272] T a7e6863e401d47c485d22868ddfb6a08 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.018312  6454 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.019137  6454 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.019856  6454 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 109c9ba263c34ff8aee17bc446cf258e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.022945  6454 tablet_replica.cc:333] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.023722  6454 raft_consensus.cc:2243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:21.024477  6454 raft_consensus.cc:2272] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:21.027613  6454 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e: stopping tablet replica
I20260501 14:01:21.028463  6454 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:21.031550  6454 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P 109c9ba263c34ff8aee17bc446cf258e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:21.049823  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:21.219772  7792 connection.cc:744] client connection to 127.6.77.130:41997 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260501 14:01:21.263849  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.270574  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.274364  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.293902  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.344309 13755 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.344937 13755 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.347105 13755 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.348569  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.349558  7824 raft_consensus.cc:2393] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.353820  8344 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.354279  8344 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.355049 13755 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:21.376077 13755 raft_consensus.cc:2749] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:21.435009 13755 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.435640 13755 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.437867 13755 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.440303  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.441152  7826 raft_consensus.cc:2393] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 15: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.443540  8344 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.444065  8344 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.444945 13755 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:21.463101 13768 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.463757 13768 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.466915 13755 raft_consensus.cc:2749] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:21.474694 13768 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.476176  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.477025  7826 raft_consensus.cc:2393] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 19: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.479122  8344 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.479617  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.481026 13768 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:21.489801 13768 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:21.514717 13768 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.517365 13768 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:21.523747  8344 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.525837  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.526722  7824 raft_consensus.cc:2393] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 21: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:21.527985  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.528942 13755 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Advancing to term 21
I20260501 14:01:21.546108 13755 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:21.557548 13768 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:21.576881  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.582867 13762 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.583475 13762 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:21.585904 13762 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:21.594280  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.598650  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.599224  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.601025 13771 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:21.626412 13770 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.627076 13770 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.629334 13770 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.629832 13770 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.630322 13770 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.634203  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.635057  7820 raft_consensus.cc:2393] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 19: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:21.641495 13770 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:21.671397  8344 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.672047  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.672935 13770 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Advancing to term 19
I20260501 14:01:21.682685  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.683585  7820 raft_consensus.cc:2393] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 17: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
I20260501 14:01:21.686889 13770 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260501 14:01:21.705647  8344 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.707584  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.710948 13766 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.711596 13766 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.714226 13766 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:21.715201 13768 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Advancing to term 17
I20260501 14:01:21.718591 13755 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.719435 13755 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.722085 13755 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.723969 13768 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:21.730041  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.730933  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.731367  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.735028  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:21.735846  8377 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
I20260501 14:01:21.736159  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.736759  7827 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
I20260501 14:01:21.741680 13762 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.752025  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:21.753034  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:21.753458  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.754232 13768 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.784502  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.791507 13768 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.792151 13768 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.794216 13768 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.799952  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:21.804283  7820 raft_consensus.cc:2393] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91854d93e96c4756834efe8b2ef59fce in current term 14: Already voted for candidate ca8dd10afb304b4c96cfcec7e2309947 in this term.
W20260501 14:01:21.804297  8344 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.802296 13771 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.805788  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.805740 13771 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:21.808518 13771 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:21.809211 13768 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Advancing to term 14
I20260501 14:01:21.818004 13768 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.823534  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:21.824975  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:21.825475  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.826272 13771 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:21.846153  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:21.881592 13768 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.882256 13768 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.885222 13768 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:21.890245  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.891089  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.891553  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.892930 13768 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:21.908104 13768 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.909214 13771 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.908675 13768 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.909812 13771 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:21.911433 13768 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:21.912403 13771 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:21.915556  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
W20260501 14:01:21.917388  8344 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.918220  8344 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:21.918905 13768 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:21.936203  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:21.940414 13771 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.940991 13771 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:21.942883 13771 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:21.949501 13766 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:21.950124 13766 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:21.952373  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:21.952872 13766 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:21.952888  7792 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 91854d93e96c4756834efe8b2ef59fce, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.963521 13766 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:21.964811  7792 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:21.974921  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.980705  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.981264  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.986371 13766 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:21.990165  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:21.990634  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:21.990971  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:21.993868  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:21.994869 13766 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:21.997429 13766 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:21.997898 13766 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.000901 13771 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.001498 13771 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.003531 13771 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.004529 13766 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.009473 13755 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.010026 13755 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.018846 13755 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:22.019392  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.020329  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.020771  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.022199 13755 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:22.023706  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.024400  8376 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 17.
I20260501 14:01:22.024896  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:22.025316  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.025528  7827 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
I20260501 14:01:22.025899  8377 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
I20260501 14:01:22.044108 13766 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.044847 13766 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:22.047390 13766 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.050801  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.051767 13766 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260501 14:01:22.051959  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.052307 13766 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.052822 13766 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:22.057907 13771 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:22.059381 13771 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.059769 13771 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:22.068706 13771 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.077670 13766 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.078104  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.084313 13762 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.084781 13771 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.084934 13762 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:22.086959 13762 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.087942  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.090211 13766 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.105017 13755 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.105764 13755 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.108098  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ee722489b34f13bc6b2cc16825e5c9" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.108814  8376 raft_consensus.cc:3060] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:22.110999  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.111642  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:22.111864  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c659157efb4e3ba3d97b7ad9d62068" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.112483  8377 raft_consensus.cc:3060] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 17 FOLLOWER]: Advancing to term 18
I20260501 14:01:22.108193 13755 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.119916  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.120648  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.121062  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.121834 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:22.122882  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.127712  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.129891 13766 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:22.133770  8377 raft_consensus.cc:2468] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 18.
I20260501 14:01:22.138420  7792 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.143276 13766 raft_consensus.cc:2804] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Leader election won for term 18
I20260501 14:01:22.144058 13766 raft_consensus.cc:697] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.144903  8376 raft_consensus.cc:2468] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:01:22.145097 13766 consensus_queue.cc:237] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.147734 13762 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.150099 13762 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.152143 13762 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:22.159149  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.165692  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:22.171670  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.174281  8376 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 14.
W20260501 14:01:22.181123  7792 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.184437  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.184800  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:22.185858  7792 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.186357 13766 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:22.188385  7792 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:22.189184 13766 raft_consensus.cc:2804] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:01:22.189924 13766 raft_consensus.cc:697] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.190889 13766 consensus_queue.cc:237] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.193832  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.195799 13771 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260501 14:01:22.196187 13771 raft_consensus.cc:493] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.196501 13771 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Advancing to term 15
I20260501 14:01:22.193630  7576 catalog_manager.cc:5671] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 16 to 18, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 18 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:22.204844 13771 raft_consensus.cc:515] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.208568 13771 leader_election.cc:290] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:22.206529  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.213829 13755 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.214339 13755 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.216848 13755 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.226212  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.227893  6454 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7775)
W20260501 14:01:22.231719  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.232414  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.233472 13768 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:22.241007  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47951612b03c496aa487574a115ca380" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
W20260501 14:01:22.241616  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.242185  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.241657  8376 raft_consensus.cc:3060] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Advancing to term 15
W20260501 14:01:22.242632  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.256117 13771 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.256711 13771 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.258912 13771 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.263393  8376 raft_consensus.cc:2468] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
W20260501 14:01:22.267275  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.275038  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.275731  8377 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
I20260501 14:01:22.276655 13768 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.277230 13768 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.278810  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:22.279330 13768 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.289435  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.290865  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.291280  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:22.292562  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.293040  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.293380  7792 leader_election.cc:336] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.294785 13768 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:22.301468 13771 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.302073 13771 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.304231 13771 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
W20260501 14:01:22.309551  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.316491  7792 leader_election.cc:304] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e
I20260501 14:01:22.319759 13766 raft_consensus.cc:2804] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader election won for term 15
I20260501 14:01:22.320349 13766 raft_consensus.cc:697] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.321323 13766 consensus_queue.cc:237] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.326722 13768 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.327337 13768 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.329576 13768 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.331686 13771 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.332296 13771 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:22.335206 13771 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.336007 13771 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.336562 13771 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.338696 13771 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.342315  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.344430 13762 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260501 14:01:22.344884 13762 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.345319 13762 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Advancing to term 21
W20260501 14:01:22.345376  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.346905  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.347321  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.348105 13768 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:22.374058 13768 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.374679 13768 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.376979 13768 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:22.382916  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.383880  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.384426  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.385951 13768 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:22.390523  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 46863.4us
I20260501 14:01:22.391583 13784 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:22.392843  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.392607 13784 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.415741 13784 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.412439 13786 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:22.416702 13786 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.419118 13786 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.373950 13762 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.426491  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.427193  8376 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 15.
I20260501 14:01:22.423650 13762 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.438385  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.439091  8376 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 21.
I20260501 14:01:22.437695  7576 catalog_manager.cc:5671] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:22.449884  7576 catalog_manager.cc:5671] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 13 to 15, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 15 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:22.468137 13768 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:22.468868 13768 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.471109 13768 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:22.487205  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.488006  8373 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 19.
W20260501 14:01:22.488168  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.488440  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:22.489120  8379 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 19.
I20260501 14:01:22.490916  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c91be7730b684fbd94e69655ab35fd61" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.491516  8376 raft_consensus.cc:3060] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Advancing to term 21
I20260501 14:01:22.501667  8376 raft_consensus.cc:2468] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 21.
W20260501 14:01:22.493422  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260501 14:01:22.507936  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.508785  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.509164  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:22.509825 13768 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:22.510281  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.563151  8344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:41997, user_credentials={real_user=slave}} blocked reactor thread for 48413.1us
I20260501 14:01:22.559477  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.593320 13762 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260501 14:01:22.593894  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.594309 13762 raft_consensus.cc:493] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.599107 13762 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:01:22.600453 13786 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260501 14:01:22.600919 13786 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.601236 13786 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Advancing to term 22
W20260501 14:01:22.603448  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.620939  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.621878  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.629305 13784 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:01:22.629746 13784 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.630097 13784 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.633543 13762 raft_consensus.cc:515] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.638491 13762 leader_election.cc:290] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.640404  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.641741  7792 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.643007 13766 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260501 14:01:22.643409 13766 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:22.643718 13766 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.644618 13762 raft_consensus.cc:2804] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Leader election won for term 21
I20260501 14:01:22.646633 13762 raft_consensus.cc:697] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.648200 13762 consensus_queue.cc:237] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.661662  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.662330  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.665143 13784 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.667687 13784 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.673615 13786 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.672832 13766 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:22.675694  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.686666  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:22.690009  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.692517  7792 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.685842 13766 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.685858 13786 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 election: Requested vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:22.700985  7576 catalog_manager.cc:5671] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 20 to 21, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 21 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:22.696259  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.706808  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:22.708498  7792 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.712153  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.712838  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.717206  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.717976  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.728111  7792 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:22.729290  7792 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:22.709043 13786 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:22.764823  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367eab87da314007b62b7bd0a0905d38" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.766148  8379 raft_consensus.cc:3060] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Advancing to term 16
I20260501 14:01:22.774111  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c14b33d5ea8424cb04207b894010749" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.774971  8376 raft_consensus.cc:3060] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.780925  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6dc2741afba411fbd7695217702cdda" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.781813  8373 raft_consensus.cc:3060] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 19 FOLLOWER]: Advancing to term 20
I20260501 14:01:22.788486  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91eb60ac1c7a48a0b3662ef7e5327f66" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce"
I20260501 14:01:22.789402  8377 raft_consensus.cc:3060] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Advancing to term 22
W20260501 14:01:22.793329  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.815974  8379 raft_consensus.cc:2468] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 16.
W20260501 14:01:22.822716  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:22.823668  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:22.830276  8377 raft_consensus.cc:2468] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 22.
I20260501 14:01:22.824110  8373 raft_consensus.cc:2468] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
W20260501 14:01:22.851347  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:22.852980  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.857450  8376 raft_consensus.cc:2468] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 20.
I20260501 14:01:22.857741  8373 raft_consensus.cc:1275] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260501 14:01:22.928752  7792 leader_election.cc:304] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
W20260501 14:01:22.922932  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:22.935783 13762 raft_consensus.cc:2804] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader election won for term 16
I20260501 14:01:22.936517 13762 raft_consensus.cc:697] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.937789 13762 consensus_queue.cc:237] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.956045  7792 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.962574 13766 raft_consensus.cc:2804] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 FOLLOWER]: Leader election won for term 22
I20260501 14:01:22.963611 13766 raft_consensus.cc:697] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:22.965293 13766 consensus_queue.cc:237] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:22.972359  7792 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:22.996714  7576 catalog_manager.cc:5671] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 14 to 16, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 16 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:23.016049 13762 raft_consensus.cc:2804] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:01:23.017073 13762 raft_consensus.cc:697] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:23.018378 13762 consensus_queue.cc:237] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:23.026095  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.030959  7792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:40155, user_credentials={real_user=slave}} blocked reactor thread for 58720.4us
I20260501 14:01:23.033020  7792 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 
I20260501 14:01:23.034040 13784 raft_consensus.cc:2804] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Leader election won for term 20
I20260501 14:01:23.035207 13784 raft_consensus.cc:697] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Becoming Leader. State: Replica: ca8dd10afb304b4c96cfcec7e2309947, State: Running, Role: LEADER
I20260501 14:01:23.036618 13784 consensus_queue.cc:237] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:23.044132 13789 log.cc:927] Time spent T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260501 14:01:23.067127  7576 catalog_manager.cc:5671] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 20 to 22, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 22 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:23.069307 13786 consensus_queue.cc:1048] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260501 14:01:23.078253  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.099290  8376 raft_consensus.cc:1275] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260501 14:01:23.111720  8373 raft_consensus.cc:1275] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260501 14:01:23.120097  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.120980  7792 leader_election.cc:336] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.132807  7576 catalog_manager.cc:5671] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 18 to 20, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 20 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:23.135075  7576 catalog_manager.cc:5671] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 reported cstate change: term changed from 18 to 20, leader changed from 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130) to ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131). New cstate: current_term: 20 leader_uuid: "ca8dd10afb304b4c96cfcec7e2309947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:23.138861  7792 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.143329 13762 raft_consensus.cc:493] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:01:23.153707  7792 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.153561 13762 raft_consensus.cc:515] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:23.154536  7792 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:23.156477  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.157039  7792 consensus_peers.cc:597] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.157553  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:23.155690 13762 leader_election.cc:290] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.158394  7792 consensus_peers.cc:597] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.166759  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.167995  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.168552  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.172710  8376 raft_consensus.cc:1275] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260501 14:01:23.178691  7792 consensus_peers.cc:597] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.179498  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.180316  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.181814  7792 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.185032  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.185765  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.204530 13793 consensus_queue.cc:1048] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260501 14:01:23.207743 13794 consensus_queue.cc:1048] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:01:23.217681 13766 consensus_queue.cc:1048] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260501 14:01:23.228688  6454 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7775)
W20260501 14:01:23.256104  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.260340  7792 consensus_peers.cc:597] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:23.261353  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:23.265769  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:01:23.270129  7792 consensus_peers.cc:597] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.270772  7792 leader_election.cc:336] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.272589  7792 leader_election.cc:304] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.281781 13766 raft_consensus.cc:2749] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:23.380102 13768 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.380844 13768 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:23.393412  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.399956 13768 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:23.410856  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:23.413386  7824 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 13.
W20260501 14:01:23.432768  7792 consensus_peers.cc:597] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.460018  7792 consensus_peers.cc:597] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.477264  7792 consensus_peers.cc:597] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:23.481528  8379 raft_consensus.cc:1275] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260501 14:01:23.491321  8376 raft_consensus.cc:1275] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260501 14:01:23.498338  8376 raft_consensus.cc:1275] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260501 14:01:23.515911  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.525666 13766 consensus_queue.cc:1048] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260501 14:01:23.534185 13762 consensus_queue.cc:1048] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260501 14:01:23.541360 13762 consensus_queue.cc:1048] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260501 14:01:23.558307  7792 consensus_peers.cc:597] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:23.589115  8344 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.592522  8344 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.606076 13768 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:23.617504 13755 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.618327 13755 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:23.620837 13755 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:23.662750  8377 raft_consensus.cc:1275] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Refusing update from remote peer ca8dd10afb304b4c96cfcec7e2309947: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260501 14:01:23.676333  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260501 14:01:23.680796 13762 consensus_queue.cc:1048] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260501 14:01:23.685900  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260501 14:01:23.712584 13762 raft_consensus.cc:493] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.713503 13762 raft_consensus.cc:515] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } attrs { replace: false } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.715900 13762 leader_election.cc:290] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.719973  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.725597 13766 raft_consensus.cc:493] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.726294 13766 raft_consensus.cc:515] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.728595 13766 leader_election.cc:290] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.729730  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.730451  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.734982 13755 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:23.747107  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:23.770812  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:23.779888  7792 leader_election.cc:336] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.780529  7792 leader_election.cc:304] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.782176 13794 raft_consensus.cc:2749] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:23.815153 13793 raft_consensus.cc:493] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.815946 13793 raft_consensus.cc:515] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
W20260501 14:01:23.818825  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:23.819654 13793 leader_election.cc:290] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.820886  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.834014 13768 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.835109 13768 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:23.840971 13768 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.851853  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.853629 13786 raft_consensus.cc:493] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.855890 13786 raft_consensus.cc:515] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.858451 13786 leader_election.cc:290] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:23.859496  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.872105  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
W20260501 14:01:23.860350  7792 leader_election.cc:336] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.873451  7792 leader_election.cc:304] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.874500 13786 raft_consensus.cc:2749] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260501 14:01:23.876412 13768 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:23.893337 13755 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.894302 13786 raft_consensus.cc:493] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:23.894099 13755 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:23.894902 13786 raft_consensus.cc:515] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:23.897068 13786 leader_election.cc:290] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:23.900290 13755 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:23.911444  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:23.911892  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "959ae22d6e614940b93df344dbf7fa20" candidate_uuid: "91854d93e96c4756834efe8b2ef59fce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca8dd10afb304b4c96cfcec7e2309947" is_pre_election: true
I20260501 14:01:23.926545  7826 raft_consensus.cc:2468] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91854d93e96c4756834efe8b2ef59fce in term 16.
W20260501 14:01:23.933591  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:23.937065  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:23.942040  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.945302  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.946300 13755 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:23.968294  7792 leader_election.cc:336] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:23.975996  7792 leader_election.cc:304] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.980679 13794 raft_consensus.cc:2749] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:23.989272  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:23.998072  7792 leader_election.cc:336] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:23.998674  7792 leader_election.cc:304] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:23.999536 13794 raft_consensus.cc:2749] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260501 14:01:24.001555  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.007992 13755 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.008623 13755 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.010484 13755 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.026171  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:24.030066  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:24.030642  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.033267 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:24.032415  7792 leader_election.cc:336] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:24.036001  7792 leader_election.cc:304] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.037155 13794 raft_consensus.cc:2749] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:24.070281  7792 consensus_peers.cc:597] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:24.081576 13755 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.082285 13755 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.084273 13755 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.108788  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:24.111588 13755 raft_consensus.cc:493] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.112391 13755 raft_consensus.cc:515] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.114382 13755 leader_election.cc:290] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.115298  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.116310  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.119365 13755 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:24.144140  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.148175  8344 leader_election.cc:336] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.149976  8344 leader_election.cc:304] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.153190 13755 raft_consensus.cc:2749] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:24.229339  6454 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7775)
I20260501 14:01:24.234146 13755 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.234972 13755 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.236951 13755 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.244814  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.245839  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.246323  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.247198 13755 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:24.288249  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:24.321014 13755 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.321700 13755 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:24.323789 13755 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.333642  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.334484  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:24.334885  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:24.335737 13755 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:24.364509  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.409075  7792 consensus_peers.cc:597] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.420578  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.482617  7792 consensus_peers.cc:597] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:24.484324  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
W20260501 14:01:24.611621  7792 consensus_peers.cc:597] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.631642  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.661157  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260501 14:01:24.710976  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.726651  7792 consensus_peers.cc:597] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.758527  7792 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111) [suppressed 686 similar messages]
W20260501 14:01:24.777344  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.779834  7792 consensus_peers.cc:597] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.800357  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.822427  7792 consensus_peers.cc:597] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.829844  7792 consensus_peers.cc:597] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.833143  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.863847  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.870656  7792 consensus_peers.cc:597] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.881593  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:24.899595  7792 consensus_peers.cc:597] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:24.900919  7792 consensus_peers.cc:597] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.942668  7792 consensus_peers.cc:597] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:24.943084 13762 raft_consensus.cc:493] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:24.951838 13762 raft_consensus.cc:515] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } }
I20260501 14:01:24.954795 13762 leader_election.cc:290] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:24.966593  7792 consensus_peers.cc:597] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.978243  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:24.990689  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:24.996258  7792 leader_election.cc:336] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:25.004026  7792 leader_election.cc:304] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:25.006253 13793 raft_consensus.cc:493] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:25.008517 13793 raft_consensus.cc:515] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:25.007030 13762 raft_consensus.cc:2749] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260501 14:01:25.013703 13793 leader_election.cc:290] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), 91854d93e96c4756834efe8b2ef59fce (127.6.77.132:40155)
I20260501 14:01:25.028796  8372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c164f5975a45b495c25c9e99b628d3" candidate_uuid: "ca8dd10afb304b4c96cfcec7e2309947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "91854d93e96c4756834efe8b2ef59fce" is_pre_election: true
I20260501 14:01:25.029793  8372 raft_consensus.cc:2468] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca8dd10afb304b4c96cfcec7e2309947 in term 13.
W20260501 14:01:25.034590  7792 consensus_peers.cc:597] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:25.044147  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
W20260501 14:01:25.044090  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:25.047515  7792 leader_election.cc:336] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:25.048061  7792 leader_election.cc:304] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce, ca8dd10afb304b4c96cfcec7e2309947; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:25.049064 13815 raft_consensus.cc:2749] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:25.060338  7625 auto_rebalancer.cc:806] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:25.060985  7625 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:25.064282  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:01:25.064138  8344 consensus_peers.cc:597] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:25.080775  7792 consensus_peers.cc:597] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.085597  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.164435  7792 consensus_peers.cc:597] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.169914  7792 consensus_peers.cc:597] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.193449  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.195895  8344 consensus_peers.cc:597] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:25.201472  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:25.202996  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.205737  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.208031  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.212805  6454 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.214147  6454 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.215615  6454 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.218932  6454 tablet_replica.cc:333] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
W20260501 14:01:25.224656  7792 consensus_peers.cc:597] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.226679  6454 raft_consensus.cc:2243] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.228096  6454 raft_consensus.cc:2272] T b1911462b92946d6b35f09cf9509128d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.233178  7792 consensus_peers.cc:597] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.236189  6454 tablet_replica.cc:333] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.237293  6454 raft_consensus.cc:2243] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.238207  6454 raft_consensus.cc:2272] T 294b76c5890f455f97130fdbedace9af P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.241616  6454 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.242532  6454 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.243252  6454 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.290606  6454 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.293587  6454 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.295076  6454 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.298322  6454 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.299285  6454 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.300674  6454 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.307273  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.315685  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.316571  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.327157  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.366117  7792 consensus_peers.cc:597] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260501 14:01:25.369130  7792 consensus_peers.cc:597] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:25.369705  6454 tablet_replica.cc:333] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.374402  6454 raft_consensus.cc:2243] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.381165  6454 raft_consensus.cc:2272] T 365625e9a5a1458e951f04698e1cc682 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.380121  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:25.393528  7792 consensus_peers.cc:597] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.395545  6454 tablet_replica.cc:333] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.398901  6454 raft_consensus.cc:2243] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.400445  6454 raft_consensus.cc:2272] T ac3b0214563f48f689fc427a69b7b5dd P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.402742  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:25.404737  6454 tablet_replica.cc:333] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.406838  6454 raft_consensus.cc:2243] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.407727  6454 raft_consensus.cc:2272] T 484e3aa806394c42a224a8dbb213dd30 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.409561  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:25.410401  8344 consensus_peers.cc:597] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260501 14:01:25.414222  7792 consensus_peers.cc:597] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:01:25.414968  6454 tablet_replica.cc:333] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.416034  6454 raft_consensus.cc:2243] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.417114  6454 raft_consensus.cc:2272] T 962840f0434049bbb395d330e010962d P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.420554  6454 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.421556  6454 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.422825  6454 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P ca8dd10afb304b4c96cfcec7e2309947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.425964  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.426824  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.427994  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.431217  6454 tablet_replica.cc:333] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.432225  6454 raft_consensus.cc:2243] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.432791  6454 raft_consensus.cc:2272] T 43e99f3322c2477888132a818eae4971 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.436111  6454 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.436753  6454 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.437989  6454 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.440762  6454 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.441656  6454 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.443001  6454 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P ca8dd10afb304b4c96cfcec7e2309947 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.444691  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:25.445930  6454 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.446592  6454 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.447715  6454 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.450361  6454 tablet_replica.cc:333] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.451310  6454 raft_consensus.cc:2243] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.452912  6454 raft_consensus.cc:2272] T ee17e865655f4db7affb37902439a8be P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.455475  7792 consensus_peers.cc:597] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.456068  6454 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.456780  6454 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.457799  6454 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P ca8dd10afb304b4c96cfcec7e2309947 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.463394  6454 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.464144  6454 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.465291  6454 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.468196  6454 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.469135  6454 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.470501  6454 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.478001  6454 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.478858  6454 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.480271  6454 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.495584  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.496615  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.498526  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.501880  6454 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.502784  6454 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.505118  6454 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P ca8dd10afb304b4c96cfcec7e2309947 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.505898  8344 consensus_peers.cc:597] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.508925  6454 tablet_replica.cc:333] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.510022  6454 raft_consensus.cc:2243] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.510768  6454 raft_consensus.cc:2272] T f9b540df5a794f06ab617858163d4297 P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.513578  8344 consensus_peers.cc:597] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce -> Peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Couldn't send request to peer 109c9ba263c34ff8aee17bc446cf258e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260501 14:01:25.514232  6454 tablet_replica.cc:333] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.515213  6454 raft_consensus.cc:2243] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.516697  6454 raft_consensus.cc:2272] T 39ab56a6d5d641c4b64cc945f297bd2b P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.519917  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.520717  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.522920  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P ca8dd10afb304b4c96cfcec7e2309947 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.525956  8344 consensus_peers.cc:597] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce -> Peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Couldn't send request to peer ca8dd10afb304b4c96cfcec7e2309947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:25.526713  6454 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
W20260501 14:01:25.527288  7792 consensus_peers.cc:597] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:25.527913  6454 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.529078  6454 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.532114  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.532889  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.534693  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.537426  6454 tablet_replica.cc:333] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.538393  6454 raft_consensus.cc:2243] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.539745  6454 raft_consensus.cc:2272] T 6866ee2ef62c4f999f3e6c7b7a6d7aa9 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.543025  6454 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.543960  6454 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.545991  6454 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.548707  6454 tablet_replica.cc:333] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.549480  6454 raft_consensus.cc:2243] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.550310  6454 raft_consensus.cc:2272] T 2a2975a86035451cb56a7caf76296505 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.553377  6454 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.554250  6454 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.555085  6454 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:25.556058  7792 consensus_peers.cc:597] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260501 14:01:25.557942  6454 tablet_replica.cc:333] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.558609  6454 raft_consensus.cc:2243] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.559541  6454 raft_consensus.cc:2272] T 5ecf82e363814b0084cab2799c85ee9d P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.562045  6454 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.562638  6454 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.563244  6454 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.565742  6454 tablet_replica.cc:333] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.566385  6454 raft_consensus.cc:2243] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.567515  6454 raft_consensus.cc:2272] T a7e6863e401d47c485d22868ddfb6a08 P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.569764  6454 tablet_replica.cc:333] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.570438  6454 raft_consensus.cc:2243] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
W20260501 14:01:25.570966  7794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260501 14:01:25.571481  6454 raft_consensus.cc:2272] T eed0026bd9c541b7b89c956e31761d54 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.573810  6454 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.574440  6454 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.575982  6454 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P ca8dd10afb304b4c96cfcec7e2309947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.578102  6454 tablet_replica.cc:333] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.578642  6454 raft_consensus.cc:2243] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.579615  6454 raft_consensus.cc:2272] T fed0245aa0064b4c8685aeb38d1de9c0 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.583966  6454 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.584721  6454 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.586089  6454 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P ca8dd10afb304b4c96cfcec7e2309947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.589823  6454 tablet_replica.cc:333] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.590719  6454 raft_consensus.cc:2243] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.591899  6454 raft_consensus.cc:2272] T c6b7bef99f44450d853fce321082a78b P ca8dd10afb304b4c96cfcec7e2309947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.594270  6454 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.594851  6454 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.595444  6454 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.597702  6454 tablet_replica.cc:333] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.598244  6454 raft_consensus.cc:2243] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.599454  6454 raft_consensus.cc:2272] T 5cde3c3e4a3b462b8f274fec8e2adbe3 P ca8dd10afb304b4c96cfcec7e2309947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.601809  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.602427  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.603792  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.606256  6454 tablet_replica.cc:333] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.606756  6454 raft_consensus.cc:2243] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.607746  6454 raft_consensus.cc:2272] T c1e64ae6fa3e42b5be743466a0338478 P ca8dd10afb304b4c96cfcec7e2309947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.609987  6454 tablet_replica.cc:333] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.610488  6454 raft_consensus.cc:2243] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:25.611405  6454 raft_consensus.cc:2272] T 3df4d60525ad4852996138e9e813b608 P ca8dd10afb304b4c96cfcec7e2309947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.613633  6454 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947: stopping tablet replica
I20260501 14:01:25.614094  6454 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:25.615015  6454 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P ca8dd10afb304b4c96cfcec7e2309947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:25.786702 13817 raft_consensus.cc:493] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:25.787549 13817 raft_consensus.cc:515] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:25.795504  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:25.801568  8344 leader_election.cc:336] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:25.802222  8344 leader_election.cc:304] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:25.803310 13818 raft_consensus.cc:2749] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:25.804234 13817 leader_election.cc:290] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.030369  8344 consensus_peers.cc:597] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260501 14:01:26.101425 13755 raft_consensus.cc:493] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.102018 13755 raft_consensus.cc:515] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.104151 13755 leader_election.cc:290] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.110929  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.111577  8344 leader_election.cc:336] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.112046  8344 leader_election.cc:304] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.112893 13755 raft_consensus.cc:2749] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:26.117931  8344 consensus_peers.cc:597] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260501 14:01:26.153702  7625 auto_rebalancer.cc:285] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.162957  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:26.163378  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.163630  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.170764  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:26.171151  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.171396  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.181124  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:26.181538  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.181833  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.190228  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:26.190604  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.190861  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.236251  8344 consensus_peers.cc:597] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260501 14:01:26.312945 13755 raft_consensus.cc:493] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.313675 13755 raft_consensus.cc:515] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.316066 13755 leader_election.cc:290] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.321791  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.322335  8344 leader_election.cc:336] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.322659  8344 leader_election.cc:304] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.323254 13755 raft_consensus.cc:2749] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:26.344576 13818 raft_consensus.cc:493] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.345134 13818 raft_consensus.cc:515] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.347069 13818 leader_election.cc:290] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.352931  8344 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.353451  8344 leader_election.cc:336] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.353742  8344 leader_election.cc:304] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.354370 13818 raft_consensus.cc:2749] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:26.371050 13818 raft_consensus.cc:493] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.371780 13818 raft_consensus.cc:515] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.373803 13818 leader_election.cc:290] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
W20260501 14:01:26.379281  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.379803  8344 leader_election.cc:336] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.380221  8344 leader_election.cc:304] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.380846 13818 raft_consensus.cc:2749] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:26.390918 13818 raft_consensus.cc:493] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.391464 13818 raft_consensus.cc:515] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.393420 13818 leader_election.cc:290] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.397867  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.398579  8344 leader_election.cc:336] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.398911  8344 leader_election.cc:304] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.399526 13818 raft_consensus.cc:2749] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260501 14:01:26.482400  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 14:01:26.484311 13818 raft_consensus.cc:493] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.485025 13818 raft_consensus.cc:515] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.486964 13818 leader_election.cc:290] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.492296  8344 leader_election.cc:336] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.493005  8344 leader_election.cc:336] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.493417  8344 leader_election.cc:304] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.494362 13818 raft_consensus.cc:2749] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260501 14:01:26.503044  8344 consensus_peers.cc:597] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce -> Peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Couldn't send request to peer bc1b0a0a152e46fea4bd4934ba9976ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260501 14:01:26.507910 13755 raft_consensus.cc:493] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.508540 13755 raft_consensus.cc:515] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.510304 13818 raft_consensus.cc:493] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.510365 13755 leader_election.cc:290] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.511374 13818 raft_consensus.cc:515] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:26.517153  8344 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.517788 13818 leader_election.cc:290] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.517918  8344 leader_election.cc:336] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.518508  8344 leader_election.cc:304] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.519227 13818 raft_consensus.cc:2749] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260501 14:01:26.524750  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.525662  8344 leader_election.cc:336] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.526015  8344 leader_election.cc:304] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.526953 13818 raft_consensus.cc:2749] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260501 14:01:26.528702 13818 raft_consensus.cc:493] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.529165 13818 raft_consensus.cc:515] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.531080 13818 leader_election.cc:290] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.536712  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.537268  8344 leader_election.cc:336] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.537599  8344 leader_election.cc:304] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.538290 13818 raft_consensus.cc:2749] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:26.552284 13818 raft_consensus.cc:493] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.552894 13818 raft_consensus.cc:515] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: true } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.555466 13818 leader_election.cc:290] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.562788  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.563648  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.564118  8344 leader_election.cc:304] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.564970 13755 raft_consensus.cc:2749] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260501 14:01:26.565961  8344 leader_election.cc:336] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.614500 13818 raft_consensus.cc:493] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.615144 13818 raft_consensus.cc:515] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } attrs { replace: false } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } attrs { replace: true } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.617702 13818 leader_election.cc:290] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.621284 13818 raft_consensus.cc:493] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.621861 13818 raft_consensus.cc:515] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.625010 13818 leader_election.cc:290] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
W20260501 14:01:26.628890  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.629830  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.630332  8344 leader_election.cc:304] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.631048 13818 raft_consensus.cc:2749] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260501 14:01:26.631491  8344 leader_election.cc:336] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:26.634334  8344 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.635170  8344 leader_election.cc:336] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.635533  8344 leader_election.cc:304] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.636219 13818 raft_consensus.cc:2749] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260501 14:01:26.646762  6454 tablet_server.cc:179] TabletServer@127.6.77.132:0 shutting down...
I20260501 14:01:26.656548 13818 raft_consensus.cc:493] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.657359 13818 raft_consensus.cc:515] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.659919 13818 leader_election.cc:290] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.669595 13755 raft_consensus.cc:493] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
W20260501 14:01:26.669656  8344 leader_election.cc:336] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.670418 13755 raft_consensus.cc:515] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
W20260501 14:01:26.670893  8344 leader_election.cc:336] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.671494  8344 leader_election.cc:304] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.673103 13755 leader_election.cc:290] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:26.673739 13755 raft_consensus.cc:2749] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260501 14:01:26.680249  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.681486  8344 leader_election.cc:336] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.681939  8344 leader_election.cc:304] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.682813 13755 raft_consensus.cc:2749] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:26.707015  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:01:26.708074  6454 tablet_replica.cc:333] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.708868  6454 raft_consensus.cc:2243] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.709519  6454 raft_consensus.cc:2272] T 0f623f4077ef4ffdad05ca3c40797b9f P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.712421 13755 raft_consensus.cc:493] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.712543  6454 tablet_replica.cc:333] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.712977 13755 raft_consensus.cc:515] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.713693  6454 raft_consensus.cc:2243] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.714545  6454 raft_consensus.cc:2272] T 47951612b03c496aa487574a115ca380 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.715225 13755 leader_election.cc:290] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.717999  6454 tablet_replica.cc:333] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.719153  6454 raft_consensus.cc:2243] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.720331  6454 raft_consensus.cc:2272] T 93b661856a9e45bf823981177d99ae0c P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.721030  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.721818  8344 leader_election.cc:336] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:26.722211  8344 leader_election.cc:304] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.722966 13755 raft_consensus.cc:2749] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260501 14:01:26.723670 13818 raft_consensus.cc:493] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.724231 13818 raft_consensus.cc:515] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.725961 13818 leader_election.cc:290] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.726799  6454 tablet_replica.cc:333] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.727944  6454 raft_consensus.cc:2243] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.729555  6454 raft_consensus.cc:2272] T 4262547d9184416ab702339797bead6f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.733485  6454 tablet_replica.cc:333] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.734565  6454 raft_consensus.cc:2243] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.735441  6454 raft_consensus.cc:2272] T a769b271cb04497eb1cb86169399ceb2 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.738942  6454 tablet_replica.cc:333] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.739611  6454 raft_consensus.cc:2243] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
W20260501 14:01:26.739889  8344 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.740345  6454 raft_consensus.cc:2272] T 367eab87da314007b62b7bd0a0905d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.740885  8344 leader_election.cc:336] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.741288  8344 leader_election.cc:304] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.742039 13818 raft_consensus.cc:2749] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260501 14:01:26.745894  6454 tablet_replica.cc:333] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.747200  6454 raft_consensus.cc:2243] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.748217  6454 raft_consensus.cc:2272] T 959ae22d6e614940b93df344dbf7fa20 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.752120  6454 tablet_replica.cc:333] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.752972 13755 raft_consensus.cc:493] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.753125  6454 raft_consensus.cc:2243] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.753544 13755 raft_consensus.cc:515] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.753907  6454 raft_consensus.cc:2272] T c4f9a0d66d094218a7a19cb600d50a75 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.755643 13755 leader_election.cc:290] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.757828  6454 tablet_replica.cc:333] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.759052  6454 raft_consensus.cc:2243] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.760264  6454 raft_consensus.cc:2272] T 23c164f5975a45b495c25c9e99b628d3 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.760898  8344 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:26.761720  8344 leader_election.cc:336] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.762087  8344 leader_election.cc:304] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.762765 13755 raft_consensus.cc:2749] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260501 14:01:26.764163  6454 tablet_replica.cc:333] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.765337  6454 raft_consensus.cc:2243] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.766098  6454 raft_consensus.cc:2272] T 2a9517b581244993be7b40b089a96bd0 P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.769623  6454 tablet_replica.cc:333] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.770546  6454 raft_consensus.cc:2243] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.771693  6454 raft_consensus.cc:2272] T 43c8497c73c3498ca73ca16b7f2da7cd P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.774995 13755 raft_consensus.cc:493] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.775194  6454 tablet_replica.cc:333] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.775489 13755 raft_consensus.cc:515] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.776261  6454 raft_consensus.cc:2243] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.776345 13818 raft_consensus.cc:493] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.777232  6454 raft_consensus.cc:2272] T f1ee722489b34f13bc6b2cc16825e5c9 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.776997 13818 raft_consensus.cc:515] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.777608 13755 leader_election.cc:290] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.779050 13818 leader_election.cc:290] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.780537  6454 tablet_replica.cc:333] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.781654  6454 raft_consensus.cc:2243] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.782577  6454 raft_consensus.cc:2272] T c445f628c10d40b5a232bb391c4c92de P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.784519 13818 raft_consensus.cc:493] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 109c9ba263c34ff8aee17bc446cf258e)
I20260501 14:01:26.785113 13818 raft_consensus.cc:515] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "109c9ba263c34ff8aee17bc446cf258e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 41997 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.786906  6454 tablet_replica.cc:333] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.787307 13818 leader_election.cc:290] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997)
I20260501 14:01:26.787990  6454 raft_consensus.cc:2243] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.788815  6454 raft_consensus.cc:2272] T d76c50227fdf4363bff9df76fdb05b2f P 91854d93e96c4756834efe8b2ef59fce [term 13 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.789206  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:26.791546  8344 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.792351  6454 tablet_replica.cc:333] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
W20260501 14:01:26.792356  8344 leader_election.cc:336] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.793094  8344 leader_election.cc:304] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.793551  6454 raft_consensus.cc:2243] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.793781 13818 raft_consensus.cc:2749] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260501 14:01:26.793972  8344 leader_election.cc:336] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.794322  6454 raft_consensus.cc:2272] T 75d27004f21449f5bfdade4d62aeba88 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.794505  8344 leader_election.cc:304] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, ca8dd10afb304b4c96cfcec7e2309947
I20260501 14:01:26.795256 13818 raft_consensus.cc:2749] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260501 14:01:26.797928  6454 tablet_replica.cc:333] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.798969  6454 raft_consensus.cc:2243] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
W20260501 14:01:26.799911  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 109c9ba263c34ff8aee17bc446cf258e (127.6.77.130:41997): Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:26.800527  6454 raft_consensus.cc:2272] T 4b13ab5be933469ba7c57247efb0f8e9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.800662  8344 leader_election.cc:336] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:26.801141  8344 leader_election.cc:304] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: 109c9ba263c34ff8aee17bc446cf258e, bc1b0a0a152e46fea4bd4934ba9976ed
I20260501 14:01:26.801802 13818 raft_consensus.cc:2749] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260501 14:01:26.804219  6454 tablet_replica.cc:333] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.805233  6454 raft_consensus.cc:2243] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.805886  6454 raft_consensus.cc:2272] T 4d228d3d4af349679aafa8dfdebf1247 P 91854d93e96c4756834efe8b2ef59fce [term 11 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.809083  6454 tablet_replica.cc:333] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.809957  6454 raft_consensus.cc:2243] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.810712  6454 raft_consensus.cc:2272] T b217e36f6e5e4fc38ba6e4ad89082fc6 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.813370 13818 raft_consensus.cc:493] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca8dd10afb304b4c96cfcec7e2309947)
I20260501 14:01:26.813906 13818 raft_consensus.cc:515] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc1b0a0a152e46fea4bd4934ba9976ed" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 36443 } } peers { permanent_uuid: "ca8dd10afb304b4c96cfcec7e2309947" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35015 } } peers { permanent_uuid: "91854d93e96c4756834efe8b2ef59fce" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 40155 } attrs { promote: false } }
I20260501 14:01:26.814293  6454 tablet_replica.cc:333] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.815384  6454 raft_consensus.cc:2243] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.815975 13818 leader_election.cc:290] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443), ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015)
I20260501 14:01:26.816819  6454 raft_consensus.cc:2272] T ef09d109d10447e796ab96c9a6eddef0 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.820035  6454 tablet_replica.cc:333] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
W20260501 14:01:26.820873  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:26.820962  6454 raft_consensus.cc:2243] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.822161  6454 raft_consensus.cc:2272] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [term 9 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:26.823262  8344 leader_election.cc:336] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca8dd10afb304b4c96cfcec7e2309947 (127.6.77.131:35015): Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:26.823702  8344 leader_election.cc:304] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91854d93e96c4756834efe8b2ef59fce; no voters: bc1b0a0a152e46fea4bd4934ba9976ed, ca8dd10afb304b4c96cfcec7e2309947
W20260501 14:01:26.824308  8344 raft_consensus.cc:2686] T 2caa4d7579144326a3f173b9182831e8 P 91854d93e96c4756834efe8b2ef59fce: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260501 14:01:26.825707  6454 tablet_replica.cc:333] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.826802  6454 raft_consensus.cc:2243] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.828109  6454 raft_consensus.cc:2272] T cac472405b2a42bb98dafbac4e20584b P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.831274  6454 tablet_replica.cc:333] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.832267  6454 raft_consensus.cc:2243] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.833052  6454 raft_consensus.cc:2272] T 3031b746c62f413a9da6fed211d638da P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.836248  6454 tablet_replica.cc:333] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.837198  6454 raft_consensus.cc:2243] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.838428  6454 raft_consensus.cc:2272] T 5ec67fee0d084477a66b6f72a7e73330 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.841743  6454 tablet_replica.cc:333] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.842700  6454 raft_consensus.cc:2243] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.843747  6454 raft_consensus.cc:2272] T 789c720014934abe950ad611625f9bc9 P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.847407  6454 tablet_replica.cc:333] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.848337  6454 raft_consensus.cc:2243] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.849305  6454 raft_consensus.cc:2272] T c469ec5051564ef892cf10d14e1eb6d4 P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.852600  6454 tablet_replica.cc:333] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.853448  6454 raft_consensus.cc:2243] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.854059  6454 raft_consensus.cc:2272] T 3c14b33d5ea8424cb04207b894010749 P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.857132  6454 tablet_replica.cc:333] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.857967  6454 raft_consensus.cc:2243] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.858680  6454 raft_consensus.cc:2272] T 1f875366331345f08d2e236a76c1c71d P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.861969  6454 tablet_replica.cc:333] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.862843  6454 raft_consensus.cc:2243] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.863588  6454 raft_consensus.cc:2272] T 539945233a6f4f6589f58e774245669e P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.866909  6454 tablet_replica.cc:333] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.867766  6454 raft_consensus.cc:2243] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.868588  6454 raft_consensus.cc:2272] T 1551821b4ac3438ea79dc8c95256cfde P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.871798  6454 tablet_replica.cc:333] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.872740  6454 raft_consensus.cc:2243] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.874151  6454 raft_consensus.cc:2272] T 0a337f1f80f84ec1b4f2ed376a8436ea P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.877615  6454 tablet_replica.cc:333] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.878486  6454 raft_consensus.cc:2243] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.879248  6454 raft_consensus.cc:2272] T 26c659157efb4e3ba3d97b7ad9d62068 P 91854d93e96c4756834efe8b2ef59fce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.882284  6454 tablet_replica.cc:333] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.883147  6454 raft_consensus.cc:2243] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.883845  6454 raft_consensus.cc:2272] T 91eb60ac1c7a48a0b3662ef7e5327f66 P 91854d93e96c4756834efe8b2ef59fce [term 22 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.886947  6454 tablet_replica.cc:333] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.887861  6454 raft_consensus.cc:2243] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.888744  6454 raft_consensus.cc:2272] T c91be7730b684fbd94e69655ab35fd61 P 91854d93e96c4756834efe8b2ef59fce [term 21 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.892150  6454 tablet_replica.cc:333] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.892995  6454 raft_consensus.cc:2243] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.894378  6454 raft_consensus.cc:2272] T b9a0dc7ba0d34f5c9d9eb78874fd40bc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.897733  6454 tablet_replica.cc:333] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.898572  6454 raft_consensus.cc:2243] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.899322  6454 raft_consensus.cc:2272] T 7211edc2aa9543b3996e3279fffe4edc P 91854d93e96c4756834efe8b2ef59fce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.902549  6454 tablet_replica.cc:333] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.903355  6454 raft_consensus.cc:2243] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.904593  6454 raft_consensus.cc:2272] T 8489b3d6a1b74818947d84d7c795a5fb P 91854d93e96c4756834efe8b2ef59fce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.907900  6454 tablet_replica.cc:333] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.908672  6454 raft_consensus.cc:2243] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.909350  6454 raft_consensus.cc:2272] T 2a1d6c31dce44935952b27fbc57a2d38 P 91854d93e96c4756834efe8b2ef59fce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.912521  6454 tablet_replica.cc:333] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.913262  6454 raft_consensus.cc:2243] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 LEADER]: Raft consensus shutting down.
I20260501 14:01:26.914394  6454 raft_consensus.cc:2272] T 0ab3422d02d5408caed8cf6c79922e21 P 91854d93e96c4756834efe8b2ef59fce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:26.917744  6454 tablet_replica.cc:333] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce: stopping tablet replica
I20260501 14:01:26.918465  6454 raft_consensus.cc:2243] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus shutting down.
I20260501 14:01:26.919113  6454 raft_consensus.cc:2272] T c6dc2741afba411fbd7695217702cdda P 91854d93e96c4756834efe8b2ef59fce [term 20 FOLLOWER]: Raft consensus is shut down!
W20260501 14:01:27.285727  7625 auto_rebalancer.cc:285] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
I20260501 14:01:27.295080  6454 tablet_server.cc:196] TabletServer@127.6.77.132:0 shutdown complete.
W20260501 14:01:27.299340  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:27.299762  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.300107  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.307047  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:27.307420  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:27.307677  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:27.315625  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused
W20260501 14:01:27.315984  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.316234  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.131:35015: connect: Connection refused (error 111)
W20260501 14:01:27.323927  7625 auto_rebalancer.cc:806] Removing replace marker failed: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused
W20260501 14:01:27.324326  7625 auto_rebalancer.cc:814] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
W20260501 14:01:27.324570  7625 auto_rebalancer.cc:295] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.6.77.130:41997: connect: Connection refused (error 111)
I20260501 14:01:27.404191  6454 master.cc:562] Master@127.6.77.190:38503 shutting down...
W20260501 14:01:29.672726  7608 debug-util.cc:398] Leaking SignalData structure 0x7b080000b460 after lost signal to thread 6457
W20260501 14:01:29.673316  7608 debug-util.cc:398] Leaking SignalData structure 0x7b08001575a0 after lost signal to thread 7611
W20260501 14:01:38.693519  7562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111) [suppressed 215 similar messages]
W20260501 14:01:38.697372  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 93b661856a9e45bf823981177d99ae0c: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
W20260501 14:01:41.320930  7562 catalog_manager.cc:4729] TS bc1b0a0a152e46fea4bd4934ba9976ed (127.6.77.129:36443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c91be7730b684fbd94e69655ab35fd61: Network error: Client connection negotiation failed: client connection to 127.6.77.129:36443: connect: Connection refused (error 111)
I20260501 14:01:44.468705  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:01:44.471975  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:01:44.472487  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0eb6c3b6d06a4c02bcd619b78c2cbb38: stopping tablet replica
I20260501 14:01:44.690171  6454 master.cc:584] Master@127.6.77.190:38503 shutdown complete.
I20260501 14:01:44.746039  6454 test_util.cc:182] -----------------------------------------------
I20260501 14:01:44.746333  6454 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777643835062054-6454-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (205531 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260501 14:01:44.750660  6454 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.77.190:42909
I20260501 14:01:44.752204  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:01:44.758563 13833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:44.758574 13834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:44.759908 13836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:01:44.761215  6454 server_base.cc:1061] running on GCE node
I20260501 14:01:44.765309  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:01:44.765498  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:01:44.765621  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644104765610 us; error 0 us; skew 500 ppm
I20260501 14:01:44.766103  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:01:44.768810  6454 webserver.cc:492] Webserver started at http://127.6.77.190:33809/ using document root <none> and password file <none>
I20260501 14:01:44.769290  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:01:44.769454  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:01:44.769722  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:01:44.771095  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/master-0-root/instance:
uuid: "9ab43bf4be274f00982a66a498b6c11f"
format_stamp: "Formatted at 2026-05-01 14:01:44 on dist-test-slave-1sft"
I20260501 14:01:44.775918  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260501 14:01:44.779531 13841 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:44.780421  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260501 14:01:44.780745  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/master-0-root
uuid: "9ab43bf4be274f00982a66a498b6c11f"
format_stamp: "Formatted at 2026-05-01 14:01:44 on dist-test-slave-1sft"
I20260501 14:01:44.781059  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:01:44.797977  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:01:44.799371  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:01:44.843971  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.190:42909
I20260501 14:01:44.844084 13892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.190:42909 every 8 connection(s)
I20260501 14:01:44.848500 13893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:44.860976 13893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f: Bootstrap starting.
I20260501 14:01:44.866418 13893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:44.871006 13893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f: No bootstrap required, opened a new log
I20260501 14:01:44.873466 13893 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab43bf4be274f00982a66a498b6c11f" member_type: VOTER }
I20260501 14:01:44.873936 13893 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:44.874135 13893 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab43bf4be274f00982a66a498b6c11f, State: Initialized, Role: FOLLOWER
I20260501 14:01:44.874624 13893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab43bf4be274f00982a66a498b6c11f" member_type: VOTER }
I20260501 14:01:44.875062 13893 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260501 14:01:44.875252 13893 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260501 14:01:44.875455 13893 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:44.880277 13893 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab43bf4be274f00982a66a498b6c11f" member_type: VOTER }
I20260501 14:01:44.880748 13893 leader_election.cc:304] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ab43bf4be274f00982a66a498b6c11f; no voters: 
I20260501 14:01:44.882020 13893 leader_election.cc:290] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260501 14:01:44.882544 13896 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:44.884562 13896 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 1 LEADER]: Becoming Leader. State: Replica: 9ab43bf4be274f00982a66a498b6c11f, State: Running, Role: LEADER
I20260501 14:01:44.885406 13893 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [sys.catalog]: configured and running, proceeding with master startup.
I20260501 14:01:44.885519 13896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab43bf4be274f00982a66a498b6c11f" member_type: VOTER }
I20260501 14:01:44.896068 13898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ab43bf4be274f00982a66a498b6c11f. Latest consensus state: current_term: 1 leader_uuid: "9ab43bf4be274f00982a66a498b6c11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab43bf4be274f00982a66a498b6c11f" member_type: VOTER } }
I20260501 14:01:44.896615 13898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [sys.catalog]: This master's current role is: LEADER
I20260501 14:01:44.896329 13897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ab43bf4be274f00982a66a498b6c11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab43bf4be274f00982a66a498b6c11f" member_type: VOTER } }
I20260501 14:01:44.897308 13897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [sys.catalog]: This master's current role is: LEADER
I20260501 14:01:44.899085 13908 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260501 14:01:44.904615 13908 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260501 14:01:44.905989  6454 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260501 14:01:44.914127 13908 catalog_manager.cc:1357] Generated new cluster ID: e99e0a452d11450f98e76ab83266a656
I20260501 14:01:44.914429 13908 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260501 14:01:44.944260 13908 catalog_manager.cc:1380] Generated new certificate authority record
I20260501 14:01:44.945806 13908 catalog_manager.cc:1514] Loading token signing keys...
I20260501 14:01:44.962536 13908 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f: Generated new TSK 0
I20260501 14:01:44.963194 13908 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260501 14:01:44.973344  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:01:44.980939 13914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:44.981477 13915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:44.983469 13917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:01:44.984365  6454 server_base.cc:1061] running on GCE node
I20260501 14:01:44.987241  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:01:44.987466  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:01:44.987673  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644104987653 us; error 0 us; skew 500 ppm
I20260501 14:01:44.988376  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:01:44.991056  6454 webserver.cc:492] Webserver started at http://127.6.77.129:33293/ using document root <none> and password file <none>
I20260501 14:01:44.991621  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:01:44.991868  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:01:44.992178  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:01:44.993577  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/instance:
uuid: "fe6496472aa4477cb4d5a008edd292f6"
format_stamp: "Formatted at 2026-05-01 14:01:44 on dist-test-slave-1sft"
I20260501 14:01:44.998744  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260501 14:01:45.002336 13922 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.003242  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260501 14:01:45.003598  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "fe6496472aa4477cb4d5a008edd292f6"
format_stamp: "Formatted at 2026-05-01 14:01:44 on dist-test-slave-1sft"
I20260501 14:01:45.004042  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:01:45.026886  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:01:45.028554  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:01:45.030247  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:01:45.032858  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:01:45.033116  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.033365  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:01:45.033555  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.081583  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:43181
I20260501 14:01:45.081691 13984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:43181 every 8 connection(s)
I20260501 14:01:45.087620  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:01:45.095546 13989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:45.097760 13990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:01:45.100821  6454 server_base.cc:1061] running on GCE node
W20260501 14:01:45.101155 13992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:01:45.103631  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:01:45.103926  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:01:45.104144  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644105104123 us; error 0 us; skew 500 ppm
I20260501 14:01:45.104987  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:01:45.106345 13985 heartbeater.cc:344] Connected to a master server at 127.6.77.190:42909
I20260501 14:01:45.106819 13985 heartbeater.cc:461] Registering TS with master...
I20260501 14:01:45.107738 13985 heartbeater.cc:507] Master 127.6.77.190:42909 requested a full tablet report, sending...
I20260501 14:01:45.108038  6454 webserver.cc:492] Webserver started at http://127.6.77.130:43811/ using document root <none> and password file <none>
I20260501 14:01:45.108739  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:01:45.108994  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:01:45.109290  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:01:45.110456 13858 ts_manager.cc:194] Registered new tserver with Master: fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:45.111294  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/instance:
uuid: "dba449c6af0341daa28866a4fd46cd96"
format_stamp: "Formatted at 2026-05-01 14:01:45 on dist-test-slave-1sft"
I20260501 14:01:45.113348 13858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38906
I20260501 14:01:45.117300  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260501 14:01:45.121083 13997 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.121971  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260501 14:01:45.122287  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-1-root
uuid: "dba449c6af0341daa28866a4fd46cd96"
format_stamp: "Formatted at 2026-05-01 14:01:45 on dist-test-slave-1sft"
I20260501 14:01:45.122608  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:01:45.140261  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:01:45.141793  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:01:45.143453  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:01:45.145968  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:01:45.146216  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.146476  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:01:45.146652  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.196163  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.130:40057
I20260501 14:01:45.196307 14059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.130:40057 every 8 connection(s)
I20260501 14:01:45.201499  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:01:45.210845 14063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:45.213536 14064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:45.214648 14066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:01:45.215590  6454 server_base.cc:1061] running on GCE node
I20260501 14:01:45.216655  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:01:45.216907  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:01:45.216903 14060 heartbeater.cc:344] Connected to a master server at 127.6.77.190:42909
I20260501 14:01:45.217350  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644105217326 us; error 0 us; skew 500 ppm
I20260501 14:01:45.217552 14060 heartbeater.cc:461] Registering TS with master...
I20260501 14:01:45.218207  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:01:45.218600 14060 heartbeater.cc:507] Master 127.6.77.190:42909 requested a full tablet report, sending...
I20260501 14:01:45.221076  6454 webserver.cc:492] Webserver started at http://127.6.77.131:45029/ using document root <none> and password file <none>
I20260501 14:01:45.221099 13858 ts_manager.cc:194] Registered new tserver with Master: dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:45.221771  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:01:45.222033  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:01:45.222325  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:01:45.222924 13858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38912
I20260501 14:01:45.223795  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/instance:
uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
format_stamp: "Formatted at 2026-05-01 14:01:45 on dist-test-slave-1sft"
I20260501 14:01:45.229146  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260501 14:01:45.232784 14071 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.233595  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260501 14:01:45.233906  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-2-root
uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
format_stamp: "Formatted at 2026-05-01 14:01:45 on dist-test-slave-1sft"
I20260501 14:01:45.234238  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:01:45.251487  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:01:45.252947  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:01:45.254665  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:01:45.257124  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:01:45.257368  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.257609  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:01:45.257781  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.306121  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.131:42573
I20260501 14:01:45.306245 14133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.131:42573 every 8 connection(s)
I20260501 14:01:45.312014  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:01:45.321687 14138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:45.321759 14137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:01:45.325042 14140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:01:45.325661 14134 heartbeater.cc:344] Connected to a master server at 127.6.77.190:42909
I20260501 14:01:45.326227 14134 heartbeater.cc:461] Registering TS with master...
I20260501 14:01:45.326273  6454 server_base.cc:1061] running on GCE node
I20260501 14:01:45.327117 14134 heartbeater.cc:507] Master 127.6.77.190:42909 requested a full tablet report, sending...
I20260501 14:01:45.327373  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:01:45.327656  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:01:45.327875  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644105327854 us; error 0 us; skew 500 ppm
I20260501 14:01:45.328538  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:01:45.329336 13858 ts_manager.cc:194] Registered new tserver with Master: e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:45.331123 13858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38926
I20260501 14:01:45.331305  6454 webserver.cc:492] Webserver started at http://127.6.77.132:37035/ using document root <none> and password file <none>
I20260501 14:01:45.331977  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:01:45.332207  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:01:45.332491  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:01:45.333760  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-3-root/instance:
uuid: "fcac793323404da6a1245c4c5264b767"
format_stamp: "Formatted at 2026-05-01 14:01:45 on dist-test-slave-1sft"
I20260501 14:01:45.338840  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260501 14:01:45.342628 14145 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.343468  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260501 14:01:45.343874  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-3-root
uuid: "fcac793323404da6a1245c4c5264b767"
format_stamp: "Formatted at 2026-05-01 14:01:45 on dist-test-slave-1sft"
I20260501 14:01:45.344201  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:01:45.355670  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:01:45.357156  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:01:45.358853  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:01:45.361436  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:01:45.361673  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.361929  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:01:45.362113  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:01:45.410398  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.132:37909
I20260501 14:01:45.410497 14207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.132:37909 every 8 connection(s)
I20260501 14:01:45.425990 14208 heartbeater.cc:344] Connected to a master server at 127.6.77.190:42909
I20260501 14:01:45.426568 14208 heartbeater.cc:461] Registering TS with master...
I20260501 14:01:45.427969 14208 heartbeater.cc:507] Master 127.6.77.190:42909 requested a full tablet report, sending...
I20260501 14:01:45.430732 13858 ts_manager.cc:194] Registered new tserver with Master: fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:45.433100 13858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38936
I20260501 14:01:45.434470  6454 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.020328133s
I20260501 14:01:45.473575 13858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260501 14:01:45.746260 14173 tablet_service.cc:1511] Processing CreateTablet for tablet f3de26ee36254bc5966555788936888a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260501 14:01:45.749504 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d7624d3964ef8a521561e8bb5a8e0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260501 14:01:45.754969 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 75a3f16449384bc982d2662b9bbcaeba (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260501 14:01:45.758467 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3de26ee36254bc5966555788936888a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.761291 14170 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1cbf2b2ed64fd19070d2c318260e59 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260501 14:01:45.762658 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a3f16449384bc982d2662b9bbcaeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.764945 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 21abf15277ce40ea892dd216ab77ea2a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260501 14:01:45.771945 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 75a3f16449384bc982d2662b9bbcaeba (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260501 14:01:45.772897 14099 tablet_service.cc:1511] Processing CreateTablet for tablet f3de26ee36254bc5966555788936888a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260501 14:01:45.773682 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a3f16449384bc982d2662b9bbcaeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.773526 13949 tablet_service.cc:1511] Processing CreateTablet for tablet 28d779c5709e49a2aad6974b29b62fe8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260501 14:01:45.774551 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3de26ee36254bc5966555788936888a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.777334 14095 tablet_service.cc:1511] Processing CreateTablet for tablet 21abf15277ce40ea892dd216ab77ea2a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260501 14:01:45.777558 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d7624d3964ef8a521561e8bb5a8e0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260501 14:01:45.779019 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21abf15277ce40ea892dd216ab77ea2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.780927 13947 tablet_service.cc:1511] Processing CreateTablet for tablet 97ebbe901baf4a2abe83987271e91687 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260501 14:01:45.781337 14094 tablet_service.cc:1511] Processing CreateTablet for tablet 4c018894af1c4282b43813c828e0f3df (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260501 14:01:45.782907 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c018894af1c4282b43813c828e0f3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.786023 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 97ebbe901baf4a2abe83987271e91687 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260501 14:01:45.784240 13946 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1cbf2b2ed64fd19070d2c318260e59 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260501 14:01:45.789508 14098 tablet_service.cc:1511] Processing CreateTablet for tablet 28d779c5709e49a2aad6974b29b62fe8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260501 14:01:45.771225 13950 tablet_service.cc:1511] Processing CreateTablet for tablet f3de26ee36254bc5966555788936888a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260501 14:01:45.791422 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21abf15277ce40ea892dd216ab77ea2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.793092 13945 tablet_service.cc:1511] Processing CreateTablet for tablet 21abf15277ce40ea892dd216ab77ea2a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260501 14:01:45.775626 13949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d779c5709e49a2aad6974b29b62fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.787667 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ebbe901baf4a2abe83987271e91687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.801296 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d7624d3964ef8a521561e8bb5a8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.804251 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1cbf2b2ed64fd19070d2c318260e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.804306 13950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3de26ee36254bc5966555788936888a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.807782 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ebbe901baf4a2abe83987271e91687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.809504 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 4c018894af1c4282b43813c828e0f3df (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260501 14:01:45.811211 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c018894af1c4282b43813c828e0f3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.812364 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d779c5709e49a2aad6974b29b62fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.816342 13945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21abf15277ce40ea892dd216ab77ea2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.820374 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d7624d3964ef8a521561e8bb5a8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.821463 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1cbf2b2ed64fd19070d2c318260e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.847241 13944 tablet_service.cc:1511] Processing CreateTablet for tablet 9c46ee8477ac4c76b73d11145f5948f9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260501 14:01:45.849236 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c46ee8477ac4c76b73d11145f5948f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.881347 14093 tablet_service.cc:1511] Processing CreateTablet for tablet 9c46ee8477ac4c76b73d11145f5948f9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260501 14:01:45.883102 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c46ee8477ac4c76b73d11145f5948f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.883700 14167 tablet_service.cc:1511] Processing CreateTablet for tablet 22408a26005c43e69c31f3ef8fbe401b (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260501 14:01:45.886905 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22408a26005c43e69c31f3ef8fbe401b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.886650 13943 tablet_service.cc:1511] Processing CreateTablet for tablet 22408a26005c43e69c31f3ef8fbe401b (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260501 14:01:45.888259 13943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22408a26005c43e69c31f3ef8fbe401b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:45.896422 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:45.910046 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 759b9fe010354272a79f83b2a223aaa8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260501 14:01:45.911774 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759b9fe010354272a79f83b2a223aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.912475 14166 tablet_service.cc:1511] Processing CreateTablet for tablet 759b9fe010354272a79f83b2a223aaa8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260501 14:01:45.914013 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759b9fe010354272a79f83b2a223aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.916392 14227 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:45.931490 14099 tablet_service.cc:1511] Processing CreateTablet for tablet fbe7f10257e74bee9c9de08d91394e3d (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260501 14:01:45.932678 14165 tablet_service.cc:1511] Processing CreateTablet for tablet fbe7f10257e74bee9c9de08d91394e3d (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260501 14:01:45.933132 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe7f10257e74bee9c9de08d91394e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.934185 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe7f10257e74bee9c9de08d91394e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.936877 14023 tablet_service.cc:1511] Processing CreateTablet for tablet 75a3f16449384bc982d2662b9bbcaeba (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260501 14:01:45.938405 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a3f16449384bc982d2662b9bbcaeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.939411 14025 tablet_service.cc:1511] Processing CreateTablet for tablet 28d779c5709e49a2aad6974b29b62fe8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260501 14:01:45.941039 14025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d779c5709e49a2aad6974b29b62fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.941212 14022 tablet_service.cc:1511] Processing CreateTablet for tablet 97ebbe901baf4a2abe83987271e91687 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260501 14:01:45.942790 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ebbe901baf4a2abe83987271e91687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.945178 14021 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1cbf2b2ed64fd19070d2c318260e59 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260501 14:01:45.946702 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1cbf2b2ed64fd19070d2c318260e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.949203 14020 tablet_service.cc:1511] Processing CreateTablet for tablet 4c018894af1c4282b43813c828e0f3df (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260501 14:01:45.950776 14020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c018894af1c4282b43813c828e0f3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.953123 14019 tablet_service.cc:1511] Processing CreateTablet for tablet 9c46ee8477ac4c76b73d11145f5948f9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260501 14:01:45.954571 14019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c46ee8477ac4c76b73d11145f5948f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.957226 14018 tablet_service.cc:1511] Processing CreateTablet for tablet 22408a26005c43e69c31f3ef8fbe401b (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260501 14:01:45.958007 14227 tablet_bootstrap.cc:654] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:45.958775 14018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22408a26005c43e69c31f3ef8fbe401b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.945188 14024 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d7624d3964ef8a521561e8bb5a8e0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260501 14:01:45.961944 14017 tablet_service.cc:1511] Processing CreateTablet for tablet fbe7f10257e74bee9c9de08d91394e3d (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260501 14:01:45.962762 13946 tablet_service.cc:1511] Processing CreateTablet for tablet f18a923244304708a082b89059b70764 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260501 14:01:45.964105 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a923244304708a082b89059b70764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.972213 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d7624d3964ef8a521561e8bb5a8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.976682 14017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe7f10257e74bee9c9de08d91394e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:45.991168 14228 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:46.007279 14016 tablet_service.cc:1511] Processing CreateTablet for tablet f18a923244304708a082b89059b70764 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260501 14:01:46.009903 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a923244304708a082b89059b70764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.044873 13947 tablet_service.cc:1511] Processing CreateTablet for tablet 759b9fe010354272a79f83b2a223aaa8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260501 14:01:46.046849 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759b9fe010354272a79f83b2a223aaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.052120 14228 tablet_bootstrap.cc:654] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.063798 14229 tablet_bootstrap.cc:492] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:46.066597 14093 tablet_service.cc:1511] Processing CreateTablet for tablet f18a923244304708a082b89059b70764 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260501 14:01:46.075095 14231 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:46.079105 13943 tablet_service.cc:1511] Processing CreateTablet for tablet 81b6408b3eea487ea04c6bc19768a4fb (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260501 14:01:46.081022 13943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b6408b3eea487ea04c6bc19768a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.083684 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 81b6408b3eea487ea04c6bc19768a4fb (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260501 14:01:46.085275 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b6408b3eea487ea04c6bc19768a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.086844 14025 tablet_service.cc:1511] Processing CreateTablet for tablet 81b6408b3eea487ea04c6bc19768a4fb (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260501 14:01:46.088459 14025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b6408b3eea487ea04c6bc19768a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.089985 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 1c534f0c5c5845f592e3cec990b099bc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260501 14:01:46.091390 14231 tablet_bootstrap.cc:654] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.097771 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 1c534f0c5c5845f592e3cec990b099bc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260501 14:01:46.099261 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c534f0c5c5845f592e3cec990b099bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.116710 13985 heartbeater.cc:499] Master 127.6.77.190:42909 was elected leader, sending a full tablet report...
I20260501 14:01:46.129384 14231 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:46.130033 14231 ts_tablet_manager.cc:1403] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.055s	user 0.005s	sys 0.027s
I20260501 14:01:46.132788 14227 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:46.133445 14227 ts_tablet_manager.cc:1403] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.218s	user 0.032s	sys 0.052s
I20260501 14:01:46.136402 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a923244304708a082b89059b70764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.137253 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c534f0c5c5845f592e3cec990b099bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.137384 14227 raft_consensus.cc:359] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.138228 14227 raft_consensus.cc:385] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.138545 14227 raft_consensus.cc:740] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.140552 14227 consensus_queue.cc:260] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.147732 14231 raft_consensus.cc:359] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:46.148629 14231 raft_consensus.cc:385] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.148952 14231 raft_consensus.cc:740] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.152549 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 2c73e59416ac4bbab3ca71bc9ccb8395 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260501 14:01:46.153774 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 2c73e59416ac4bbab3ca71bc9ccb8395 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260501 14:01:46.155268 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c73e59416ac4bbab3ca71bc9ccb8395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.155061 14023 tablet_service.cc:1511] Processing CreateTablet for tablet 2c73e59416ac4bbab3ca71bc9ccb8395 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260501 14:01:46.154203 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c73e59416ac4bbab3ca71bc9ccb8395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.156234 14231 consensus_queue.cc:260] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:46.165377 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c73e59416ac4bbab3ca71bc9ccb8395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.169899 13943 tablet_service.cc:1511] Processing CreateTablet for tablet 1c534f0c5c5845f592e3cec990b099bc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260501 14:01:46.183616 14229 tablet_bootstrap.cc:654] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.189270 13943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c534f0c5c5845f592e3cec990b099bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.217795 14060 heartbeater.cc:499] Master 127.6.77.190:42909 was elected leader, sending a full tablet report...
I20260501 14:01:46.218370 14227 ts_tablet_manager.cc:1434] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.085s	user 0.014s	sys 0.018s
I20260501 14:01:46.218786 14228 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:46.219312 14134 heartbeater.cc:499] Master 127.6.77.190:42909 was elected leader, sending a full tablet report...
I20260501 14:01:46.219385 14228 ts_tablet_manager.cc:1403] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.229s	user 0.031s	sys 0.032s
I20260501 14:01:46.226537 14227 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:46.227350 14231 ts_tablet_manager.cc:1434] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.097s	user 0.004s	sys 0.020s
I20260501 14:01:46.228958 14231 tablet_bootstrap.cc:492] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:46.229707 14228 raft_consensus.cc:359] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.230794 14228 raft_consensus.cc:385] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.231180 14228 raft_consensus.cc:740] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.233989 14227 tablet_bootstrap.cc:654] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.237238 14231 tablet_bootstrap.cc:654] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.240916 13947 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3a7258fde148469fc13884190b3b50 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260501 14:01:46.242929 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3a7258fde148469fc13884190b3b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.250869 14095 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3a7258fde148469fc13884190b3b50 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260501 14:01:46.253036 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3a7258fde148469fc13884190b3b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.245415 14019 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3a7258fde148469fc13884190b3b50 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260501 14:01:46.260787 14228 consensus_queue.cc:260] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.261652 14019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3a7258fde148469fc13884190b3b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.274061 14172 tablet_service.cc:1511] Processing CreateTablet for tablet bf71137f69a744b4a92765dd2b7e0b25 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260501 14:01:46.276376 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf71137f69a744b4a92765dd2b7e0b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.306183 14228 ts_tablet_manager.cc:1434] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.002s
W20260501 14:01:46.312582 14135 tablet.cc:2404] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260501 14:01:46.313504 14229 tablet_bootstrap.cc:492] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:46.314164 14229 ts_tablet_manager.cc:1403] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.016s
I20260501 14:01:46.317354 13946 tablet_service.cc:1511] Processing CreateTablet for tablet bf71137f69a744b4a92765dd2b7e0b25 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260501 14:01:46.321141 14227 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:46.317992 14229 raft_consensus.cc:359] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.320427 14025 tablet_service.cc:1511] Processing CreateTablet for tablet bf71137f69a744b4a92765dd2b7e0b25 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260501 14:01:46.330349 14229 raft_consensus.cc:385] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.330734 14229 raft_consensus.cc:740] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.323565 14231 tablet_bootstrap.cc:492] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:46.331882 14231 ts_tablet_manager.cc:1403] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.028s
I20260501 14:01:46.322382 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 257ae2a81f03487bac5d569393c8ee08 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260501 14:01:46.336769 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257ae2a81f03487bac5d569393c8ee08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.336899 14228 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:46.324427 13944 tablet_service.cc:1511] Processing CreateTablet for tablet 257ae2a81f03487bac5d569393c8ee08 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260501 14:01:46.339675 14016 tablet_service.cc:1511] Processing CreateTablet for tablet a955fb193fda436098188379de1edb2c (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260501 14:01:46.339881 14166 tablet_service.cc:1511] Processing CreateTablet for tablet a955fb193fda436098188379de1edb2c (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260501 14:01:46.329993 14227 ts_tablet_manager.cc:1403] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.104s	user 0.025s	sys 0.036s
I20260501 14:01:46.337713 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf71137f69a744b4a92765dd2b7e0b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.341630 14099 tablet_service.cc:1511] Processing CreateTablet for tablet a955fb193fda436098188379de1edb2c (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260501 14:01:46.350804 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a955fb193fda436098188379de1edb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.352656 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a955fb193fda436098188379de1edb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.342322 14093 tablet_service.cc:1511] Processing CreateTablet for tablet 257ae2a81f03487bac5d569393c8ee08 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260501 14:01:46.352880 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a955fb193fda436098188379de1edb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.365842 14025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf71137f69a744b4a92765dd2b7e0b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.354441 14227 raft_consensus.cc:359] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:46.350312 14229 consensus_queue.cc:260] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.348194 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 8c97fd620b464e0c91cdcd6df3e535ab (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260501 14:01:46.335392 14231 raft_consensus.cc:359] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.356539 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257ae2a81f03487bac5d569393c8ee08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.369694 14231 raft_consensus.cc:385] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.370110 14231 raft_consensus.cc:740] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.370326 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c97fd620b464e0c91cdcd6df3e535ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.370945 14231 consensus_queue.cc:260] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.373356 14231 ts_tablet_manager.cc:1434] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260501 14:01:46.374465 14231 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:46.378299 14241 raft_consensus.cc:493] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:46.379108 14229 ts_tablet_manager.cc:1434] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.003s
I20260501 14:01:46.378877 14241 raft_consensus.cc:515] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.368896 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257ae2a81f03487bac5d569393c8ee08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.380012 14208 heartbeater.cc:499] Master 127.6.77.190:42909 was elected leader, sending a full tablet report...
I20260501 14:01:46.380375 14229 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:46.381321 14023 tablet_service.cc:1511] Processing CreateTablet for tablet 8c97fd620b464e0c91cdcd6df3e535ab (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260501 14:01:46.382783 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c97fd620b464e0c91cdcd6df3e535ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.383949 14227 raft_consensus.cc:385] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.384305 14227 raft_consensus.cc:740] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.385083 14239 raft_consensus.cc:493] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:46.386440 14239 raft_consensus.cc:515] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.389173 14239 leader_election.cc:290] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:46.412883 14231 tablet_bootstrap.cc:654] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.428982 14234 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:46.430826 14234 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:46.433437 14234 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:46.430148 14241 leader_election.cc:290] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:46.385165 14227 consensus_queue.cc:260] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:46.448069 14235 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:46.476714 13949 tablet_service.cc:1511] Processing CreateTablet for tablet ead3c38847ad4f6ca3c0e3001b4a3936 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260501 14:01:46.478739 13949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead3c38847ad4f6ca3c0e3001b4a3936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.460608 14235 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:46.492507 14168 tablet_service.cc:1511] Processing CreateTablet for tablet ead3c38847ad4f6ca3c0e3001b4a3936 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260501 14:01:46.492816 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 814949c890d34428a715ffeaaed0d1ce (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260501 14:01:46.494279 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814949c890d34428a715ffeaaed0d1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.492625 14095 tablet_service.cc:1511] Processing CreateTablet for tablet 814949c890d34428a715ffeaaed0d1ce (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260501 14:01:46.495697 14098 tablet_service.cc:1511] Processing CreateTablet for tablet c8267536f1bb4b159dc87ac7afca5b70 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260501 14:01:46.497392 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814949c890d34428a715ffeaaed0d1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.509732 14228 tablet_bootstrap.cc:654] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.520709 14229 tablet_bootstrap.cc:654] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.521551 14165 tablet_service.cc:1511] Processing CreateTablet for tablet c8267536f1bb4b159dc87ac7afca5b70 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260501 14:01:46.523023 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8267536f1bb4b159dc87ac7afca5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.500123 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 8c97fd620b464e0c91cdcd6df3e535ab (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260501 14:01:46.530931 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead3c38847ad4f6ca3c0e3001b4a3936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.541406 14097 tablet_service.cc:1511] Processing CreateTablet for tablet a7467482380a426188c5b2ac43d54310 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260501 14:01:46.544008 13947 tablet_service.cc:1511] Processing CreateTablet for tablet a7467482380a426188c5b2ac43d54310 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260501 14:01:46.545469 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7467482380a426188c5b2ac43d54310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.515403 14234 raft_consensus.cc:493] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:46.555450 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 814949c890d34428a715ffeaaed0d1ce (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260501 14:01:46.557039 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814949c890d34428a715ffeaaed0d1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.559211 14094 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91939f293a4c53b18c1c18f4449f06 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260501 14:01:46.559582 14234 raft_consensus.cc:515] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.562140 14234 leader_election.cc:290] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:46.536911 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8267536f1bb4b159dc87ac7afca5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.596414 14231 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:46.597364 14231 ts_tablet_manager.cc:1403] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.223s	user 0.013s	sys 0.008s
I20260501 14:01:46.602173 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:46.604885 13926 leader_election.cc:343] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:46.612795 13949 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91939f293a4c53b18c1c18f4449f06 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260501 14:01:46.613556 13943 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfb57bc54a04297a88d40804890af15 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260501 14:01:46.614343 13949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91939f293a4c53b18c1c18f4449f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.615377 13943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfb57bc54a04297a88d40804890af15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.620404 13944 tablet_service.cc:1511] Processing CreateTablet for tablet 0265e96f503c4b65adaa438fe44216d7 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260501 14:01:46.622364 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0265e96f503c4b65adaa438fe44216d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.637109 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 0265e96f503c4b65adaa438fe44216d7 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260501 14:01:46.638736 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0265e96f503c4b65adaa438fe44216d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.640975 14170 tablet_service.cc:1511] Processing CreateTablet for tablet a14016a1d4de44178b73674dbf82b9c4 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260501 14:01:46.641077 14099 tablet_service.cc:1511] Processing CreateTablet for tablet a14016a1d4de44178b73674dbf82b9c4 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260501 14:01:46.642479 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14016a1d4de44178b73674dbf82b9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.642560 14167 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91939f293a4c53b18c1c18f4449f06 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260501 14:01:46.644114 14016 tablet_service.cc:1511] Processing CreateTablet for tablet ead3c38847ad4f6ca3c0e3001b4a3936 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260501 14:01:46.644917 14019 tablet_service.cc:1511] Processing CreateTablet for tablet c8267536f1bb4b159dc87ac7afca5b70 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260501 14:01:46.645491 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead3c38847ad4f6ca3c0e3001b4a3936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.646281 14019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8267536f1bb4b159dc87ac7afca5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.646895 14022 tablet_service.cc:1511] Processing CreateTablet for tablet a7467482380a426188c5b2ac43d54310 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260501 14:01:46.647663 14021 tablet_service.cc:1511] Processing CreateTablet for tablet a14016a1d4de44178b73674dbf82b9c4 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260501 14:01:46.648234 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7467482380a426188c5b2ac43d54310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.649078 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14016a1d4de44178b73674dbf82b9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.650560 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:46.653183 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91939f293a4c53b18c1c18f4449f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.652918 14024 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfb57bc54a04297a88d40804890af15 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260501 14:01:46.654345 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfb57bc54a04297a88d40804890af15. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:46.655277 13925 leader_election.cc:343] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:46.652956 14017 tablet_service.cc:1511] Processing CreateTablet for tablet 0265e96f503c4b65adaa438fe44216d7 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260501 14:01:46.657240 14017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0265e96f503c4b65adaa438fe44216d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.655871 13925 leader_election.cc:304] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:46.660852 14239 raft_consensus.cc:2749] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:46.672591 14235 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:46.673350 14235 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:46.673853 14235 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.642553 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14016a1d4de44178b73674dbf82b9c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:46.686633 13845 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 74771.3us
I20260501 14:01:46.683470 14231 raft_consensus.cc:359] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:46.713447 14231 raft_consensus.cc:385] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.713801 14231 raft_consensus.cc:740] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.724814 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:46.740000 14235 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:46.772369 14231 consensus_queue.cc:260] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:46.778753 14231 ts_tablet_manager.cc:1434] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.181s	user 0.008s	sys 0.002s
W20260501 14:01:46.781195 14001 leader_election.cc:343] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:46.783530 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:46.784608 14183 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:46.797333 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7467482380a426188c5b2ac43d54310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.799348 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 7b188afe7907439098cfaf8f874665bc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260501 14:01:46.800360 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c97fd620b464e0c91cdcd6df3e535ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.801306 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b188afe7907439098cfaf8f874665bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.804337 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91939f293a4c53b18c1c18f4449f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.811336 13944 tablet_service.cc:1511] Processing CreateTablet for tablet 7b188afe7907439098cfaf8f874665bc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260501 14:01:46.813110 13844 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 167111us
I20260501 14:01:46.813400 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b188afe7907439098cfaf8f874665bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.821540 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfb57bc54a04297a88d40804890af15 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260501 14:01:46.823105 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfb57bc54a04297a88d40804890af15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.824076 14228 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:46.824913 14228 ts_tablet_manager.cc:1403] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.488s	user 0.013s	sys 0.006s
I20260501 14:01:46.826077 14229 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:46.826664 14229 ts_tablet_manager.cc:1403] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.447s	user 0.056s	sys 0.085s
I20260501 14:01:46.828504 14228 raft_consensus.cc:359] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.829347 14228 raft_consensus.cc:385] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.829653 14228 raft_consensus.cc:740] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.830171 14229 raft_consensus.cc:359] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.830950 14229 raft_consensus.cc:385] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:46.831248 14229 raft_consensus.cc:740] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:46.836237 14228 consensus_queue.cc:260] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.852195 14229 consensus_queue.cc:260] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:46.881804 14229 ts_tablet_manager.cc:1434] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260501 14:01:46.882988 14229 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:46.882828 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:46.883651 14035 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:46.885129 14228 ts_tablet_manager.cc:1434] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260501 14:01:46.886325 14228 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:46.889209 14091 tablet_service.cc:1511] Processing CreateTablet for tablet 2156db7c0cd944eda5eebd2ee3275d8e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260501 14:01:46.890766 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156db7c0cd944eda5eebd2ee3275d8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:46.899515 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:46.900013 14231 tablet_bootstrap.cc:492] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:46.902022 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 2156db7c0cd944eda5eebd2ee3275d8e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260501 14:01:46.903443 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156db7c0cd944eda5eebd2ee3275d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.912287 14148 leader_election.cc:304] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:46.913475 14240 raft_consensus.cc:2804] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:46.913879 14240 raft_consensus.cc:493] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:46.914206 14240 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:46.921001 14023 tablet_service.cc:1511] Processing CreateTablet for tablet 7b188afe7907439098cfaf8f874665bc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260501 14:01:46.922574 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b188afe7907439098cfaf8f874665bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.923339 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:46.933121 14021 tablet_service.cc:1511] Processing CreateTablet for tablet d26c529b25f04145b69a8055b71ce4b9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260501 14:01:46.934702 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26c529b25f04145b69a8055b71ce4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.936316 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:46.937968 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
W20260501 14:01:46.940308 14000 leader_election.cc:343] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:46.940896 14000 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:46.941841 14234 raft_consensus.cc:2749] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:46.940323 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:46.954411 13946 tablet_service.cc:1511] Processing CreateTablet for tablet 2156db7c0cd944eda5eebd2ee3275d8e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260501 14:01:46.955862 14227 ts_tablet_manager.cc:1434] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.605s	user 0.034s	sys 0.059s
W20260501 14:01:46.956326 14227 ts_tablet_manager.cc:1467] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: Tablet startup took 605ms
W20260501 14:01:46.958806 14075 leader_election.cc:343] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:46.959656 14075 leader_election.cc:343] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:46.961056 14240 raft_consensus.cc:515] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:46.962818 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:46.964411 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:46.963526 14183 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:46.965086 14035 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:46.965132 14240 leader_election.cc:290] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:46.971189 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156db7c0cd944eda5eebd2ee3275d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.944288 14001 leader_election.cc:304] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
W20260501 14:01:46.972453 14000 leader_election.cc:343] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:46.972818 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 48318.1us
I20260501 14:01:46.977072 14229 tablet_bootstrap.cc:654] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:46.985965 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:46.987751 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
W20260501 14:01:46.989367 14148 leader_election.cc:343] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:46.990465 14148 leader_election.cc:343] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:46.992908 14095 tablet_service.cc:1511] Processing CreateTablet for tablet d26c529b25f04145b69a8055b71ce4b9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260501 14:01:46.994464 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26c529b25f04145b69a8055b71ce4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:46.986085 14075 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:46.998793 14256 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:46.999259 14256 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:46.999617 14256 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.008337 14256 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.010488 14231 tablet_bootstrap.cc:654] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.012133 14035 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:47.012758 14234 raft_consensus.cc:2764] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260501 14:01:47.013355 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:47.013484 14148 leader_election.cc:304] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:47.014468 14240 raft_consensus.cc:2804] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
W20260501 14:01:47.015020 14074 leader_election.cc:343] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.015566 14074 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:47.018357 14228 tablet_bootstrap.cc:654] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.018771 14251 raft_consensus.cc:2749] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:47.022781 14256 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:47.025667 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:47.026515 14183 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:46.956739 14227 ts_tablet_manager.cc:1469] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: Trace:
0501 14:01:45.770417 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:45.784702 (+ 14285us) service_pool.cc:224] Handling call
0501 14:01:45.787045 (+  2343us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0501 14:01:45.787162 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0501 14:01:45.857817 (+ 70655us) tablet_metadata.cc:665] Metadata flushed
0501 14:01:45.955659 (+ 97842us) tablet_replica.cc:206] Creating consensus instance
0501 14:01:45.956233 (+   574us) inbound_call.cc:177] Queueing success response
0501 14:01:46.225555 (+269322us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0501 14:01:46.351227 (+125672us) ts_tablet_manager.cc:1435] Starting tablet replica
0501 14:01:46.351886 (+   659us) tablet_replica.cc:261] Starting instrumentation
0501 14:01:46.352516 (+   630us) tablet_replica.cc:280] Starting consensus
0501 14:01:46.548685 (+196169us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400562a54. stack: 00007fb2f7611c83 00007fb2f7611b80 00007fb2f6f5f574 00007fb300c316b4 00007fb300c31649 00007fb2fa64a951 00007fb2fa6d850e 00007fb2fa6d706d 00007fb2fe0def9e 00007fb2ff70444a 00007fb2ff7183c1 00007fb2ff718369 00007fb2ff7182f9 00007fb2ff7182c1 00007fb2ff71759d 0000000000379254
Metrics: {"raft.queue_time_us":191810,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1897,"spinlock_wait_cycles":107637120,"tablet-open.queue_time_us":269419,"thread_start_us":329224,"threads_started":1}
I20260501 14:01:47.024109 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:47.030557 14168 tablet_service.cc:1511] Processing CreateTablet for tablet d26c529b25f04145b69a8055b71ce4b9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260501 14:01:47.036996 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26c529b25f04145b69a8055b71ce4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.037693 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 93952479e863465a8930469c1e593ae8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260501 14:01:47.040099 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93952479e863465a8930469c1e593ae8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:47.038779 14075 leader_election.cc:343] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.042943 14022 tablet_service.cc:1511] Processing CreateTablet for tablet 93952479e863465a8930469c1e593ae8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260501 14:01:47.044318 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93952479e863465a8930469c1e593ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.049342 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 93952479e863465a8930469c1e593ae8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260501 14:01:47.050963 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93952479e863465a8930469c1e593ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.059688 14183 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:47.061403 14227 tablet_bootstrap.cc:492] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:47.061235 14075 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:47.062402 14256 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:47.062909 14256 raft_consensus.cc:697] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:47.063874 14256 consensus_queue.cc:237] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.078718 14171 tablet_service.cc:1511] Processing CreateTablet for tablet f959d4d3d985474291a0b7bf62481690 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260501 14:01:47.080351 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f959d4d3d985474291a0b7bf62481690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.082491 14240 raft_consensus.cc:697] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:47.086680 14240 consensus_queue.cc:237] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.086591 13946 tablet_service.cc:1511] Processing CreateTablet for tablet f959d4d3d985474291a0b7bf62481690 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260501 14:01:47.088972 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f959d4d3d985474291a0b7bf62481690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.097621 14016 tablet_service.cc:1511] Processing CreateTablet for tablet f959d4d3d985474291a0b7bf62481690 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260501 14:01:47.098560 13858 catalog_manager.cc:5671] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:47.102867 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f959d4d3d985474291a0b7bf62481690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.103366 14234 raft_consensus.cc:493] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.103946 14234 raft_consensus.cc:515] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.105012 14229 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:47.105578 14229 ts_tablet_manager.cc:1403] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.223s	user 0.013s	sys 0.001s
I20260501 14:01:47.107131 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 20a6f8feaeaa4b79b89a164e7d98c53b (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260501 14:01:47.108843 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a6f8feaeaa4b79b89a164e7d98c53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.113283 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:47.123399 14001 leader_election.cc:343] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.126261 14231 tablet_bootstrap.cc:492] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:47.126938 14231 ts_tablet_manager.cc:1403] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.251s	user 0.004s	sys 0.016s
I20260501 14:01:47.127010 14229 raft_consensus.cc:359] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.128386 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:47.128907 14228 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:47.129443 14228 ts_tablet_manager.cc:1403] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.000s
W20260501 14:01:47.130373 14001 leader_election.cc:343] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.130887 14001 leader_election.cc:304] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:47.132011 14234 leader_election.cc:290] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:47.132946 14234 raft_consensus.cc:2749] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:47.136236 14229 raft_consensus.cc:385] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.138556 14229 raft_consensus.cc:740] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.139317 14229 consensus_queue.cc:260] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.141696 14228 raft_consensus.cc:359] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.142410 14231 raft_consensus.cc:359] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.143249 14231 raft_consensus.cc:385] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.143553 14231 raft_consensus.cc:740] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.144711 14231 consensus_queue.cc:260] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.147393 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 20a6f8feaeaa4b79b89a164e7d98c53b (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260501 14:01:47.148869 14229 ts_tablet_manager.cc:1434] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.003s
I20260501 14:01:47.149039 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a6f8feaeaa4b79b89a164e7d98c53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.150101 14229 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:47.142515 14228 raft_consensus.cc:385] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.152185 14228 raft_consensus.cc:740] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.155220 14231 ts_tablet_manager.cc:1434] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260501 14:01:47.157114 14228 consensus_queue.cc:260] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.168733 13947 tablet_service.cc:1511] Processing CreateTablet for tablet 20a6f8feaeaa4b79b89a164e7d98c53b (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260501 14:01:47.170215 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a6f8feaeaa4b79b89a164e7d98c53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.174113 14227 tablet_bootstrap.cc:654] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.175603 14228 ts_tablet_manager.cc:1434] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.001s
I20260501 14:01:47.176002 14231 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:47.186940 14023 tablet_service.cc:1511] Processing CreateTablet for tablet e8b961c5d58c420495fd18f163645f47 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260501 14:01:47.192723 14228 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:47.200592 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b961c5d58c420495fd18f163645f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.205296 14095 tablet_service.cc:1511] Processing CreateTablet for tablet e8b961c5d58c420495fd18f163645f47 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260501 14:01:47.206919 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b961c5d58c420495fd18f163645f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.214373 14229 tablet_bootstrap.cc:654] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.216434 14227 tablet_bootstrap.cc:492] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:47.217012 14227 ts_tablet_manager.cc:1403] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.000s
I20260501 14:01:47.217310 13856 catalog_manager.cc:5671] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:47.220783 14168 tablet_service.cc:1511] Processing CreateTablet for tablet e8b961c5d58c420495fd18f163645f47 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260501 14:01:47.222981 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b961c5d58c420495fd18f163645f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.225093 14016 tablet_service.cc:1511] Processing CreateTablet for tablet c851785bc2fd4764ab766fd38f7597dc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260501 14:01:47.224172 13948 tablet_service.cc:1511] Processing CreateTablet for tablet c851785bc2fd4764ab766fd38f7597dc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260501 14:01:47.229748 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c851785bc2fd4764ab766fd38f7597dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.232367 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c851785bc2fd4764ab766fd38f7597dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.240458 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 844973e68bc642b788a5ef4c699eca7e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260501 14:01:47.241307 13946 tablet_service.cc:1511] Processing CreateTablet for tablet 844973e68bc642b788a5ef4c699eca7e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260501 14:01:47.241904 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844973e68bc642b788a5ef4c699eca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.231765 14092 tablet_service.cc:1511] Processing CreateTablet for tablet c851785bc2fd4764ab766fd38f7597dc (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260501 14:01:47.245805 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844973e68bc642b788a5ef4c699eca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.253252 14021 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2e48efa4624f60b08bea18bc9413e1 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260501 14:01:47.254594 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2e48efa4624f60b08bea18bc9413e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.246613 14022 tablet_service.cc:1511] Processing CreateTablet for tablet 844973e68bc642b788a5ef4c699eca7e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260501 14:01:47.256806 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 844973e68bc642b788a5ef4c699eca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.248304 14091 tablet_service.cc:1511] Processing CreateTablet for tablet 39734d31bb3943c1a3477c1ced03bdb6 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260501 14:01:47.251181 13944 tablet_service.cc:1511] Processing CreateTablet for tablet 39734d31bb3943c1a3477c1ced03bdb6 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260501 14:01:47.262080 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39734d31bb3943c1a3477c1ced03bdb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.262244 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39734d31bb3943c1a3477c1ced03bdb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.265573 14239 raft_consensus.cc:493] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.266139 14239 raft_consensus.cc:515] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.251539 14167 tablet_service.cc:1511] Processing CreateTablet for tablet 39734d31bb3943c1a3477c1ced03bdb6 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260501 14:01:47.268714 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39734d31bb3943c1a3477c1ced03bdb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.268625 14239 leader_election.cc:290] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:47.268996 14231 tablet_bootstrap.cc:654] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.272019 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:47.273694 13926 leader_election.cc:343] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.276765 14228 tablet_bootstrap.cc:654] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.280529 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c851785bc2fd4764ab766fd38f7597dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.287683 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2e48efa4624f60b08bea18bc9413e1 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260501 14:01:47.289399 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2e48efa4624f60b08bea18bc9413e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.268627 14227 raft_consensus.cc:359] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.297567 14227 raft_consensus.cc:385] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.298022 14227 raft_consensus.cc:740] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.298974 14227 consensus_queue.cc:260] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.305881 13948 tablet_service.cc:1511] Processing CreateTablet for tablet be6afe227fa3478280adc659a49382f0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260501 14:01:47.307670 14024 tablet_service.cc:1511] Processing CreateTablet for tablet be6afe227fa3478280adc659a49382f0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260501 14:01:47.314257 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6afe227fa3478280adc659a49382f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.314318 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6afe227fa3478280adc659a49382f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.312037 14096 tablet_service.cc:1511] Processing CreateTablet for tablet be6afe227fa3478280adc659a49382f0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260501 14:01:47.316655 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6afe227fa3478280adc659a49382f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.321559 14229 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:47.322193 14229 ts_tablet_manager.cc:1403] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.172s	user 0.004s	sys 0.014s
I20260501 14:01:47.326129 14229 raft_consensus.cc:359] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.326845 14229 raft_consensus.cc:385] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.327152 14229 raft_consensus.cc:740] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.328472 14228 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:47.329064 14228 ts_tablet_manager.cc:1403] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.004s
I20260501 14:01:47.330550 14227 ts_tablet_manager.cc:1434] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260501 14:01:47.333953 14240 raft_consensus.cc:493] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.339399 14231 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:47.353207 14231 ts_tablet_manager.cc:1403] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.000s
I20260501 14:01:47.345118 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2e48efa4624f60b08bea18bc9413e1 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260501 14:01:47.352185 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:47.354482 14227 tablet_bootstrap.cc:492] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
W20260501 14:01:47.355757 13925 leader_election.cc:343] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.352982 14240 raft_consensus.cc:515] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.356542 13925 leader_election.cc:304] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:47.358435 14239 raft_consensus.cc:2749] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:47.359158 14240 leader_election.cc:290] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:47.359037 14231 raft_consensus.cc:359] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.359866 14231 raft_consensus.cc:385] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.360190 14231 raft_consensus.cc:740] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.360976 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:47.361152 14231 consensus_queue.cc:260] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
W20260501 14:01:47.363816 14148 leader_election.cc:343] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.364359 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2e48efa4624f60b08bea18bc9413e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.364996 14229 consensus_queue.cc:260] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.366344 14231 ts_tablet_manager.cc:1434] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260501 14:01:47.367535 14231 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:47.367548 14229 ts_tablet_manager.cc:1434] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260501 14:01:47.377058 14229 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:47.378494 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:47.385344 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 398bfbe172bd426db8d5dfc783abed5d (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260501 14:01:47.386802 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398bfbe172bd426db8d5dfc783abed5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:47.386893 14149 leader_election.cc:343] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.387442 14149 leader_election.cc:304] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:47.390110 13944 tablet_service.cc:1511] Processing CreateTablet for tablet f7736f72df4e4056b6e8306bb195e5d8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260501 14:01:47.392086 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7736f72df4e4056b6e8306bb195e5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.390937 14240 raft_consensus.cc:2749] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:47.396404 14021 tablet_service.cc:1511] Processing CreateTablet for tablet f7736f72df4e4056b6e8306bb195e5d8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260501 14:01:47.379881 14167 tablet_service.cc:1511] Processing CreateTablet for tablet f7736f72df4e4056b6e8306bb195e5d8 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260501 14:01:47.404424 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7736f72df4e4056b6e8306bb195e5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.412165 14227 tablet_bootstrap.cc:654] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.402627 14091 tablet_service.cc:1511] Processing CreateTablet for tablet 398bfbe172bd426db8d5dfc783abed5d (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260501 14:01:47.404951 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7736f72df4e4056b6e8306bb195e5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.395534 14228 raft_consensus.cc:359] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.416033 14228 raft_consensus.cc:385] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.416415 14228 raft_consensus.cc:740] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.417212 14228 consensus_queue.cc:260] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.414206 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398bfbe172bd426db8d5dfc783abed5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.424767 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 398bfbe172bd426db8d5dfc783abed5d (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260501 14:01:47.429026 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398bfbe172bd426db8d5dfc783abed5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.436573 14228 ts_tablet_manager.cc:1434] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.000s
I20260501 14:01:47.437790 14228 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:47.441184 14024 tablet_service.cc:1511] Processing CreateTablet for tablet f14ddad993d446dd92f27c20aace1a34 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260501 14:01:47.442610 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14ddad993d446dd92f27c20aace1a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.447335 14231 tablet_bootstrap.cc:654] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.452057 14227 tablet_bootstrap.cc:492] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:47.452612 14227 ts_tablet_manager.cc:1403] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.003s
I20260501 14:01:47.452090 14228 tablet_bootstrap.cc:654] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.455351 14227 raft_consensus.cc:359] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.463297 14227 raft_consensus.cc:385] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.463907 14227 raft_consensus.cc:740] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.464756 14227 consensus_queue.cc:260] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.466166 14099 tablet_service.cc:1511] Processing CreateTablet for tablet f14ddad993d446dd92f27c20aace1a34 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260501 14:01:47.467236 14172 tablet_service.cc:1511] Processing CreateTablet for tablet f14ddad993d446dd92f27c20aace1a34 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260501 14:01:47.467633 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14ddad993d446dd92f27c20aace1a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.468586 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14ddad993d446dd92f27c20aace1a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.471246 14022 tablet_service.cc:1511] Processing CreateTablet for tablet 071fccc276bd4528803ab25b4d2dd3a7 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260501 14:01:47.474124 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 071fccc276bd4528803ab25b4d2dd3a7 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260501 14:01:47.475442 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071fccc276bd4528803ab25b4d2dd3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.460747 14229 tablet_bootstrap.cc:654] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.480500 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071fccc276bd4528803ab25b4d2dd3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.486409 13960 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.486358 13946 tablet_service.cc:1511] Processing CreateTablet for tablet 42855c0411ec46b3bf4bd4be757430c4 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260501 14:01:47.487308 14016 tablet_service.cc:1511] Processing CreateTablet for tablet 42855c0411ec46b3bf4bd4be757430c4 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260501 14:01:47.487980 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42855c0411ec46b3bf4bd4be757430c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.490427 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 071fccc276bd4528803ab25b4d2dd3a7 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260501 14:01:47.483976 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 42855c0411ec46b3bf4bd4be757430c4 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260501 14:01:47.491878 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071fccc276bd4528803ab25b4d2dd3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.492378 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42855c0411ec46b3bf4bd4be757430c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.492249 14096 tablet_service.cc:1511] Processing CreateTablet for tablet dba1e3df02974207a6e359613777bc2a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260501 14:01:47.493523 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba1e3df02974207a6e359613777bc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.504230 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42855c0411ec46b3bf4bd4be757430c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.517748 14171 tablet_service.cc:1511] Processing CreateTablet for tablet dba1e3df02974207a6e359613777bc2a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260501 14:01:47.519275 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba1e3df02974207a6e359613777bc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.521553 14231 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:47.522187 14231 ts_tablet_manager.cc:1403] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.000s
I20260501 14:01:47.528299 14231 raft_consensus.cc:359] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.529089 14231 raft_consensus.cc:385] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.529385 14231 raft_consensus.cc:740] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.530164 14231 consensus_queue.cc:260] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.532902 14108 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.538214 14231 ts_tablet_manager.cc:1434] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260501 14:01:47.533067 14227 ts_tablet_manager.cc:1434] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.003s
I20260501 14:01:47.541608 14239 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.541972 14227 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:47.542145 14239 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.544855 14239 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:47.545497 14267 raft_consensus.cc:493] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.546170 14267 raft_consensus.cc:515] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.546553 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:47.547237 14183 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:47.548275 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:47.549188 14267 leader_election.cc:290] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:47.549360 14256 consensus_queue.cc:1048] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:47.553264 13926 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:47.554092 14023 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce6c201d860417d91baa78d28d6a3a3 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260501 14:01:47.554782 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
W20260501 14:01:47.559748 14000 leader_election.cc:343] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.561034 14231 tablet_bootstrap.cc:492] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:47.560686 13944 tablet_service.cc:1511] Processing CreateTablet for tablet dba1e3df02974207a6e359613777bc2a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260501 14:01:47.562178 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba1e3df02974207a6e359613777bc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.564173 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce6c201d860417d91baa78d28d6a3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.564108 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:47.557713 14239 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:01:47.565505 14239 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260501 14:01:47.565696 14001 leader_election.cc:343] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.565896 14239 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:47.566246 14001 leader_election.cc:304] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:47.567448 14267 raft_consensus.cc:2749] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:47.572456 14240 consensus_queue.cc:1048] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 14:01:47.577277 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce6c201d860417d91baa78d28d6a3a3 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260501 14:01:47.581921 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce6c201d860417d91baa78d28d6a3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.584103 14231 tablet_bootstrap.cc:654] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.586546 14227 tablet_bootstrap.cc:654] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.599318 14281 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.604933 14024 tablet_service.cc:1511] Processing CreateTablet for tablet f5f77c3cf0c443cf8e717a27fc040aab (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260501 14:01:47.606211 13948 tablet_service.cc:1511] Processing CreateTablet for tablet f5f77c3cf0c443cf8e717a27fc040aab (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260501 14:01:47.609541 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce6c201d860417d91baa78d28d6a3a3 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260501 14:01:47.613231 14229 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:47.615020 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 489891716d5d4794b3171c3b41c6b6f0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260501 14:01:47.621181 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f77c3cf0c443cf8e717a27fc040aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.624161 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489891716d5d4794b3171c3b41c6b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.625233 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f77c3cf0c443cf8e717a27fc040aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.626514 13947 tablet_service.cc:1511] Processing CreateTablet for tablet 489891716d5d4794b3171c3b41c6b6f0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260501 14:01:47.628023 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489891716d5d4794b3171c3b41c6b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.633996 14228 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:47.634586 14228 ts_tablet_manager.cc:1403] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.008s
I20260501 14:01:47.638067 14228 raft_consensus.cc:359] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.638803 14228 raft_consensus.cc:385] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.639240 14229 ts_tablet_manager.cc:1403] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.265s	user 0.014s	sys 0.002s
I20260501 14:01:47.639318 14228 raft_consensus.cc:740] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.647635 14091 tablet_service.cc:1511] Processing CreateTablet for tablet f5f77c3cf0c443cf8e717a27fc040aab (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260501 14:01:47.647197 14239 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.649184 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f77c3cf0c443cf8e717a27fc040aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.649019 13960 raft_consensus.cc:1240] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Rejecting Update request from peer e6f0deb8c1e1415693f8ab2ca413688d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260501 14:01:47.648928 14021 tablet_service.cc:1511] Processing CreateTablet for tablet 489891716d5d4794b3171c3b41c6b6f0 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260501 14:01:47.650408 14021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489891716d5d4794b3171c3b41c6b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.653766 14092 tablet_service.cc:1511] Processing CreateTablet for tablet f6e246a62848488dbc45a3794baac420 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260501 14:01:47.655118 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e246a62848488dbc45a3794baac420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.647174 14228 consensus_queue.cc:260] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.658880 14256 consensus_queue.cc:1059] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:47.661571 14167 tablet_service.cc:1511] Processing CreateTablet for tablet f6e246a62848488dbc45a3794baac420 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260501 14:01:47.639854 14281 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.672106 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce6c201d860417d91baa78d28d6a3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.671657 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:47.693773 14183 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:47.695214 14016 tablet_service.cc:1511] Processing CreateTablet for tablet 67f9563f8238491491dcfbf6b39bf91a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260501 14:01:47.696798 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f9563f8238491491dcfbf6b39bf91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.697028 13946 tablet_service.cc:1511] Processing CreateTablet for tablet f6e246a62848488dbc45a3794baac420 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260501 14:01:47.698366 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e246a62848488dbc45a3794baac420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.686807 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e246a62848488dbc45a3794baac420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.687177 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
W20260501 14:01:47.707834 13925 leader_election.cc:343] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.684386 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:47.709331 14035 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:47.709579 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 67f9563f8238491491dcfbf6b39bf91a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260501 14:01:47.709743 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 67f9563f8238491491dcfbf6b39bf91a (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260501 14:01:47.711423 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f9563f8238491491dcfbf6b39bf91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.681913 14281 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:47.682327 14229 raft_consensus.cc:359] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.717276 13925 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:47.717844 14229 raft_consensus.cc:385] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.718230 14229 raft_consensus.cc:740] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.719074 14285 raft_consensus.cc:2804] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:47.719530 14285 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:47.719890 14285 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.722167 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f9563f8238491491dcfbf6b39bf91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.680058 14240 raft_consensus.cc:493] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.742642 14267 raft_consensus.cc:493] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.744446 14267 raft_consensus.cc:515] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.746666 14267 leader_election.cc:290] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:47.747149 14024 tablet_service.cc:1511] Processing CreateTablet for tablet 33ebd762ee5d435fa14f8a227d9b05f9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260501 14:01:47.748627 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ebd762ee5d435fa14f8a227d9b05f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.748806 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:47.749523 13960 raft_consensus.cc:2468] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:47.757007 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 33ebd762ee5d435fa14f8a227d9b05f9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260501 14:01:47.758419 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ebd762ee5d435fa14f8a227d9b05f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.759120 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:47.760772 14001 leader_election.cc:343] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.761494 14001 leader_election.cc:304] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:47.765038 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:47.737681 14239 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:47.740882 14240 raft_consensus.cc:515] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.781515 14227 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:47.782179 14227 ts_tablet_manager.cc:1403] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.000s
I20260501 14:01:47.782279 14231 tablet_bootstrap.cc:492] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:47.782853 14231 ts_tablet_manager.cc:1403] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.222s	user 0.014s	sys 0.015s
I20260501 14:01:47.786080 14227 raft_consensus.cc:359] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.786188 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 33ebd762ee5d435fa14f8a227d9b05f9 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260501 14:01:47.786300 14231 raft_consensus.cc:359] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.786913 14227 raft_consensus.cc:385] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.787231 14231 raft_consensus.cc:385] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:47.787317 14227 raft_consensus.cc:740] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.771214 14267 raft_consensus.cc:2804] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:47.789901 14267 raft_consensus.cc:493] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:47.790283 14267 raft_consensus.cc:3060] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.787652 14231 raft_consensus.cc:740] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:47.791335 14231 consensus_queue.cc:260] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.771857 14256 raft_consensus.cc:3055] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Stepping down as leader of term 1
W20260501 14:01:47.789297 14075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 94536.4us
I20260501 14:01:47.795892 14288 consensus_queue.cc:1048] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:47.788959 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ebd762ee5d435fa14f8a227d9b05f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.794598 14256 raft_consensus.cc:740] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:47.797837 14256 consensus_queue.cc:260] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.798643 14183 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:01:47.800010 13926 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:47.801251 14281 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:01:47.794729 14239 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.804853 14239 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.781481 14240 leader_election.cc:290] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:47.813364 14228 ts_tablet_manager.cc:1434] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.178s	user 0.011s	sys 0.003s
I20260501 14:01:47.814733 14228 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:47.814406 14172 tablet_service.cc:1511] Processing CreateTablet for tablet c3834cf44f254585909e19f7b9cccaba (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260501 14:01:47.813122 14240 consensus_queue.cc:1048] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:47.815917 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3834cf44f254585909e19f7b9cccaba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.740512 14229 consensus_queue.cc:260] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.818420 14229 ts_tablet_manager.cc:1434] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.173s	user 0.005s	sys 0.004s
I20260501 14:01:47.833150 14256 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:47.836896 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:47.819653 14229 tablet_bootstrap.cc:492] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:47.846382 14281 raft_consensus.cc:697] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:47.855343 14016 tablet_service.cc:1511] Processing CreateTablet for tablet c3834cf44f254585909e19f7b9cccaba (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260501 14:01:47.848233 13960 raft_consensus.cc:2468] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:47.856853 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3834cf44f254585909e19f7b9cccaba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.859086 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 36fbdffa2ccc49c9be276b75784b7fc1 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260501 14:01:47.859570 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:47.860489 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fbdffa2ccc49c9be276b75784b7fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.861742 14267 raft_consensus.cc:515] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.862918 14022 tablet_service.cc:1511] Processing CreateTablet for tablet f74b3f2390f84435b1288ad258be8b49 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260501 14:01:47.841142 14227 consensus_queue.cc:260] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.864238 14022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74b3f2390f84435b1288ad258be8b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.863950 14091 tablet_service.cc:1511] Processing CreateTablet for tablet f74b3f2390f84435b1288ad258be8b49 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260501 14:01:47.866922 14267 leader_election.cc:290] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:47.873904 13947 tablet_service.cc:1511] Processing CreateTablet for tablet 36fbdffa2ccc49c9be276b75784b7fc1 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260501 14:01:47.875356 13947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fbdffa2ccc49c9be276b75784b7fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.880157 14239 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:47.864998 14285 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:47.884833 14285 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:47.885607 13944 tablet_service.cc:1511] Processing CreateTablet for tablet c3834cf44f254585909e19f7b9cccaba (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260501 14:01:47.887542 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74b3f2390f84435b1288ad258be8b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.888419 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3834cf44f254585909e19f7b9cccaba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.889755 14149 leader_election.cc:304] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
W20260501 14:01:47.890240 13925 leader_election.cc:343] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.904536 14286 raft_consensus.cc:493] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.890110 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:47.905284 14286 raft_consensus.cc:515] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.906167 13960 raft_consensus.cc:3060] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.908777 14286 leader_election.cc:290] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:47.896802 14228 tablet_bootstrap.cc:654] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.909546 14227 ts_tablet_manager.cc:1434] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.001s
I20260501 14:01:47.910951 14227 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:47.913478 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:47.913919 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:47.914556 14108 raft_consensus.cc:2468] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:47.847600 14281 consensus_queue.cc:237] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:47.915578 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:47.916294 14109 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.915227 14167 tablet_service.cc:1511] Processing CreateTablet for tablet 36fbdffa2ccc49c9be276b75784b7fc1 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260501 14:01:47.917794 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fbdffa2ccc49c9be276b75784b7fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:47.920215 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:47.920847 14035 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.921981 14287 raft_consensus.cc:493] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.922462 14287 raft_consensus.cc:515] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:47.904398 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260501 14:01:47.925107 14001 leader_election.cc:343] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:47.926446 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a3f16449384bc982d2662b9bbcaeba" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:47.927093 14034 raft_consensus.cc:2468] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:47.928246 13925 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:47.930143 14074 leader_election.cc:304] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:01:47.931078 14286 raft_consensus.cc:2804] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:47.931428 14286 raft_consensus.cc:493] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:47.931737 14286 raft_consensus.cc:3060] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.942166 14285 raft_consensus.cc:2804] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:47.946627 14285 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:47.947013 14285 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.948355 14267 raft_consensus.cc:493] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:47.948920 14267 raft_consensus.cc:515] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:47.956627 14287 leader_election.cc:290] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:47.957333 14287 raft_consensus.cc:2804] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:47.957696 14287 raft_consensus.cc:493] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:47.958024 14287 raft_consensus.cc:3060] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:47.960368 14286 raft_consensus.cc:515] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:47.962678 14229 tablet_bootstrap.cc:654] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:47.964308 13960 raft_consensus.cc:2468] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:47.966024 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:47.977365 14035 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:47.978283 14267 leader_election.cc:290] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:47.980237 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:47.982146 14109 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:47.999869 14227 tablet_bootstrap.cc:654] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:47.988660 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 220389us
I20260501 14:01:47.999498 14183 raft_consensus.cc:2468] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:48.020401 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:48.021605 14231 ts_tablet_manager.cc:1434] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.238s	user 0.026s	sys 0.022s
I20260501 14:01:48.022927 14231 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:48.028136 13925 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:48.029258 14239 raft_consensus.cc:2804] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.029055 14167 tablet_service.cc:1511] Processing CreateTablet for tablet f74b3f2390f84435b1288ad258be8b49 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260501 14:01:48.029879 14239 raft_consensus.cc:697] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:48.030578 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74b3f2390f84435b1288ad258be8b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.030849 14239 consensus_queue.cc:237] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.032318 14286 leader_election.cc:290] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:48.033389 14023 tablet_service.cc:1511] Processing CreateTablet for tablet 154bd4746b484c05b7f01be4f586a706 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260501 14:01:48.034832 14023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154bd4746b484c05b7f01be4f586a706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.035583 13948 tablet_service.cc:1511] Processing CreateTablet for tablet 3a371931392243bc9beed91b6eb227db (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260501 14:01:48.035969 13946 tablet_service.cc:1511] Processing CreateTablet for tablet 154bd4746b484c05b7f01be4f586a706 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260501 14:01:48.037026 13948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a371931392243bc9beed91b6eb227db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.037547 14092 tablet_service.cc:1511] Processing CreateTablet for tablet 00d1903b4ee9466a83fa31497f59744e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260501 14:01:48.038790 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d1903b4ee9466a83fa31497f59744e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.039804 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a3f16449384bc982d2662b9bbcaeba" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:48.040467 14148 leader_election.cc:343] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.041026 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 00d1903b4ee9466a83fa31497f59744e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260501 14:01:48.041428 14075 leader_election.cc:343] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.041960 13949 tablet_service.cc:1511] Processing CreateTablet for tablet 00d1903b4ee9466a83fa31497f59744e (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260501 14:01:48.042383 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d1903b4ee9466a83fa31497f59744e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.043309 13949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d1903b4ee9466a83fa31497f59744e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.044768 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 154bd4746b484c05b7f01be4f586a706 (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260501 14:01:48.045325 14183 raft_consensus.cc:1240] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Rejecting Update request from peer e6f0deb8c1e1415693f8ab2ca413688d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260501 14:01:48.046303 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a3f16449384bc982d2662b9bbcaeba" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:48.047241 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154bd4746b484c05b7f01be4f586a706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.048491 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 3a371931392243bc9beed91b6eb227db (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260501 14:01:48.049973 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a371931392243bc9beed91b6eb227db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.056313 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:48.016079 14001 leader_election.cc:304] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:48.060171 14035 raft_consensus.cc:2468] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:48.061906 14285 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:48.063625 14075 leader_election.cc:343] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.059178 14016 tablet_service.cc:1511] Processing CreateTablet for tablet 3a371931392243bc9beed91b6eb227db (DEFAULT_TABLE table=test-workload [id=2bf2c6962ad9427e8605c6fd8e86d275]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260501 14:01:48.073158 14016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a371931392243bc9beed91b6eb227db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:01:48.078495 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 67233us
I20260501 14:01:48.078648 14148 leader_election.cc:304] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:48.080051 14289 raft_consensus.cc:2804] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.080274 14001 leader_election.cc:304] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:48.080467 14289 raft_consensus.cc:493] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.080928 14289 raft_consensus.cc:3060] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.081521 14267 raft_consensus.cc:2804] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.084231 13946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154bd4746b484c05b7f01be4f586a706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:01:48.061906 14287 raft_consensus.cc:515] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
W20260501 14:01:48.106623 14001 leader_election.cc:343] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.114141 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a3f16449384bc982d2662b9bbcaeba" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:48.139802 14285 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
W20260501 14:01:48.141511 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 48651.3us
I20260501 14:01:48.147171 14231 tablet_bootstrap.cc:654] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.148428 14293 raft_consensus.cc:2804] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.149068 14293 raft_consensus.cc:493] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.149513 14293 raft_consensus.cc:3060] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.132022 14035 raft_consensus.cc:3060] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.157004 14287 leader_election.cc:290] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:01:48.131276 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 263129us
I20260501 14:01:48.168982 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:48.169884 14108 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.171717 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
W20260501 14:01:48.173306 14148 leader_election.cc:343] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.174149 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
W20260501 14:01:48.175866 13925 leader_election.cc:343] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:48.208097 13844 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 60671.1us
I20260501 14:01:48.218566 14293 raft_consensus.cc:515] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.220422 14229 tablet_bootstrap.cc:492] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:48.221024 14229 ts_tablet_manager.cc:1403] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.402s	user 0.014s	sys 0.008s
I20260501 14:01:48.221487 14293 leader_election.cc:290] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:48.222342 14035 raft_consensus.cc:2468] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:48.223553 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:48.224267 14181 raft_consensus.cc:3060] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.166353 13855 catalog_manager.cc:5671] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:48.225873 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:48.227784 14227 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
W20260501 14:01:48.228132 14001 leader_election.cc:343] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.228406 14227 ts_tablet_manager.cc:1403] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.318s	user 0.014s	sys 0.008s
I20260501 14:01:48.229068 14074 leader_election.cc:304] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:48.230592 14286 raft_consensus.cc:2804] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.230669 14289 raft_consensus.cc:515] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.231228 14286 raft_consensus.cc:697] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:48.232501 14286 consensus_queue.cc:237] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.209684 14267 raft_consensus.cc:697] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:48.237396 14228 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:48.237198 14267 consensus_queue.cc:237] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.238059 14228 ts_tablet_manager.cc:1403] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.424s	user 0.014s	sys 0.014s
I20260501 14:01:48.241434 14229 raft_consensus.cc:359] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.242008 14289 leader_election.cc:290] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:48.242367 14229 raft_consensus.cc:385] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.243289 14229 raft_consensus.cc:740] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.244123 14229 consensus_queue.cc:260] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.246543 14229 ts_tablet_manager.cc:1434] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260501 14:01:48.247321 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:48.247448 14227 raft_consensus.cc:359] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.261895 14227 raft_consensus.cc:385] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.262508 14227 raft_consensus.cc:740] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.247699 14229 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:48.262045 14181 raft_consensus.cc:2468] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:48.260784 14035 raft_consensus.cc:3060] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.276211 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.277789 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:48.278514 13960 raft_consensus.cc:3060] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.280388 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:48.276213 14228 raft_consensus.cc:359] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.284246 14228 raft_consensus.cc:385] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.284579 14228 raft_consensus.cc:740] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
W20260501 14:01:48.284605 14149 leader_election.cc:343] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:48.286010 14149 leader_election.cc:343] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.285821 14228 consensus_queue.cc:260] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.288863 14231 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:48.289503 14231 ts_tablet_manager.cc:1403] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.267s	user 0.018s	sys 0.020s
I20260501 14:01:48.292541 13858 catalog_manager.cc:5671] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.296007 14001 leader_election.cc:304] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.263748 14227 consensus_queue.cc:260] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.290537 14108 raft_consensus.cc:2468] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:48.306352 14231 raft_consensus.cc:359] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.312381 13925 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:48.307890 14228 ts_tablet_manager.cc:1434] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.003s
I20260501 14:01:48.314476 14228 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:48.314493 14285 raft_consensus.cc:2804] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.313002 14231 raft_consensus.cc:385] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.310067 14267 raft_consensus.cc:2804] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.320940 14231 raft_consensus.cc:740] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.320608 14285 raft_consensus.cc:697] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:48.312004 14227 ts_tablet_manager.cc:1434] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260501 14:01:48.324399 14285 consensus_queue.cc:237] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.327962 14267 raft_consensus.cc:697] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:48.329054 14108 raft_consensus.cc:1275] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260501 14:01:48.329543 14108 pending_rounds.cc:85] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Aborting all ops after (but not including) 0
I20260501 14:01:48.329926 14108 pending_rounds.cc:107] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260501 14:01:48.330265 14108 raft_consensus.cc:2889] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260501 14:01:48.332144 14239 consensus_queue.cc:1048] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:48.333287 13960 raft_consensus.cc:2468] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:48.339327 14149 leader_election.cc:304] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:48.340982 14289 raft_consensus.cc:2804] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.329082 14267 consensus_queue.cc:237] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.341652 14289 raft_consensus.cc:697] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:48.337049 14227 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:48.342917 14289 consensus_queue.cc:237] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.337123 14231 consensus_queue.cc:260] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.338330 14229 tablet_bootstrap.cc:654] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.368795 14035 raft_consensus.cc:2468] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:48.370710 14148 leader_election.cc:304] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.372377 14289 raft_consensus.cc:2804] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.373425 14289 raft_consensus.cc:697] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:48.374671 14289 consensus_queue.cc:237] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.377918 14231 ts_tablet_manager.cc:1434] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.002s
I20260501 14:01:48.378715 14228 tablet_bootstrap.cc:654] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.379181 14231 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:48.392302 14229 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:48.393061 14229 ts_tablet_manager.cc:1403] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.009s
I20260501 14:01:48.393415 13857 catalog_manager.cc:5671] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.398324 14229 raft_consensus.cc:359] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.399808 14229 raft_consensus.cc:385] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.400220 14229 raft_consensus.cc:740] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.401077 14229 consensus_queue.cc:260] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.403844 14229 ts_tablet_manager.cc:1434] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260501 14:01:48.405058 14227 tablet_bootstrap.cc:654] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.405105 14229 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:48.416680 14228 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:48.417459 14228 ts_tablet_manager.cc:1403] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.011s
I20260501 14:01:48.420812 14228 raft_consensus.cc:359] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.421602 14228 raft_consensus.cc:385] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.421905 14228 raft_consensus.cc:740] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.422955 14286 raft_consensus.cc:493] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.423539 14286 raft_consensus.cc:515] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.425849 14286 leader_election.cc:290] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:48.426410 14231 tablet_bootstrap.cc:654] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.427583 14229 tablet_bootstrap.cc:654] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.422639 14228 consensus_queue.cc:260] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.430289 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46ee8477ac4c76b73d11145f5948f9" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.431934 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46ee8477ac4c76b73d11145f5948f9" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
W20260501 14:01:48.434177 14074 leader_election.cc:343] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.427266 13856 catalog_manager.cc:5671] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.451527 13857 catalog_manager.cc:5671] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.444244 13960 raft_consensus.cc:2468] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:48.453841 13858 catalog_manager.cc:5671] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.462167 13858 catalog_manager.cc:5671] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.440094 14228 ts_tablet_manager.cc:1434] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260501 14:01:48.460836 14075 leader_election.cc:304] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:48.466902 14286 raft_consensus.cc:2804] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.467353 14286 raft_consensus.cc:493] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.467716 14286 raft_consensus.cc:3060] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.473543 14181 raft_consensus.cc:1275] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:01:48.475112 14228 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:48.475523 14285 consensus_queue.cc:1048] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:48.489462 14289 raft_consensus.cc:493] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.490132 14289 raft_consensus.cc:515] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.492316 14289 leader_election.cc:290] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:48.491916 13856 catalog_manager.cc:5671] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:48.497736 14228 tablet_bootstrap.cc:654] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.483280 14286 raft_consensus.cc:515] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.494537 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:48.495366 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
W20260501 14:01:48.500187 14148 leader_election.cc:343] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.500452 14035 raft_consensus.cc:2468] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:48.488055 14231 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:48.501410 14231 ts_tablet_manager.cc:1403] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.122s	user 0.030s	sys 0.012s
I20260501 14:01:48.506281 14148 leader_election.cc:304] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:48.506702 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46ee8477ac4c76b73d11145f5948f9" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:48.507571 14289 raft_consensus.cc:2804] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.507571 13960 raft_consensus.cc:3060] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.508040 14289 raft_consensus.cc:493] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.509687 14289 raft_consensus.cc:3060] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.512102 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46ee8477ac4c76b73d11145f5948f9" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
W20260501 14:01:48.514206 14074 leader_election.cc:343] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.500684 14286 leader_election.cc:290] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:48.520450 14227 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:48.522723 14289 raft_consensus.cc:515] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.526109 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:48.526796 14034 raft_consensus.cc:3060] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.527245 14227 ts_tablet_manager.cc:1403] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.024s
I20260501 14:01:48.530812 14227 raft_consensus.cc:359] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.531549 14227 raft_consensus.cc:385] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.526796 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:48.526106 14289 leader_election.cc:290] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:48.536828 14034 raft_consensus.cc:2468] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
W20260501 14:01:48.543852 14148 leader_election.cc:343] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.541426 13960 raft_consensus.cc:2468] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:48.546005 14231 raft_consensus.cc:359] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.546921 14231 raft_consensus.cc:385] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.547259 14231 raft_consensus.cc:740] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.546032 14229 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:48.548056 14231 consensus_queue.cc:260] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.548967 14229 ts_tablet_manager.cc:1403] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.144s	user 0.025s	sys 0.023s
I20260501 14:01:48.550725 14231 ts_tablet_manager.cc:1434] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260501 14:01:48.551882 14231 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:48.557067 14229 raft_consensus.cc:359] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.542240 14227 raft_consensus.cc:740] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.553555 14075 leader_election.cc:304] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:48.565389 14286 raft_consensus.cc:2804] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.564736 14229 raft_consensus.cc:385] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.565932 14286 raft_consensus.cc:697] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:48.565971 14229 raft_consensus.cc:740] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.566924 14286 consensus_queue.cc:237] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.567066 14229 consensus_queue.cc:260] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.569500 14229 ts_tablet_manager.cc:1434] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260501 14:01:48.570926 14229 tablet_bootstrap.cc:492] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:48.560861 14228 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:48.552681 14148 leader_election.cc:304] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:48.576439 14289 raft_consensus.cc:2804] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.576997 14289 raft_consensus.cc:697] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:48.577870 14289 consensus_queue.cc:237] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.581097 14228 ts_tablet_manager.cc:1403] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.021s
I20260501 14:01:48.582722 14229 tablet_bootstrap.cc:654] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.584616 14228 raft_consensus.cc:359] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.585798 14228 raft_consensus.cc:385] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.587185 14228 raft_consensus.cc:740] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.588025 14228 consensus_queue.cc:260] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.590385 14228 ts_tablet_manager.cc:1434] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260501 14:01:48.593885 13856 catalog_manager.cc:5671] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:48.586367 14227 consensus_queue.cc:260] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.590569 13857 catalog_manager.cc:5671] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:48.597442 14227 ts_tablet_manager.cc:1434] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260501 14:01:48.598691 14227 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:48.600653 14239 raft_consensus.cc:493] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.599470 14228 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:48.601248 14239 raft_consensus.cc:515] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.607512 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:48.594441 14231 tablet_bootstrap.cc:654] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.612618 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1cbf2b2ed64fd19070d2c318260e59" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:48.613531 14181 raft_consensus.cc:2393] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:48.614712 14289 raft_consensus.cc:493] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.615254 14289 raft_consensus.cc:515] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.615792 14228 tablet_bootstrap.cc:654] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.617494 14289 leader_election.cc:290] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:48.619230 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:48.620296 14227 tablet_bootstrap.cc:654] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.623068 14267 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.623616 14267 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.623914 13926 leader_election.cc:304] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:48.624886 14281 raft_consensus.cc:3060] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.628031 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.629601 14267 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:48.623624 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.632747 13960 raft_consensus.cc:2393] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:48.632634 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:48.632951 14239 leader_election.cc:290] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:48.633520 14108 raft_consensus.cc:2393] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:48.634548 14149 leader_election.cc:304] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.634773 14000 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.637120 14289 raft_consensus.cc:3060] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.637280 14267 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.638904 14302 raft_consensus.cc:493] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.639556 14302 raft_consensus.cc:515] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.642366 14302 leader_election.cc:290] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:48.637086 14281 raft_consensus.cc:2749] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:48.645577 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923244304708a082b89059b70764" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.646237 14229 tablet_bootstrap.cc:492] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:48.646804 14229 ts_tablet_manager.cc:1403] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.009s
I20260501 14:01:48.646661 13960 raft_consensus.cc:2468] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:48.648510 14001 leader_election.cc:304] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:48.650672 14229 raft_consensus.cc:359] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.650997 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923244304708a082b89059b70764" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:48.651444 14229 raft_consensus.cc:385] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.651769 14229 raft_consensus.cc:740] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.652475 14229 consensus_queue.cc:260] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.654480 14302 raft_consensus.cc:2804] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.658195 14302 raft_consensus.cc:493] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.655846 14229 ts_tablet_manager.cc:1434] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260501 14:01:48.656718 14000 leader_election.cc:343] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.662326 14228 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:48.664103 14302 raft_consensus.cc:3060] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.664991 14289 raft_consensus.cc:2749] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:48.665397 14229 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:48.654597 14281 consensus_queue.cc:1048] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.668253 14239 consensus_queue.cc:1048] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:48.671981 14227 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:48.672555 14227 ts_tablet_manager.cc:1403] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.010s
I20260501 14:01:48.672797 14267 raft_consensus.cc:2749] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:48.675462 14227 raft_consensus.cc:359] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.676280 14227 raft_consensus.cc:385] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.676537 14227 raft_consensus.cc:740] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.677217 14231 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:48.677755 14231 ts_tablet_manager.cc:1403] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.004s
I20260501 14:01:48.677932 14293 consensus_queue.cc:1048] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.677953 14227 consensus_queue.cc:260] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.681165 14227 ts_tablet_manager.cc:1434] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:01:48.682541 14227 tablet_bootstrap.cc:492] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:48.684927 14229 tablet_bootstrap.cc:654] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.687513 14293 consensus_queue.cc:1048] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.691116 14227 tablet_bootstrap.cc:654] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.696221 14231 raft_consensus.cc:359] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.697165 14231 raft_consensus.cc:385] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.699165 14228 ts_tablet_manager.cc:1403] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.015s
I20260501 14:01:48.699360 14231 raft_consensus.cc:740] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.700302 14231 consensus_queue.cc:260] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.702807 14231 ts_tablet_manager.cc:1434] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260501 14:01:48.704432 14231 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:48.711170 14302 raft_consensus.cc:515] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.711197 14231 tablet_bootstrap.cc:654] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.718871 14227 tablet_bootstrap.cc:492] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:48.719462 14227 ts_tablet_manager.cc:1403] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260501 14:01:48.718740 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923244304708a082b89059b70764" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:48.720019 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923244304708a082b89059b70764" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:48.720172 13958 raft_consensus.cc:3060] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.702535 14228 raft_consensus.cc:359] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.722481 14228 raft_consensus.cc:385] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260501 14:01:48.722437 14000 leader_election.cc:343] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.722942 14228 raft_consensus.cc:740] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.719117 14302 leader_election.cc:290] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:48.723898 14228 consensus_queue.cc:260] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.725569 14227 raft_consensus.cc:359] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.726527 14227 raft_consensus.cc:385] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.726997 14227 raft_consensus.cc:740] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.727782 14228 ts_tablet_manager.cc:1434] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260501 14:01:48.728736 14228 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:48.731873 14227 consensus_queue.cc:260] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.740661 14227 ts_tablet_manager.cc:1434] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260501 14:01:48.742719 14227 tablet_bootstrap.cc:492] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:48.747660 14228 tablet_bootstrap.cc:654] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.758896 14267 raft_consensus.cc:493] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.759541 14267 raft_consensus.cc:515] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.760821 14229 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:48.760824 14231 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:48.761523 14229 ts_tablet_manager.cc:1403] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.005s
I20260501 14:01:48.761722 14231 ts_tablet_manager.cc:1403] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.007s
I20260501 14:01:48.761914 14267 leader_election.cc:290] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:48.763234 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46ee8477ac4c76b73d11145f5948f9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:48.763674 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c46ee8477ac4c76b73d11145f5948f9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.764628 13959 raft_consensus.cc:2393] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:48.766004 14001 leader_election.cc:304] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.768016 14229 raft_consensus.cc:359] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.768784 14229 raft_consensus.cc:385] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.769061 14229 raft_consensus.cc:740] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.769893 14229 consensus_queue.cc:260] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.770135 14231 raft_consensus.cc:359] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.772244 14229 ts_tablet_manager.cc:1434] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260501 14:01:48.772466 14231 raft_consensus.cc:385] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.773277 14231 raft_consensus.cc:740] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.773788 14229 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:48.774648 14267 raft_consensus.cc:3060] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.774415 14231 consensus_queue.cc:260] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.775350 14181 raft_consensus.cc:3060] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.784363 13958 raft_consensus.cc:2468] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:48.785856 14001 leader_election.cc:304] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:48.791457 14338 raft_consensus.cc:2804] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:48.792044 14338 raft_consensus.cc:697] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:48.793016 14338 consensus_queue.cc:237] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:48.795120 14286 consensus_queue.cc:1048] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.796480 14227 tablet_bootstrap.cc:654] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.806303 14285 consensus_queue.cc:1048] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.810124 14229 tablet_bootstrap.cc:654] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.816406 14289 raft_consensus.cc:493] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.816824 14293 consensus_queue.cc:1048] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:48.817085 14289 raft_consensus.cc:515] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.824354 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759b9fe010354272a79f83b2a223aaa8" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.840637 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759b9fe010354272a79f83b2a223aaa8" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:48.841475 14107 raft_consensus.cc:2468] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:48.822074 14289 leader_election.cc:290] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:48.836977 14285 raft_consensus.cc:493] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.855079 14228 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:48.855713 14228 ts_tablet_manager.cc:1403] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.021s
I20260501 14:01:48.843895 14267 raft_consensus.cc:2749] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 14:01:48.843333 14149 leader_election.cc:343] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.861490 14148 leader_election.cc:304] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.862650 14290 raft_consensus.cc:2804] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.863137 14290 raft_consensus.cc:493] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.863516 14290 raft_consensus.cc:3060] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.851086 14285 raft_consensus.cc:515] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.866624 14228 raft_consensus.cc:359] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.867431 14228 raft_consensus.cc:385] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.867712 14228 raft_consensus.cc:740] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.868489 14228 consensus_queue.cc:260] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.868768 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:48.868932 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22408a26005c43e69c31f3ef8fbe401b" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:48.870889 14035 raft_consensus.cc:2393] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:48.872709 13925 leader_election.cc:304] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:48.874809 14290 raft_consensus.cc:515] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.858564 14227 tablet_bootstrap.cc:492] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:48.879150 14227 ts_tablet_manager.cc:1403] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.137s	user 0.024s	sys 0.006s
I20260501 14:01:48.882750 14231 ts_tablet_manager.cc:1434] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.121s	user 0.026s	sys 0.024s
I20260501 14:01:48.886035 14239 raft_consensus.cc:3060] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.868669 14285 leader_election.cc:290] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:48.893456 14231 tablet_bootstrap.cc:492] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:48.899839 14227 raft_consensus.cc:359] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.901111 14227 raft_consensus.cc:385] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.901697 14227 raft_consensus.cc:740] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.902730 14227 consensus_queue.cc:260] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:48.906222 14227 ts_tablet_manager.cc:1434] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260501 14:01:48.896147 14286 consensus_queue.cc:1048] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260501 14:01:48.907465 14227 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:48.909343 14239 raft_consensus.cc:2749] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:48.910248 14228 ts_tablet_manager.cc:1434] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260501 14:01:48.911427 14228 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:48.911151 14295 consensus_queue.cc:1048] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.918862 14227 tablet_bootstrap.cc:654] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.919888 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759b9fe010354272a79f83b2a223aaa8" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:48.920656 14107 raft_consensus.cc:3060] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.922125 14229 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:48.922772 14229 ts_tablet_manager.cc:1403] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.002s
I20260501 14:01:48.928951 14228 tablet_bootstrap.cc:654] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:48.930634 14339 consensus_queue.cc:1048] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:48.933423 14290 leader_election.cc:290] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:48.936447 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759b9fe010354272a79f83b2a223aaa8" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
W20260501 14:01:48.938095 14149 leader_election.cc:343] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:48.939947 14239 consensus_queue.cc:1048] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:48.946842 14229 raft_consensus.cc:359] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.947574 14229 raft_consensus.cc:385] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:48.948232 14290 consensus_queue.cc:1048] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:48.947901 14229 raft_consensus.cc:740] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:48.950248 14229 consensus_queue.cc:260] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.943502 13858 catalog_manager.cc:5671] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:48.956395 14295 raft_consensus.cc:493] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.962177 14295 raft_consensus.cc:515] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:48.964612 14295 leader_election.cc:290] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:48.969165 14107 raft_consensus.cc:2468] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:48.969368 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b6408b3eea487ea04c6bc19768a4fb" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:48.970161 14032 raft_consensus.cc:2468] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:48.971349 14148 leader_election.cc:304] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:48.972288 14290 raft_consensus.cc:2804] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:48.978876 14229 ts_tablet_manager.cc:1434] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260501 14:01:48.980638 14229 tablet_bootstrap.cc:492] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:48.972713 14290 raft_consensus.cc:493] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:48.983021 14290 raft_consensus.cc:3060] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.985193 14286 raft_consensus.cc:493] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:48.985786 14286 raft_consensus.cc:515] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:48.988101 14148 leader_election.cc:304] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:48.989588 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.992173 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b6408b3eea487ea04c6bc19768a4fb" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:48.992908 13960 raft_consensus.cc:2468] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:48.994174 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21abf15277ce40ea892dd216ab77ea2a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:48.990760 14286 leader_election.cc:290] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.003772 14231 tablet_bootstrap.cc:654] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:49.004578 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:49.011093 14229 tablet_bootstrap.cc:654] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.009769 14108 raft_consensus.cc:3060] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.013860 14107 raft_consensus.cc:3060] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:48.995266 14295 raft_consensus.cc:2804] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.014389 14075 leader_election.cc:304] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.027295 14289 consensus_queue.cc:1048] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.032406 14256 consensus_queue.cc:1048] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.020764 14295 raft_consensus.cc:697] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:49.052465 14228 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.053200 14228 ts_tablet_manager.cc:1403] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.002s
I20260501 14:01:49.061561 14229 tablet_bootstrap.cc:492] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.062404 14229 ts_tablet_manager.cc:1403] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.002s
I20260501 14:01:49.074150 14290 raft_consensus.cc:515] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.078395 14287 consensus_queue.cc:1048] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.082268 14229 raft_consensus.cc:359] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.083092 14229 raft_consensus.cc:385] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.083446 14229 raft_consensus.cc:740] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.084396 14229 consensus_queue.cc:260] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.096916 14229 ts_tablet_manager.cc:1434] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.034s	user 0.014s	sys 0.000s
I20260501 14:01:49.098003 14227 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.098603 14227 ts_tablet_manager.cc:1403] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.191s	user 0.010s	sys 0.018s
I20260501 14:01:49.098884 14229 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.100368 14256 consensus_queue.cc:1048] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.102000 14227 raft_consensus.cc:359] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.060971 14295 consensus_queue.cc:237] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.109021 14227 raft_consensus.cc:385] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.112215 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b6408b3eea487ea04c6bc19768a4fb" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:49.112939 13960 raft_consensus.cc:3060] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.110410 14227 raft_consensus.cc:740] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.115702 14227 consensus_queue.cc:260] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.116969 14229 tablet_bootstrap.cc:654] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.117877 14227 ts_tablet_manager.cc:1434] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260501 14:01:49.119103 14227 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.136567 14227 tablet_bootstrap.cc:654] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.141286 14231 tablet_bootstrap.cc:492] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:49.147047 14231 ts_tablet_manager.cc:1403] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.263s	user 0.021s	sys 0.001s
I20260501 14:01:49.151135 14290 leader_election.cc:290] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.184051 14357 raft_consensus.cc:493] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.184952 14357 raft_consensus.cc:515] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.153514 14286 raft_consensus.cc:2749] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.196621 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b6408b3eea487ea04c6bc19768a4fb" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:49.197671 14034 raft_consensus.cc:3060] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.199431 14362 consensus_queue.cc:1048] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.206274 14231 raft_consensus.cc:359] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.208007 14362 consensus_queue.cc:1048] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:49.209518 14034 raft_consensus.cc:2468] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:49.206365 14228 raft_consensus.cc:359] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.211632 14228 raft_consensus.cc:385] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.212216 14228 raft_consensus.cc:740] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.207767 14231 raft_consensus.cc:385] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.214661 14231 raft_consensus.cc:740] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.215660 14231 consensus_queue.cc:260] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.213320 14228 consensus_queue.cc:260] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.224190 14148 leader_election.cc:304] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.226967 14290 raft_consensus.cc:2804] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.228036 14290 raft_consensus.cc:697] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:49.207944 13960 raft_consensus.cc:2468] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:49.228938 14290 consensus_queue.cc:237] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.232807 14231 ts_tablet_manager.cc:1434] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260501 14:01:49.234978 14231 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:49.233850 14228 ts_tablet_manager.cc:1434] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.180s	user 0.003s	sys 0.008s
I20260501 14:01:49.236804 14228 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:49.243606 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.245424 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe7f10257e74bee9c9de08d91394e3d" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.246850 14229 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.247426 14229 ts_tablet_manager.cc:1403] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.149s	user 0.037s	sys 0.035s
I20260501 14:01:49.248327 14075 leader_election.cc:304] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:49.250952 14229 raft_consensus.cc:359] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.251680 14229 raft_consensus.cc:385] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.251987 14229 raft_consensus.cc:740] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.252774 14229 consensus_queue.cc:260] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.255329 14229 ts_tablet_manager.cc:1434] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260501 14:01:49.256369 14229 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.267621 14339 consensus_queue.cc:1048] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.223570 14357 leader_election.cc:290] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.293792 14229 tablet_bootstrap.cc:654] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.297390 14227 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.298185 14227 ts_tablet_manager.cc:1403] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.179s	user 0.048s	sys 0.062s
I20260501 14:01:49.300292 14359 raft_consensus.cc:2749] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:49.308877 14227 raft_consensus.cc:359] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.319393 14227 raft_consensus.cc:385] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260501 14:01:49.317555 14000 consensus_peers.cc:597] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:49.320262 14227 raft_consensus.cc:740] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.321419 14227 consensus_queue.cc:260] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.314257 13855 catalog_manager.cc:5671] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:49.319000 14231 tablet_bootstrap.cc:654] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.325095 14359 raft_consensus.cc:493] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.322244 14228 tablet_bootstrap.cc:654] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.325666 14359 raft_consensus.cc:515] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.328526 14359 leader_election.cc:290] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.329794 14227 ts_tablet_manager.cc:1434] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260501 14:01:49.332208 14227 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.330216 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73e59416ac4bbab3ca71bc9ccb8395" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.334710 14181 raft_consensus.cc:2468] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:49.322281 14229 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.332571 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73e59416ac4bbab3ca71bc9ccb8395" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.336195 14075 leader_election.cc:304] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.338366 14229 ts_tablet_manager.cc:1403] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.011s
I20260501 14:01:49.338992 14359 raft_consensus.cc:2804] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.339417 14359 raft_consensus.cc:493] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.339788 14359 raft_consensus.cc:3060] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.342288 14229 raft_consensus.cc:359] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.343236 14229 raft_consensus.cc:385] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.338402 14035 raft_consensus.cc:2468] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:49.343564 14229 raft_consensus.cc:740] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.346540 14227 tablet_bootstrap.cc:654] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.346930 14229 consensus_queue.cc:260] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.347946 14228 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.348512 14228 ts_tablet_manager.cc:1403] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.003s
I20260501 14:01:49.349560 14229 ts_tablet_manager.cc:1434] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260501 14:01:49.350586 14229 tablet_bootstrap.cc:492] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.352839 14231 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:49.354322 14228 raft_consensus.cc:359] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.357779 14229 tablet_bootstrap.cc:654] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.360463 14295 raft_consensus.cc:493] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.361150 14295 raft_consensus.cc:515] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.355214 14231 ts_tablet_manager.cc:1403] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.120s	user 0.007s	sys 0.012s
I20260501 14:01:49.364637 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c534f0c5c5845f592e3cec990b099bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:49.365765 14231 raft_consensus.cc:359] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:49.366142 14148 leader_election.cc:343] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.366730 14290 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.355576 14228 raft_consensus.cc:385] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.367158 14295 leader_election.cc:290] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.367226 14290 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.367794 14228 raft_consensus.cc:740] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.368343 14231 raft_consensus.cc:385] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.369089 14231 raft_consensus.cc:740] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.369598 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c534f0c5c5845f592e3cec990b099bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.370762 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.371150 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
W20260501 14:01:49.372330 14148 leader_election.cc:343] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.370318 14231 consensus_queue.cc:260] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:49.373476 14149 leader_election.cc:343] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.373919 14149 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.369632 14290 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.369663 14228 consensus_queue.cc:260] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.375569 14290 raft_consensus.cc:2749] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.376818 13958 raft_consensus.cc:2468] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:49.378101 14359 raft_consensus.cc:515] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.379415 14228 ts_tablet_manager.cc:1434] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.005s
I20260501 14:01:49.381213 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73e59416ac4bbab3ca71bc9ccb8395" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:49.381794 14035 raft_consensus.cc:3060] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.382846 14228 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:49.383507 14227 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.380388 14359 leader_election.cc:290] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.384207 14227 ts_tablet_manager.cc:1403] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.021s
I20260501 14:01:49.380414 14231 ts_tablet_manager.cc:1434] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260501 14:01:49.381721 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73e59416ac4bbab3ca71bc9ccb8395" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:49.387085 14181 raft_consensus.cc:3060] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.390311 14035 raft_consensus.cc:2468] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:49.390625 14228 tablet_bootstrap.cc:654] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.380028 14149 leader_election.cc:304] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:49.391574 14074 leader_election.cc:304] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:01:49.392647 14359 raft_consensus.cc:2804] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.393364 14359 raft_consensus.cc:697] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:49.394711 14295 raft_consensus.cc:2804] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.395125 14295 raft_consensus.cc:493] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.395453 14295 raft_consensus.cc:3060] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.401886 13854 catalog_manager.cc:5671] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:49.404737 14231 tablet_bootstrap.cc:492] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:49.417924 14229 tablet_bootstrap.cc:492] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.418490 14229 ts_tablet_manager.cc:1403] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.005s
I20260501 14:01:49.421599 14229 raft_consensus.cc:359] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.403699 14295 raft_consensus.cc:515] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.406888 14227 raft_consensus.cc:359] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.422825 14227 raft_consensus.cc:385] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.423136 14227 raft_consensus.cc:740] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.424011 14295 leader_election.cc:290] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.423836 14227 consensus_queue.cc:260] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.424633 14229 raft_consensus.cc:385] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.424950 14229 raft_consensus.cc:740] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.407516 14290 raft_consensus.cc:493] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.425619 14227 ts_tablet_manager.cc:1434] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260501 14:01:49.426452 14290 raft_consensus.cc:515] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.427505 14227 tablet_bootstrap.cc:492] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.428491 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c534f0c5c5845f592e3cec990b099bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:49.429172 14107 raft_consensus.cc:3060] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.428570 14290 leader_election.cc:290] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.410378 14228 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.430763 14228 ts_tablet_manager.cc:1403] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.001s
I20260501 14:01:49.432391 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:49.434816 14228 raft_consensus.cc:359] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.422006 14231 tablet_bootstrap.cc:654] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.394268 14359 consensus_queue.cc:237] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.435551 14228 raft_consensus.cc:385] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260501 14:01:49.435773 14148 leader_election.cc:343] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.435938 14228 raft_consensus.cc:740] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.436128 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.436820 14228 consensus_queue.cc:260] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.437937 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c534f0c5c5845f592e3cec990b099bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:49.438580 13958 raft_consensus.cc:3060] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.439275 14228 ts_tablet_manager.cc:1434] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260501 14:01:49.441052 14149 leader_election.cc:343] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.441723 14149 leader_election.cc:304] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.443226 14290 raft_consensus.cc:2749] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.414546 14181 raft_consensus.cc:2468] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:49.425606 14229 consensus_queue.cc:260] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.435228 14227 tablet_bootstrap.cc:654] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.449486 14229 ts_tablet_manager.cc:1434] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260501 14:01:49.450587 14229 tablet_bootstrap.cc:492] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.456866 14107 raft_consensus.cc:2468] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:49.476025 14286 raft_consensus.cc:493] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.481478 14286 raft_consensus.cc:515] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.482599 14148 leader_election.cc:304] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.484174 14286 leader_election.cc:290] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.484766 14295 raft_consensus.cc:2804] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.485316 14295 raft_consensus.cc:697] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:49.485541 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a7258fde148469fc13884190b3b50" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.486151 14295 consensus_queue.cc:237] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.462034 14228 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:49.451495 13958 raft_consensus.cc:2468] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:49.480237 14227 tablet_bootstrap.cc:492] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.489089 14227 ts_tablet_manager.cc:1403] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.009s
I20260501 14:01:49.480880 14231 tablet_bootstrap.cc:492] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:49.490809 14231 ts_tablet_manager.cc:1403] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.004s
I20260501 14:01:49.473696 14229 tablet_bootstrap.cc:654] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:49.486774 14075 leader_election.cc:343] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.492352 14227 raft_consensus.cc:359] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.493103 14227 raft_consensus.cc:385] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.493427 14227 raft_consensus.cc:740] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.494082 14227 consensus_queue.cc:260] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.495069 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a7258fde148469fc13884190b3b50" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.495348 14228 tablet_bootstrap.cc:654] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.495747 14035 raft_consensus.cc:2468] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:49.496387 14227 ts_tablet_manager.cc:1434] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 14:01:49.497442 14227 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.497828 14231 raft_consensus.cc:359] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.498653 14231 raft_consensus.cc:385] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.499006 14231 raft_consensus.cc:740] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.499035 14074 leader_election.cc:304] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.500155 14359 raft_consensus.cc:2804] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.500651 14359 raft_consensus.cc:493] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.501103 14359 raft_consensus.cc:3060] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.504997 14227 tablet_bootstrap.cc:654] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.507576 13856 catalog_manager.cc:5671] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:49.513192 14231 consensus_queue.cc:260] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.519436 14227 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.521119 14227 ts_tablet_manager.cc:1403] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260501 14:01:49.524755 14359 raft_consensus.cc:515] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.527015 14231 ts_tablet_manager.cc:1434] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260501 14:01:49.528141 14231 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:49.529101 14227 raft_consensus.cc:359] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.529867 14227 raft_consensus.cc:385] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.530133 14227 raft_consensus.cc:740] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.530809 14227 consensus_queue.cc:260] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.533282 14227 ts_tablet_manager.cc:1434] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260501 14:01:49.534284 14227 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.538019 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a7258fde148469fc13884190b3b50" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
W20260501 14:01:49.540046 14075 leader_election.cc:343] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.541062 14227 tablet_bootstrap.cc:654] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.543370 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a7258fde148469fc13884190b3b50" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:49.544234 14035 raft_consensus.cc:3060] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.546228 13858 catalog_manager.cc:5671] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:49.555107 14035 raft_consensus.cc:2468] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:49.556502 14074 leader_election.cc:304] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.557484 14286 raft_consensus.cc:2804] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.557989 14286 raft_consensus.cc:697] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:49.558913 14286 consensus_queue.cc:237] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.563344 14227 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.564035 14227 ts_tablet_manager.cc:1403] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260501 14:01:49.565243 14359 leader_election.cc:290] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.566984 14229 tablet_bootstrap.cc:492] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.567796 14229 ts_tablet_manager.cc:1403] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.003s
I20260501 14:01:49.568081 14227 raft_consensus.cc:359] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.569097 14227 raft_consensus.cc:385] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.569443 14227 raft_consensus.cc:740] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.570168 14231 tablet_bootstrap.cc:654] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.570250 14227 consensus_queue.cc:260] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.570776 14229 raft_consensus.cc:359] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.571549 14229 raft_consensus.cc:385] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.575407 14229 raft_consensus.cc:740] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.576552 14229 consensus_queue.cc:260] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.577324 14228 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.577963 14228 ts_tablet_manager.cc:1403] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.116s	user 0.029s	sys 0.036s
I20260501 14:01:49.579509 14229 ts_tablet_manager.cc:1434] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260501 14:01:49.579324 13858 catalog_manager.cc:5671] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:49.580607 14229 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.580834 14228 raft_consensus.cc:359] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.581492 14228 raft_consensus.cc:385] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.581990 14228 raft_consensus.cc:740] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.582783 14228 consensus_queue.cc:260] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.586928 14228 ts_tablet_manager.cc:1434] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260501 14:01:49.573480 14227 ts_tablet_manager.cc:1434] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260501 14:01:49.588611 14227 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.588640 14228 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:49.595815 14227 tablet_bootstrap.cc:654] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.596314 14228 tablet_bootstrap.cc:654] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.602732 14229 tablet_bootstrap.cc:654] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.603132 14228 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.603577 14228 ts_tablet_manager.cc:1403] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260501 14:01:49.607326 14228 raft_consensus.cc:359] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.607806 14227 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.608136 14231 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:49.608088 14228 raft_consensus.cc:385] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.608632 14227 ts_tablet_manager.cc:1403] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.008s
I20260501 14:01:49.608678 14228 raft_consensus.cc:740] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.608902 14231 ts_tablet_manager.cc:1403] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.006s
I20260501 14:01:49.609795 14228 consensus_queue.cc:260] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.612073 14227 raft_consensus.cc:359] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.612646 14228 ts_tablet_manager.cc:1434] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:01:49.612389 14231 raft_consensus.cc:359] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.613256 14231 raft_consensus.cc:385] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.613588 14231 raft_consensus.cc:740] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.612872 14227 raft_consensus.cc:385] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.613746 14228 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:49.614374 14227 raft_consensus.cc:740] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.615214 14227 consensus_queue.cc:260] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.616214 14231 consensus_queue.cc:260] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.618505 14231 ts_tablet_manager.cc:1434] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260501 14:01:49.619293 14229 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.619804 14229 ts_tablet_manager.cc:1403] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.004s
I20260501 14:01:49.622871 14229 raft_consensus.cc:359] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.623585 14229 raft_consensus.cc:385] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.623894 14229 raft_consensus.cc:740] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.624246 14228 tablet_bootstrap.cc:654] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.624548 14229 consensus_queue.cc:260] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.625164 14227 ts_tablet_manager.cc:1434] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260501 14:01:49.626091 14285 raft_consensus.cc:493] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.626725 14231 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:49.626572 14285 raft_consensus.cc:515] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.628171 14290 consensus_queue.cc:1048] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:49.626781 14229 ts_tablet_manager.cc:1434] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260501 14:01:49.632382 14229 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.632938 14227 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.634976 14285 leader_election.cc:290] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:49.637518 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.638298 14035 raft_consensus.cc:2468] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:49.638804 14229 tablet_bootstrap.cc:654] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.643710 14231 tablet_bootstrap.cc:654] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.643522 13925 leader_election.cc:304] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:49.644542 14281 raft_consensus.cc:2804] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.644986 14281 raft_consensus.cc:493] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.645346 14281 raft_consensus.cc:3060] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.648859 14227 tablet_bootstrap.cc:654] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.650622 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
W20260501 14:01:49.652612 13925 leader_election.cc:343] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.656919 14289 consensus_queue.cc:1048] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:49.664155 13958 raft_consensus.cc:3060] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.666702 14281 raft_consensus.cc:515] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.678028 14281 leader_election.cc:290] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:49.682263 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:49.682725 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:49.683108 14032 raft_consensus.cc:3060] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:49.684216 13925 leader_election.cc:343] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.685135 14227 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.685647 14227 ts_tablet_manager.cc:1403] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.000s
I20260501 14:01:49.685701 14231 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:49.686322 14231 ts_tablet_manager.cc:1403] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.000s
I20260501 14:01:49.689133 14227 raft_consensus.cc:359] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.689858 14227 raft_consensus.cc:385] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.690058 14231 raft_consensus.cc:359] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.690856 14231 raft_consensus.cc:385] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.691190 14231 raft_consensus.cc:740] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.694407 14032 raft_consensus.cc:2468] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:49.697285 13925 leader_election.cc:304] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:49.698800 14281 raft_consensus.cc:2804] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.699469 14362 consensus_queue.cc:1048] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.701292 14281 raft_consensus.cc:697] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:49.709637 14290 consensus_queue.cc:1048] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.704908 14281 consensus_queue.cc:237] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.703657 14229 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.717836 14229 ts_tablet_manager.cc:1403] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.005s
I20260501 14:01:49.722008 14229 raft_consensus.cc:359] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.724277 14231 consensus_queue.cc:260] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.748396 14229 raft_consensus.cc:385] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.748818 14229 raft_consensus.cc:740] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.726573 14267 raft_consensus.cc:493] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.690172 14227 raft_consensus.cc:740] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.749668 14267 raft_consensus.cc:515] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.750022 14227 consensus_queue.cc:260] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.752079 14267 leader_election.cc:290] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.752442 14227 ts_tablet_manager.cc:1434] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260501 14:01:49.753624 14227 tablet_bootstrap.cc:492] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.755363 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a955fb193fda436098188379de1edb2c" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:49.756137 14107 raft_consensus.cc:2468] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:49.757227 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a955fb193fda436098188379de1edb2c" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.757958 14181 raft_consensus.cc:2468] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:49.759303 14001 leader_election.cc:304] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.762198 14231 ts_tablet_manager.cc:1434] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260501 14:01:49.762724 14267 raft_consensus.cc:2804] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.763206 14267 raft_consensus.cc:493] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.762832 14229 consensus_queue.cc:260] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.763577 14267 raft_consensus.cc:3060] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.765305 14229 ts_tablet_manager.cc:1434] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260501 14:01:49.766390 14229 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:49.768673 13855 catalog_manager.cc:5671] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:49.771095 14231 tablet_bootstrap.cc:492] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:49.772284 14227 tablet_bootstrap.cc:654] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.775758 14286 raft_consensus.cc:493] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.776574 14229 tablet_bootstrap.cc:654] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.776294 14286 raft_consensus.cc:515] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.777593 14231 tablet_bootstrap.cc:654] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.778590 14286 leader_election.cc:290] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.779803 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923244304708a082b89059b70764" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.781057 14228 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.781181 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a923244304708a082b89059b70764" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.781616 14228 ts_tablet_manager.cc:1403] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.031s
I20260501 14:01:49.783478 14075 leader_election.cc:304] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.784847 14228 raft_consensus.cc:359] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.785540 14286 raft_consensus.cc:2749] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.790441 14286 raft_consensus.cc:493] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.791165 14286 raft_consensus.cc:515] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.794234 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.794032 14362 raft_consensus.cc:493] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.796061 14362 raft_consensus.cc:515] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.797374 14286 leader_election.cc:290] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.798192 14362 leader_election.cc:290] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:49.801165 14286 raft_consensus.cc:493] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.801307 14359 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.802397 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.802175 14359 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.803733 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:49.804915 14359 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:01:49.806736 14148 leader_election.cc:343] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.807461 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.807910 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.808640 14181 raft_consensus.cc:2468] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
W20260501 14:01:49.807480 14148 leader_election.cc:343] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:49.809487 14075 leader_election.cc:343] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.809854 14148 leader_election.cc:304] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:49.811313 14362 raft_consensus.cc:2749] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.811640 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:49.812487 14032 raft_consensus.cc:2393] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:49.812359 14075 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.814010 14074 leader_election.cc:304] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:49.815296 14357 raft_consensus.cc:2804] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.815652 14357 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.816031 14357 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.816286 14267 raft_consensus.cc:515] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.811786 14286 raft_consensus.cc:515] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.821161 14107 raft_consensus.cc:3060] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.820195 14359 raft_consensus.cc:3060] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.825477 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.826251 14181 raft_consensus.cc:2468] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:49.827657 14075 leader_election.cc:304] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.785559 14228 raft_consensus.cc:385] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.832327 14228 raft_consensus.cc:740] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.833171 14286 leader_election.cc:290] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.833854 14286 raft_consensus.cc:2804] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.834227 14286 raft_consensus.cc:493] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.834558 14286 raft_consensus.cc:3060] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.835484 14227 tablet_bootstrap.cc:492] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.836210 14227 ts_tablet_manager.cc:1403] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.083s	user 0.022s	sys 0.021s
I20260501 14:01:49.836252 14359 raft_consensus.cc:2749] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.840945 14267 leader_election.cc:290] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.841629 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a955fb193fda436098188379de1edb2c" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:49.842164 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a955fb193fda436098188379de1edb2c" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:49.842300 14108 raft_consensus.cc:3060] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.842821 14181 raft_consensus.cc:3060] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.833233 14228 consensus_queue.cc:260] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.845515 14228 ts_tablet_manager.cc:1434] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260501 14:01:49.849653 14228 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:49.839452 14227 raft_consensus.cc:359] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.852267 14227 raft_consensus.cc:385] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.852576 14227 raft_consensus.cc:740] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.853292 14227 consensus_queue.cc:260] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.851790 14286 raft_consensus.cc:515] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.857197 14286 leader_election.cc:290] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.858176 14231 tablet_bootstrap.cc:492] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:49.858798 14231 ts_tablet_manager.cc:1403] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.088s	user 0.005s	sys 0.007s
I20260501 14:01:49.855614 14227 ts_tablet_manager.cc:1434] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260501 14:01:49.860236 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.860980 13958 raft_consensus.cc:2468] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:49.861374 14227 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.862342 14181 raft_consensus.cc:2468] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:49.863165 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:49.863834 14182 raft_consensus.cc:3060] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.864261 14001 leader_election.cc:304] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.865695 14293 raft_consensus.cc:2804] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.866180 14293 raft_consensus.cc:697] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:49.867039 14293 consensus_queue.cc:237] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.870245 14281 raft_consensus.cc:493] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.871061 14281 raft_consensus.cc:515] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.874017 14228 tablet_bootstrap.cc:654] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.875799 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:49.876699 13958 raft_consensus.cc:3060] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.878459 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
W20260501 14:01:49.880009 13925 leader_election.cc:343] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.876803 14281 leader_election.cc:290] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:49.883898 14227 tablet_bootstrap.cc:654] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.885792 14267 raft_consensus.cc:493] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.874069 14182 raft_consensus.cc:2468] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:49.886415 14267 raft_consensus.cc:515] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.887668 14075 leader_election.cc:304] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.889993 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265e96f503c4b65adaa438fe44216d7" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.890729 14183 raft_consensus.cc:2468] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:49.889686 13856 catalog_manager.cc:5671] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:49.891666 13958 raft_consensus.cc:2468] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:49.892505 14001 leader_election.cc:304] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:49.893195 14359 raft_consensus.cc:2804] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:49.894212 14359 raft_consensus.cc:697] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:49.895054 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:49.896488 13926 leader_election.cc:343] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.896978 13926 leader_election.cc:304] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:49.897286 14286 consensus_queue.cc:1048] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:49.897941 14281 raft_consensus.cc:2749] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:49.897145 14359 consensus_queue.cc:237] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.898124 14293 raft_consensus.cc:2804] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.901718 14293 raft_consensus.cc:493] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.903803 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265e96f503c4b65adaa438fe44216d7" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:49.900874 14227 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:49.904912 14227 ts_tablet_manager.cc:1403] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
W20260501 14:01:49.905287 14001 leader_election.cc:343] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.905877 14293 raft_consensus.cc:3060] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.855312 14357 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:49.908557 14229 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:49.918959 14229 ts_tablet_manager.cc:1403] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.004s
I20260501 14:01:49.921569 14227 raft_consensus.cc:359] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.921896 14229 raft_consensus.cc:359] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.922822 14229 raft_consensus.cc:385] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.923244 14229 raft_consensus.cc:740] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.924531 14229 consensus_queue.cc:260] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.909567 14231 raft_consensus.cc:359] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.912756 14405 consensus_queue.cc:1048] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:49.928485 14231 raft_consensus.cc:385] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.928882 14231 raft_consensus.cc:740] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.929612 14231 consensus_queue.cc:260] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.933296 14357 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:49.858145 14108 raft_consensus.cc:2468] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:49.922459 14227 raft_consensus.cc:385] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:49.934489 14227 raft_consensus.cc:740] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:49.934815 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:49.935379 14227 consensus_queue.cc:260] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.938110 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:49.938299 14227 ts_tablet_manager.cc:1434] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260501 14:01:49.939168 14183 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.942174 14229 ts_tablet_manager.cc:1434] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260501 14:01:49.944548 14229 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
W20260501 14:01:49.945825 14075 leader_election.cc:343] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.947618 14362 consensus_queue.cc:1048] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:49.950170 14231 ts_tablet_manager.cc:1434] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.005s
I20260501 14:01:49.951560 14231 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:49.951483 14339 raft_consensus.cc:493] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.952181 14339 raft_consensus.cc:515] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.954348 14339 leader_election.cc:290] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.955981 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:49.956537 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:49.957208 14107 raft_consensus.cc:2468] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
W20260501 14:01:49.957425 14001 leader_election.cc:343] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.958513 14000 leader_election.cc:304] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:49.959573 14339 raft_consensus.cc:2804] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:49.956023 14227 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:49.960021 14339 raft_consensus.cc:493] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:49.960386 14339 raft_consensus.cc:3060] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.969727 14339 raft_consensus.cc:515] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:49.973184 14339 leader_election.cc:290] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:49.973263 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:49.975040 14001 leader_election.cc:343] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:49.975854 14281 raft_consensus.cc:493] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:49.976433 14281 raft_consensus.cc:515] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:49.977041 14227 tablet_bootstrap.cc:654] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.979777 14281 leader_election.cc:290] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:49.982977 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a7258fde148469fc13884190b3b50" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:49.983503 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:49.984549 14107 raft_consensus.cc:3060] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:49.986773 14231 tablet_bootstrap.cc:654] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.989122 14229 tablet_bootstrap.cc:654] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:49.993315 14293 raft_consensus.cc:515] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:49.998200 14228 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:49.999068 14228 ts_tablet_manager.cc:1403] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.150s	user 0.024s	sys 0.008s
I20260501 14:01:49.913939 14267 leader_election.cc:290] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:50.003232 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a7258fde148469fc13884190b3b50" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.003873 14293 leader_election.cc:290] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:50.004261 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265e96f503c4b65adaa438fe44216d7" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:50.005102 14182 raft_consensus.cc:3060] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.008360 14228 raft_consensus.cc:359] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.009526 14228 raft_consensus.cc:385] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.010093 14228 raft_consensus.cc:740] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.004233 14032 raft_consensus.cc:2393] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:49.967531 14183 raft_consensus.cc:2468] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:50.011046 14228 consensus_queue.cc:260] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.013636 14359 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.025748 14359 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.029537 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265e96f503c4b65adaa438fe44216d7" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
W20260501 14:01:50.031600 14001 leader_election.cc:343] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.033238 13959 raft_consensus.cc:3060] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.037906 14359 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:50.042202 14180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:50.044152 14075 leader_election.cc:343] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.048938 13856 catalog_manager.cc:5671] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:50.054754 14075 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:50.056985 14290 consensus_queue.cc:1048] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:50.060899 14357 raft_consensus.cc:2804] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.061491 14357 raft_consensus.cc:697] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:50.062361 14357 consensus_queue.cc:237] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.065848 14228 ts_tablet_manager.cc:1434] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.005s
I20260501 14:01:50.066905 14228 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:50.072062 14229 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:50.054755 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:50.073693 14229 ts_tablet_manager.cc:1403] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.129s	user 0.018s	sys 0.001s
I20260501 14:01:50.076967 14182 raft_consensus.cc:2468] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:50.078311 14001 leader_election.cc:304] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:50.079507 14293 raft_consensus.cc:2804] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.080063 14293 raft_consensus.cc:697] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:50.080976 14293 consensus_queue.cc:237] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.083047 14405 consensus_queue.cc:1048] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:50.066179 14107 raft_consensus.cc:2468] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:50.098454 14000 leader_election.cc:304] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:50.100407 14267 raft_consensus.cc:2804] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.101815 14285 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.102656 14285 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.098919 14227 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:50.104363 14227 ts_tablet_manager.cc:1403] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.165s	user 0.014s	sys 0.003s
I20260501 14:01:50.067994 13925 leader_election.cc:304] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:50.127997 14285 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
W20260501 14:01:50.148733 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 95818.3us
I20260501 14:01:50.139998 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:50.158610 14227 raft_consensus.cc:359] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.159242 14227 raft_consensus.cc:385] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.159538 14227 raft_consensus.cc:740] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.162227 14227 consensus_queue.cc:260] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:50.153002 14075 leader_election.cc:343] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.165400 14231 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:50.166635 14231 ts_tablet_manager.cc:1403] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.215s	user 0.032s	sys 0.024s
I20260501 14:01:50.155958 14267 raft_consensus.cc:697] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:50.160401 14182 raft_consensus.cc:2468] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:50.172938 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.174536 13926 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:50.168828 14075 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:50.175560 14285 raft_consensus.cc:2804] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:50.176045 14285 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:50.176182 14405 raft_consensus.cc:2749] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:50.176450 14285 raft_consensus.cc:3060] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:50.180729 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:50.181684 14267 consensus_queue.cc:237] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.186379 14231 raft_consensus.cc:359] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.187640 14231 raft_consensus.cc:385] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.188123 14231 raft_consensus.cc:740] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.189173 14231 consensus_queue.cc:260] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.171907 14227 ts_tablet_manager.cc:1434] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260501 14:01:50.191784 14227 tablet_bootstrap.cc:492] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:50.194715 14289 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.203238 14281 raft_consensus.cc:2749] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:50.197507 14289 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.216517 14339 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.217139 14339 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.217836 14289 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:50.219125 14339 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:50.219872 14281 consensus_queue.cc:1048] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:50.221029 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.221319 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:50.222016 14181 raft_consensus.cc:2468] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
W20260501 14:01:50.222407 14148 leader_election.cc:343] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.222968 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:50.224064 14001 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:50.224635 14231 ts_tablet_manager.cc:1434] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.004s
I20260501 14:01:50.225338 14339 raft_consensus.cc:2804] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:50.225776 14231 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:50.226006 14339 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:50.226647 14339 raft_consensus.cc:3060] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.236830 14231 tablet_bootstrap.cc:654] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:50.242578 13925 leader_election.cc:343] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.238247 14357 raft_consensus.cc:493] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.245611 13955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:50.245839 14357 raft_consensus.cc:515] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.244800 13854 catalog_manager.cc:5671] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:50.240312 14413 log.cc:927] Time spent T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260501 14:01:50.247789 14405 consensus_queue.cc:1048] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:50.262486 14227 tablet_bootstrap.cc:654] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:50.264490 14149 leader_election.cc:343] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.265010 14149 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:50.267970 14287 raft_consensus.cc:2749] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:50.274636 14228 tablet_bootstrap.cc:654] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.239732 14229 raft_consensus.cc:359] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.276253 14229 raft_consensus.cc:385] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.276641 14229 raft_consensus.cc:740] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.277539 14229 consensus_queue.cc:260] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.248008 14339 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.257277 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:50.259549 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.267803 13856 catalog_manager.cc:5671] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:50.285238 14229 ts_tablet_manager.cc:1434] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.211s	user 0.008s	sys 0.001s
I20260501 14:01:50.286192 13856 catalog_manager.cc:5671] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:50.280401 14357 leader_election.cc:290] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:50.292385 14229 tablet_bootstrap.cc:492] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:50.289937 14339 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:01:50.294008 14074 leader_election.cc:343] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.303239 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:50.296849 14285 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:50.309551 14075 leader_election.cc:343] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.310896 13959 raft_consensus.cc:2393] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:50.310804 14075 leader_election.cc:304] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:50.306025 14181 raft_consensus.cc:3060] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.311983 14357 raft_consensus.cc:2749] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:50.314390 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:50.312337 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:50.325649 14229 tablet_bootstrap.cc:654] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.326668 14227 tablet_bootstrap.cc:492] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:50.327272 14227 ts_tablet_manager.cc:1403] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.011s
I20260501 14:01:50.335178 14285 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:50.363965 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:50.364995 14032 raft_consensus.cc:2393] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
W20260501 14:01:50.367497 14421 log.cc:927] Time spent T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260501 14:01:50.370530 14357 consensus_queue.cc:1048] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:50.376483 14227 raft_consensus.cc:359] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.380797 14227 raft_consensus.cc:385] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.381172 14227 raft_consensus.cc:740] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.381969 14227 consensus_queue.cc:260] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.397817 14295 raft_consensus.cc:493] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.400269 14227 ts_tablet_manager.cc:1434] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.004s
I20260501 14:01:50.399989 14295 raft_consensus.cc:515] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.401352 14405 raft_consensus.cc:493] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.415103 14229 tablet_bootstrap.cc:492] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:50.420132 14229 ts_tablet_manager.cc:1403] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.132s	user 0.021s	sys 0.008s
I20260501 14:01:50.410055 14267 consensus_queue.cc:1048] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260501 14:01:50.422734 14227 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:50.421566 14405 raft_consensus.cc:515] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.425158 14405 leader_election.cc:290] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:50.428174 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:50.428416 14229 raft_consensus.cc:359] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.428937 14183 raft_consensus.cc:2468] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:50.429220 14229 raft_consensus.cc:385] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.429556 14229 raft_consensus.cc:740] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.430400 14229 consensus_queue.cc:260] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.432204 13925 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:50.433483 14075 leader_election.cc:304] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:50.435185 14404 raft_consensus.cc:2804] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:50.435678 14404 raft_consensus.cc:493] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:50.436090 14404 raft_consensus.cc:3060] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.439515 14295 leader_election.cc:290] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:50.439929 14424 raft_consensus.cc:2749] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:50.440246 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.445535 14229 ts_tablet_manager.cc:1434] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260501 14:01:50.446754 14229 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:50.448010 14228 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:50.448526 14228 ts_tablet_manager.cc:1403] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.382s	user 0.028s	sys 0.044s
I20260501 14:01:50.449008 14181 raft_consensus.cc:2468] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:50.450886 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.451259 14001 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:50.452225 14423 consensus_queue.cc:1048] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260501 14:01:50.453023 14148 leader_election.cc:343] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:50.453370 14074 leader_election.cc:343] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.457397 14228 raft_consensus.cc:359] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.458137 14228 raft_consensus.cc:385] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.458418 14228 raft_consensus.cc:740] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.459105 14228 consensus_queue.cc:260] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.461876 14267 raft_consensus.cc:2804] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.462477 14267 raft_consensus.cc:697] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:50.463377 14267 consensus_queue.cc:237] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.453069 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:50.464742 13959 raft_consensus.cc:2468] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:50.470999 14228 ts_tablet_manager.cc:1434] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260501 14:01:50.471158 14227 tablet_bootstrap.cc:654] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.485546 14149 leader_election.cc:304] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:50.489207 14295 raft_consensus.cc:2804] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:50.490892 14295 raft_consensus.cc:493] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:50.491218 14295 raft_consensus.cc:3060] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.491688 14404 raft_consensus.cc:515] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.493247 14359 consensus_queue.cc:1048] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:50.494333 14404 leader_election.cc:290] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:50.496520 14228 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:50.497300 14231 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:50.499065 14231 ts_tablet_manager.cc:1403] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.274s	user 0.016s	sys 0.009s
I20260501 14:01:50.497596 14180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:50.505370 14231 raft_consensus.cc:359] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.506242 14231 raft_consensus.cc:385] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.506542 14231 raft_consensus.cc:740] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.507011 14180 raft_consensus.cc:3060] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.507236 14231 consensus_queue.cc:260] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.509521 14228 tablet_bootstrap.cc:654] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.513744 14229 tablet_bootstrap.cc:654] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.511576 14436 consensus_queue.cc:1048] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260501 14:01:50.516359 14339 consensus_queue.cc:1048] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:50.516884 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:50.517536 14231 ts_tablet_manager.cc:1434] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260501 14:01:50.520939 14180 raft_consensus.cc:2468] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:50.528703 14231 tablet_bootstrap.cc:492] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
W20260501 14:01:50.529229 14074 leader_election.cc:343] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.531121 14075 leader_election.cc:304] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:50.532596 14404 raft_consensus.cc:2804] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.533160 14404 raft_consensus.cc:697] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:50.534188 14227 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:50.534935 14227 ts_tablet_manager.cc:1403] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.010s
I20260501 14:01:50.534098 14404 consensus_queue.cc:237] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.542244 14227 raft_consensus.cc:359] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.543550 14227 raft_consensus.cc:385] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.543876 14227 raft_consensus.cc:740] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.547603 14339 consensus_queue.cc:1048] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:50.552065 14227 consensus_queue.cc:260] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.565480 14231 tablet_bootstrap.cc:654] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.566975 14227 ts_tablet_manager.cc:1434] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
I20260501 14:01:50.568519 14227 tablet_bootstrap.cc:492] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
W20260501 14:01:50.572227 14075 consensus_peers.cc:597] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:01:50.582314 14001 consensus_peers.cc:597] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:50.555804 14295 raft_consensus.cc:515] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:50.585996 14433 log.cc:927] Time spent T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260501 14:01:50.596681 14285 raft_consensus.cc:493] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.597580 14285 raft_consensus.cc:515] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.589951 14295 leader_election.cc:290] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:50.604565 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:50.606352 14228 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:50.607157 14228 ts_tablet_manager.cc:1403] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.007s
I20260501 14:01:50.612768 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:50.613525 13959 raft_consensus.cc:3060] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.614571 14228 raft_consensus.cc:359] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.615561 14228 raft_consensus.cc:385] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260501 14:01:50.616438 14148 leader_election.cc:343] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.618377 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.619102 14032 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:50.620453 13925 leader_election.cc:304] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:50.621258 14228 raft_consensus.cc:740] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.621358 14423 raft_consensus.cc:2804] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:50.621881 14423 raft_consensus.cc:493] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:50.622344 14423 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.626817 14285 leader_election.cc:290] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:50.629238 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
W20260501 14:01:50.629864 14439 log.cc:927] Time spent T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260501 14:01:50.630043 14108 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:50.632109 14228 consensus_queue.cc:260] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.648720 14228 ts_tablet_manager.cc:1434] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.000s
I20260501 14:01:50.647562 13856 catalog_manager.cc:5671] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:50.647679 14423 raft_consensus.cc:515] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.666329 14228 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:50.669642 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:50.670655 14108 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.674932 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:50.675923 14035 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.680219 14423 leader_election.cc:290] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:50.681136 14420 consensus_queue.cc:1048] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 14:01:50.727669 14228 tablet_bootstrap.cc:654] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.734184 13959 raft_consensus.cc:2468] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:50.735576 14149 leader_election.cc:304] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:50.735033 13856 catalog_manager.cc:5671] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:50.737226 14290 raft_consensus.cc:2804] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.737892 14290 raft_consensus.cc:697] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:50.739372 14227 tablet_bootstrap.cc:654] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.738924 14290 consensus_queue.cc:237] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.746973 14035 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:50.749537 13925 leader_election.cc:304] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:50.751694 14423 raft_consensus.cc:2804] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:50.752295 14423 raft_consensus.cc:697] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:50.753216 14423 consensus_queue.cc:237] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.755153 14108 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:50.766171 14229 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:50.766747 14229 ts_tablet_manager.cc:1403] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.320s	user 0.052s	sys 0.099s
I20260501 14:01:50.775445 14179 raft_consensus.cc:3060] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.775053 14229 raft_consensus.cc:359] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.780735 14229 raft_consensus.cc:385] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.781163 14229 raft_consensus.cc:740] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.781927 14229 consensus_queue.cc:260] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.786191 14229 ts_tablet_manager.cc:1434] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260501 14:01:50.792850 14231 tablet_bootstrap.cc:492] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:50.793525 14231 ts_tablet_manager.cc:1403] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.266s	user 0.012s	sys 0.010s
I20260501 14:01:50.798166 14229 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:50.805802 14231 raft_consensus.cc:359] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.809783 14231 raft_consensus.cc:385] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.810114 14231 raft_consensus.cc:740] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.813099 14228 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:50.813695 14228 ts_tablet_manager.cc:1403] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.003s
I20260501 14:01:50.814581 14231 consensus_queue.cc:260] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.817961 14231 ts_tablet_manager.cc:1434] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260501 14:01:50.818991 14231 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:50.822609 14228 raft_consensus.cc:359] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.823433 14228 raft_consensus.cc:385] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.826215 14227 tablet_bootstrap.cc:492] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:50.826766 14227 ts_tablet_manager.cc:1403] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.259s	user 0.018s	sys 0.001s
I20260501 14:01:50.827103 14229 tablet_bootstrap.cc:654] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.829823 14227 raft_consensus.cc:359] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.830564 14227 raft_consensus.cc:385] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.835937 14227 raft_consensus.cc:740] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.836656 14227 consensus_queue.cc:260] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.841320 14339 consensus_queue.cc:1048] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:50.823717 14228 raft_consensus.cc:740] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.842658 14228 consensus_queue.cc:260] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.843541 14289 raft_consensus.cc:493] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.844614 14227 ts_tablet_manager.cc:1434] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260501 14:01:50.845851 14227 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:50.844187 14289 raft_consensus.cc:515] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.840929 13854 catalog_manager.cc:5671] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:50.850924 14228 ts_tablet_manager.cc:1434] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260501 14:01:50.851485 14289 leader_election.cc:290] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:50.852246 14228 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:50.853715 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:50.858029 14231 tablet_bootstrap.cc:654] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.859164 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:50.862259 14148 leader_election.cc:304] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:50.868328 14228 tablet_bootstrap.cc:654] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.872562 14227 tablet_bootstrap.cc:654] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.878199 14231 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:50.878780 14231 ts_tablet_manager.cc:1403] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.004s
I20260501 14:01:50.882743 14231 raft_consensus.cc:359] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.883482 14231 raft_consensus.cc:385] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.883773 14231 raft_consensus.cc:740] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.884739 14231 consensus_queue.cc:260] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.890111 14227 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:50.891016 14227 ts_tablet_manager.cc:1403] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260501 14:01:50.892925 13856 catalog_manager.cc:5671] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:50.890321 14229 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:50.894995 14229 ts_tablet_manager.cc:1403] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.097s	user 0.025s	sys 0.012s
I20260501 14:01:50.896680 14231 ts_tablet_manager.cc:1434] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260501 14:01:50.899682 14231 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:50.898406 14229 raft_consensus.cc:359] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.901319 14287 raft_consensus.cc:2749] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:50.901135 14229 raft_consensus.cc:385] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.902609 14229 raft_consensus.cc:740] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.903342 14228 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:50.903306 14229 consensus_queue.cc:260] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.903990 14228 ts_tablet_manager.cc:1403] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.001s
I20260501 14:01:50.901927 14227 raft_consensus.cc:359] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.906136 14229 ts_tablet_manager.cc:1434] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260501 14:01:50.906306 14227 raft_consensus.cc:385] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.906646 14227 raft_consensus.cc:740] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.907212 14229 tablet_bootstrap.cc:492] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:50.907377 14228 raft_consensus.cc:359] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.908185 14228 raft_consensus.cc:385] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.908430 14228 raft_consensus.cc:740] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.909204 14228 consensus_queue.cc:260] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.909925 14231 tablet_bootstrap.cc:654] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.911465 14228 ts_tablet_manager.cc:1434] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 14:01:50.907339 14227 consensus_queue.cc:260] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.913249 14228 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:50.923538 14227 ts_tablet_manager.cc:1434] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.005s
I20260501 14:01:50.924789 14227 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:50.925159 14228 tablet_bootstrap.cc:654] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.936060 14339 consensus_queue.cc:1048] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:50.939368 14231 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:50.939987 14231 ts_tablet_manager.cc:1403] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260501 14:01:50.946027 14227 tablet_bootstrap.cc:654] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.943595 14231 raft_consensus.cc:359] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.950250 14231 raft_consensus.cc:385] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.950439 14229 tablet_bootstrap.cc:654] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.950639 14231 raft_consensus.cc:740] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.951066 14293 raft_consensus.cc:493] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.951670 14293 raft_consensus.cc:515] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:50.951710 14231 consensus_queue.cc:260] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:50.954203 14293 leader_election.cc:290] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:50.956322 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:50.957448 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:50.963538 14179 raft_consensus.cc:2393] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:50.954810 14231 ts_tablet_manager.cc:1434] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260501 14:01:50.964818 14001 leader_election.cc:304] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:50.953595 14228 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:50.966667 14228 ts_tablet_manager.cc:1403] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.000s
I20260501 14:01:50.966967 14231 tablet_bootstrap.cc:492] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:50.967262 14293 raft_consensus.cc:3060] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:50.969472 14436 raft_consensus.cc:493] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.970006 14436 raft_consensus.cc:515] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.972303 14436 leader_election.cc:290] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:50.974850 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
W20260501 14:01:50.976533 14075 leader_election.cc:343] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.980234 14287 raft_consensus.cc:493] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:50.980815 14287 raft_consensus.cc:515] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:50.983500 14287 leader_election.cc:290] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:50.984916 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:50.985667 14108 raft_consensus.cc:2468] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:50.986263 14231 tablet_bootstrap.cc:654] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:50.969936 14228 raft_consensus.cc:359] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.987068 14228 raft_consensus.cc:385] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:50.987418 14228 raft_consensus.cc:740] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:50.988282 14228 consensus_queue.cc:260] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:50.990922 14228 ts_tablet_manager.cc:1434] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260501 14:01:50.992302 14228 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:50.992215 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:50.993964 14148 leader_election.cc:304] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:50.995241 14287 raft_consensus.cc:2804] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 14:01:50.996537 14149 leader_election.cc:343] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:50.996876 14287 raft_consensus.cc:493] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:50.997265 14287 raft_consensus.cc:3060] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.003062 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.007160 14231 tablet_bootstrap.cc:492] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:51.007972 14231 ts_tablet_manager.cc:1403] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.001s
I20260501 14:01:51.011929 14339 consensus_queue.cc:1048] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:51.017004 14231 raft_consensus.cc:359] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.018194 14231 raft_consensus.cc:385] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.018559 14231 raft_consensus.cc:740] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.019786 14293 raft_consensus.cc:2749] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:51.019454 14231 consensus_queue.cc:260] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.046902 14231 ts_tablet_manager.cc:1434] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260501 14:01:51.048110 14231 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:51.050429 14436 consensus_queue.cc:1048] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.057050 14231 tablet_bootstrap.cc:654] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.034610 14287 raft_consensus.cc:515] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.062134 14287 leader_election.cc:290] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.036990 13958 raft_consensus.cc:3060] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.063910 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:51.064646 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:51.064841 14108 raft_consensus.cc:3060] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.065196 14227 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:51.065908 14179 raft_consensus.cc:2393] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:51.067480 14229 tablet_bootstrap.cc:492] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:51.067934 14075 leader_election.cc:304] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.068079 14229 ts_tablet_manager.cc:1403] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.161s	user 0.032s	sys 0.077s
W20260501 14:01:51.070621 14149 leader_election.cc:343] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.071972 14229 raft_consensus.cc:359] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.072702 14229 raft_consensus.cc:385] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.072991 14229 raft_consensus.cc:740] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.073693 14229 consensus_queue.cc:260] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.065908 14227 ts_tablet_manager.cc:1403] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.039s
I20260501 14:01:51.080405 14293 raft_consensus.cc:493] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.080947 14293 raft_consensus.cc:515] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.084416 14229 ts_tablet_manager.cc:1434] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260501 14:01:51.086508 14108 raft_consensus.cc:2468] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:51.087495 14357 raft_consensus.cc:2749] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:51.088645 14229 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:51.090517 14289 raft_consensus.cc:493] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.092605 14287 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.039392 14228 tablet_bootstrap.cc:654] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.092998 14289 raft_consensus.cc:515] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.091899 14227 raft_consensus.cc:359] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.096504 14227 raft_consensus.cc:385] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.100471 14289 leader_election.cc:290] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:51.102041 14229 tablet_bootstrap.cc:654] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.102394 14287 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.103029 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:51.106508 14148 leader_election.cc:304] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.106987 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.108289 14290 raft_consensus.cc:2804] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.108932 14290 raft_consensus.cc:697] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
W20260501 14:01:51.109364 14149 leader_election.cc:343] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.110049 14290 consensus_queue.cc:237] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.109416 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.113458 14109 raft_consensus.cc:2468] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:51.113847 14032 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:51.114265 14287 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.096927 14227 raft_consensus.cc:740] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.117422 14227 consensus_queue.cc:260] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.124658 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.124943 14293 leader_election.cc:290] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:51.125423 14109 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:51.126914 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.127576 14179 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:51.128731 14001 leader_election.cc:304] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:51.128306 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.131978 14148 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.132001 14293 raft_consensus.cc:2804] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.139629 14289 raft_consensus.cc:2804] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.139993 14293 raft_consensus.cc:493] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.140213 14289 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.140422 14293 raft_consensus.cc:3060] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.140782 14289 raft_consensus.cc:3060] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.152516 14357 consensus_queue.cc:1048] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.154143 14231 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:51.154752 14231 ts_tablet_manager.cc:1403] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.107s	user 0.037s	sys 0.027s
I20260501 14:01:51.135922 14227 ts_tablet_manager.cc:1434] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260501 14:01:51.130918 14108 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:51.157877 14148 leader_election.cc:304] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:51.158366 14231 raft_consensus.cc:359] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.158880 14295 raft_consensus.cc:2804] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.159118 14231 raft_consensus.cc:385] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.159298 14295 raft_consensus.cc:493] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.159459 14231 raft_consensus.cc:740] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.159729 14295 raft_consensus.cc:3060] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.160341 14231 consensus_queue.cc:260] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.162277 14231 ts_tablet_manager.cc:1434] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 14:01:51.163232 14231 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:51.169833 14231 tablet_bootstrap.cc:654] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.173583 14227 tablet_bootstrap.cc:492] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:51.193068 13956 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.198779 14289 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.213117 14285 raft_consensus.cc:493] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dba449c6af0341daa28866a4fd46cd96)
I20260501 14:01:51.214610 14285 raft_consensus.cc:515] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.218207 14285 leader_election.cc:290] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:51.219329 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265e96f503c4b65adaa438fe44216d7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:51.212425 14420 raft_consensus.cc:493] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.223953 14420 raft_consensus.cc:515] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.226656 14420 leader_election.cc:290] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:51.230016 14228 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:51.230599 14228 ts_tablet_manager.cc:1403] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.239s	user 0.009s	sys 0.010s
I20260501 14:01:51.231314 14423 consensus_queue.cc:1048] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.240583 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.241345 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265e96f503c4b65adaa438fe44216d7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.246451 13926 leader_election.cc:304] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:51.239528 14293 raft_consensus.cc:515] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.247368 14423 raft_consensus.cc:2749] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:51.249886 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.250685 14108 raft_consensus.cc:2468] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:51.231253 14295 raft_consensus.cc:515] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.247512 14228 raft_consensus.cc:359] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.254626 14423 consensus_queue.cc:1048] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:51.241406 13960 raft_consensus.cc:2468] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:51.258657 14001 leader_election.cc:304] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:51.259940 14339 raft_consensus.cc:2804] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.260438 14339 raft_consensus.cc:493] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.260880 14339 raft_consensus.cc:3060] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.271131 14229 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:51.271802 14229 ts_tablet_manager.cc:1403] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.183s	user 0.026s	sys 0.035s
I20260501 14:01:51.272665 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:51.273396 14109 raft_consensus.cc:3060] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.274905 14229 raft_consensus.cc:359] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.278242 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:51.279764 14405 raft_consensus.cc:493] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.275669 14229 raft_consensus.cc:385] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.271174 14295 leader_election.cc:290] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:51.280364 14405 raft_consensus.cc:515] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.280397 14229 raft_consensus.cc:740] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.281164 14293 leader_election.cc:290] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:51.281935 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:51.282009 14229 consensus_queue.cc:260] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.282994 14183 raft_consensus.cc:2393] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:51.283703 14405 leader_election.cc:290] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:51.284874 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:51.285235 14001 leader_election.cc:304] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:51.285429 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.286839 14032 raft_consensus.cc:2468] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
W20260501 14:01:51.287926 14075 leader_election.cc:343] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.288642 14074 leader_election.cc:304] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.290022 14404 raft_consensus.cc:2804] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.290315 14289 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.290493 14404 raft_consensus.cc:493] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.290539 14405 raft_consensus.cc:493] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.291069 14404 raft_consensus.cc:3060] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.291436 14405 raft_consensus.cc:515] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.292364 14227 tablet_bootstrap.cc:654] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.292886 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:51.293553 14107 raft_consensus.cc:3060] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.293694 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:51.295073 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6f8feaeaa4b79b89a164e7d98c53b" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.253834 14228 raft_consensus.cc:385] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260501 14:01:51.295702 14149 leader_election.cc:343] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.296144 14228 raft_consensus.cc:740] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.294008 14405 leader_election.cc:290] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.286026 14229 ts_tablet_manager.cc:1434] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260501 14:01:51.296943 14228 consensus_queue.cc:260] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.295230 13857 catalog_manager.cc:5671] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:51.313962 14229 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
W20260501 14:01:51.297107 14075 leader_election.cc:343] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.311012 14293 raft_consensus.cc:2749] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:51.283294 14339 raft_consensus.cc:515] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.338927 14231 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:51.339789 14231 ts_tablet_manager.cc:1403] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.177s	user 0.018s	sys 0.009s
I20260501 14:01:51.318341 14420 raft_consensus.cc:493] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.344390 14228 ts_tablet_manager.cc:1434] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.114s	user 0.011s	sys 0.000s
I20260501 14:01:51.349326 14228 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:51.345129 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6f8feaeaa4b79b89a164e7d98c53b" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.354709 14183 raft_consensus.cc:2468] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:51.360688 14109 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:51.346714 14420 raft_consensus.cc:515] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.351207 14285 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:51.364856 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:51.365003 14285 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.365880 14420 leader_election.cc:290] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.366922 14285 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:51.368816 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.369724 13960 raft_consensus.cc:2393] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:51.369853 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:51.372675 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.373070 14473 consensus_queue.cc:1048] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:51.373354 14179 raft_consensus.cc:2468] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
W20260501 14:01:51.375043 13925 leader_election.cc:343] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.369915 14075 leader_election.cc:304] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.376861 13926 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:51.377792 14436 raft_consensus.cc:2804] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.378168 14436 raft_consensus.cc:493] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.378520 14436 raft_consensus.cc:3060] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.378937 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.380102 14423 raft_consensus.cc:2804] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.380512 14423 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.380846 14423 raft_consensus.cc:3060] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.381397 14404 raft_consensus.cc:515] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.396016 14001 leader_election.cc:304] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.397068 14475 raft_consensus.cc:3060] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.384681 14148 leader_election.cc:304] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:51.399768 14295 raft_consensus.cc:2804] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.400619 14295 raft_consensus.cc:697] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:51.402241 14295 consensus_queue.cc:237] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.403015 14231 raft_consensus.cc:359] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.404459 14231 raft_consensus.cc:385] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.404747 14231 raft_consensus.cc:740] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.405484 14231 consensus_queue.cc:260] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.446002 14231 ts_tablet_manager.cc:1434] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.003s
I20260501 14:01:51.424490 14423 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.450157 14231 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:51.438223 14107 raft_consensus.cc:2468] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:51.444219 14404 leader_election.cc:290] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:51.458712 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:51.453619 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:51.461182 14033 raft_consensus.cc:2393] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:51.468657 14227 tablet_bootstrap.cc:492] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:51.469223 14231 tablet_bootstrap.cc:654] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.469357 14227 ts_tablet_manager.cc:1403] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.296s	user 0.019s	sys 0.009s
I20260501 14:01:51.470055 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:51.470810 14109 raft_consensus.cc:3060] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:51.473505 14075 leader_election.cc:343] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.477705 14227 raft_consensus.cc:359] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.479233 14227 raft_consensus.cc:385] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.479663 14227 raft_consensus.cc:740] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.483705 14227 consensus_queue.cc:260] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.487193 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:51.487627 14148 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.488204 13958 raft_consensus.cc:3060] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.488754 14289 raft_consensus.cc:2804] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.489289 14289 raft_consensus.cc:697] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:51.490248 14289 consensus_queue.cc:237] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
W20260501 14:01:51.500490 14478 log.cc:927] Time spent T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260501 14:01:51.500655 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:51.501449 14181 raft_consensus.cc:3060] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.501703 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:51.502557 14033 raft_consensus.cc:3060] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:51.504478 14477 log.cc:927] Time spent T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260501 14:01:51.480504 14339 leader_election.cc:290] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:51.508611 14227 ts_tablet_manager.cc:1434] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260501 14:01:51.510707 14227 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:51.515973 14231 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:51.516536 14231 ts_tablet_manager.cc:1403] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.022s
I20260501 14:01:51.519763 14227 tablet_bootstrap.cc:654] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.503400 14436 raft_consensus.cc:515] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.528087 14229 tablet_bootstrap.cc:654] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.537698 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:51.538486 14034 raft_consensus.cc:3060] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:51.546754 14476 log.cc:927] Time spent T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260501 14:01:51.547341 14231 raft_consensus.cc:359] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.548702 14231 raft_consensus.cc:385] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.548990 14231 raft_consensus.cc:740] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.550943 14231 consensus_queue.cc:260] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.511991 14423 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:51.547973 14033 raft_consensus.cc:2468] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:51.562011 14231 ts_tablet_manager.cc:1434] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260501 14:01:51.563536 14231 tablet_bootstrap.cc:492] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:51.575503 14281 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6f0deb8c1e1415693f8ab2ca413688d)
I20260501 14:01:51.579129 14436 leader_election.cc:290] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.589005 14228 tablet_bootstrap.cc:654] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.600311 14034 raft_consensus.cc:2468] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:51.579630 14281 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.588878 14109 raft_consensus.cc:2468] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:51.579144 14181 raft_consensus.cc:2468] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:51.610220 14475 raft_consensus.cc:2749] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:51.615510 13926 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:51.620483 14229 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:51.621130 14229 ts_tablet_manager.cc:1403] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.010s
I20260501 14:01:51.620973 13958 raft_consensus.cc:2468] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:51.622146 14482 raft_consensus.cc:2804] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.620543 14074 leader_election.cc:304] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.624969 14001 leader_election.cc:304] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:51.647214 14229 raft_consensus.cc:359] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.648293 14229 raft_consensus.cc:385] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.648644 14229 raft_consensus.cc:740] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.649277 14229 consensus_queue.cc:260] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.634832 13854 catalog_manager.cc:5671] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:51.653890 14229 ts_tablet_manager.cc:1434] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260501 14:01:51.647651 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6f8feaeaa4b79b89a164e7d98c53b" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
W20260501 14:01:51.648221 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 111621us
I20260501 14:01:51.647374 14404 raft_consensus.cc:2804] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.652225 14475 raft_consensus.cc:2804] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.670053 14482 raft_consensus.cc:697] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:51.672443 14281 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:51.676492 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.662482 14404 raft_consensus.cc:697] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:51.678738 14404 consensus_queue.cc:237] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.680490 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6f8feaeaa4b79b89a164e7d98c53b" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:51.681185 14181 raft_consensus.cc:3060] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.683297 14231 tablet_bootstrap.cc:654] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:51.700834 14075 leader_election.cc:343] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.705080 14229 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:51.671170 14482 consensus_queue.cc:237] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.718473 14227 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:51.719110 14227 ts_tablet_manager.cc:1403] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.007s
I20260501 14:01:51.720638 14473 consensus_queue.cc:1048] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:51.731854 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.735078 14473 consensus_queue.cc:1048] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.737425 14227 raft_consensus.cc:359] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.737979 13959 raft_consensus.cc:3060] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.738226 14227 raft_consensus.cc:385] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.738610 14227 raft_consensus.cc:740] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.739279 14227 consensus_queue.cc:260] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.742106 14228 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:51.742656 14228 ts_tablet_manager.cc:1403] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.396s	user 0.021s	sys 0.020s
I20260501 14:01:51.745586 14227 ts_tablet_manager.cc:1434] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260501 14:01:51.746357 14231 tablet_bootstrap.cc:492] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:51.746712 14227 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:51.746994 14231 ts_tablet_manager.cc:1403] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.004s
I20260501 14:01:51.750172 14231 raft_consensus.cc:359] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.750880 14231 raft_consensus.cc:385] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.751147 14231 raft_consensus.cc:740] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.729182 14475 raft_consensus.cc:697] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:51.754057 14475 consensus_queue.cc:237] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.754694 14228 raft_consensus.cc:359] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.755581 14228 raft_consensus.cc:385] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.755939 14228 raft_consensus.cc:740] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.757014 14228 consensus_queue.cc:260] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.757213 13854 catalog_manager.cc:5671] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:51.757082 14231 consensus_queue.cc:260] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.769168 14231 ts_tablet_manager.cc:1434] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260501 14:01:51.770748 14231 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:51.776117 14228 ts_tablet_manager.cc:1434] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260501 14:01:51.782460 14229 tablet_bootstrap.cc:654] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.785772 14228 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:51.785552 13858 catalog_manager.cc:5671] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:51.788079 14281 raft_consensus.cc:493] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.764397 13925 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:51.794720 14231 tablet_bootstrap.cc:654] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.789376 14281 raft_consensus.cc:515] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.791651 14495 raft_consensus.cc:2749] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:51.789501 14181 raft_consensus.cc:2468] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
W20260501 14:01:51.799780 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 43801.2us
I20260501 14:01:51.813596 14281 leader_election.cc:290] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:51.823462 14489 consensus_queue.cc:1048] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.815645 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.828013 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156db7c0cd944eda5eebd2ee3275d8e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.833666 14228 tablet_bootstrap.cc:654] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.839083 14075 leader_election.cc:304] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.818818 14227 tablet_bootstrap.cc:654] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:51.841209 14436 raft_consensus.cc:2804] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:51.841789 14436 raft_consensus.cc:697] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:51.842645 14436 consensus_queue.cc:237] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.826854 14497 raft_consensus.cc:493] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.845252 14497 raft_consensus.cc:515] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.851002 14497 leader_election.cc:290] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:51.852406 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b961c5d58c420495fd18f163645f47" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:51.853858 14109 raft_consensus.cc:2468] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:51.855284 14000 leader_election.cc:304] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:01:51.858158 14496 raft_consensus.cc:2804] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.858553 14496 raft_consensus.cc:493] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.858323 13925 leader_election.cc:304] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:51.859162 14496 raft_consensus.cc:3060] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.866281 14339 raft_consensus.cc:493] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.866969 14339 raft_consensus.cc:515] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.826854 13855 catalog_manager.cc:5671] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:51.870906 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f959d4d3d985474291a0b7bf62481690" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.871680 14181 raft_consensus.cc:2468] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:51.872836 14339 leader_election.cc:290] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.875370 14001 leader_election.cc:304] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:51.876170 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f959d4d3d985474291a0b7bf62481690" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.876935 14474 raft_consensus.cc:2804] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:51.877509 14474 raft_consensus.cc:493] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:51.877959 14474 raft_consensus.cc:3060] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:51.877969 14001 leader_election.cc:343] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.883157 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b961c5d58c420495fd18f163645f47" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:51.887080 14001 leader_election.cc:343] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.900488 14495 raft_consensus.cc:2749] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:51.905326 14489 consensus_queue.cc:1048] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.918686 14229 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:51.919265 14229 ts_tablet_manager.cc:1403] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.214s	user 0.016s	sys 0.037s
I20260501 14:01:51.922384 14229 raft_consensus.cc:359] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.926329 14229 raft_consensus.cc:385] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.926704 14229 raft_consensus.cc:740] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.925462 14496 raft_consensus.cc:515] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:51.929261 14496 leader_election.cc:290] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:51.927428 14229 consensus_queue.cc:260] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.938812 14295 consensus_queue.cc:1048] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:51.946784 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b961c5d58c420495fd18f163645f47" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:51.947625 14109 raft_consensus.cc:3060] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:51.960278 14227 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:51.960950 14227 ts_tablet_manager.cc:1403] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.012s
I20260501 14:01:51.967542 14357 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:51.969601 14357 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:51.972034 14357 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:51.974236 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:51.974701 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:51.957023 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b961c5d58c420495fd18f163645f47" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:51.976024 14075 leader_election.cc:343] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:51.977008 14001 leader_election.cc:343] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:51.977632 14075 leader_election.cc:343] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:51.978322 14075 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:51.979964 14357 raft_consensus.cc:2749] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:51.983729 14474 raft_consensus.cc:515] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:51.988771 14227 raft_consensus.cc:359] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.989604 14227 raft_consensus.cc:385] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:51.989890 14227 raft_consensus.cc:740] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:51.990713 14227 consensus_queue.cc:260] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:51.992563 14229 ts_tablet_manager.cc:1434] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.005s
I20260501 14:01:52.000727 14229 tablet_bootstrap.cc:492] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:52.007745 14489 consensus_queue.cc:1048] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:52.008541 14227 ts_tablet_manager.cc:1434] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260501 14:01:52.009624 14227 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:52.006697 14109 raft_consensus.cc:2468] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:52.020418 14000 leader_election.cc:304] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:52.021391 14496 raft_consensus.cc:2804] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:52.021988 14496 raft_consensus.cc:697] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:52.022891 13854 catalog_manager.cc:5671] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:52.026726 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f959d4d3d985474291a0b7bf62481690" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:52.026886 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f959d4d3d985474291a0b7bf62481690" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:52.027449 14182 raft_consensus.cc:3060] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.029541 14227 tablet_bootstrap.cc:654] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:52.030511 14001 leader_election.cc:343] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.019797 14231 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:52.024819 14228 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:52.036417 14228 ts_tablet_manager.cc:1403] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.259s	user 0.029s	sys 0.039s
I20260501 14:01:52.039610 14228 raft_consensus.cc:359] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.040915 14228 raft_consensus.cc:385] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.041220 14228 raft_consensus.cc:740] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.042039 14228 consensus_queue.cc:260] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.045179 14231 ts_tablet_manager.cc:1403] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.275s	user 0.033s	sys 0.017s
I20260501 14:01:52.049304 14228 ts_tablet_manager.cc:1434] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260501 14:01:52.025285 14474 leader_election.cc:290] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:52.022914 14496 consensus_queue.cc:237] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.052994 14182 raft_consensus.cc:2468] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:52.053678 14228 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:52.055534 14001 leader_election.cc:304] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:52.053946 14231 raft_consensus.cc:359] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.057479 14474 raft_consensus.cc:2804] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:52.057343 14231 raft_consensus.cc:385] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.058091 14231 raft_consensus.cc:740] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.060418 14474 raft_consensus.cc:697] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:52.060185 14231 consensus_queue.cc:260] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.061632 14474 consensus_queue.cc:237] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.067039 14495 raft_consensus.cc:493] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.067836 14495 raft_consensus.cc:515] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.073133 14228 tablet_bootstrap.cc:654] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.082779 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f959d4d3d985474291a0b7bf62481690" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:52.083683 14495 leader_election.cc:290] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:52.084342 14182 raft_consensus.cc:2393] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:52.063730 14231 ts_tablet_manager.cc:1434] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260501 14:01:52.085928 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f959d4d3d985474291a0b7bf62481690" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:52.086544 13956 raft_consensus.cc:3060] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.088007 14231 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:52.071247 13855 catalog_manager.cc:5671] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:52.096139 13926 leader_election.cc:304] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:52.102298 14228 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:52.144248 14229 tablet_bootstrap.cc:654] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.206466 14228 ts_tablet_manager.cc:1403] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.155s	user 0.037s	sys 0.046s
I20260501 14:01:52.202786 14496 consensus_queue.cc:1048] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260501 14:01:52.115422 14436 raft_consensus.cc:493] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.191883 14474 raft_consensus.cc:493] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.105016 14281 raft_consensus.cc:3060] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.209105 14474 raft_consensus.cc:515] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.150864 14404 consensus_queue.cc:1048] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260501 14:01:52.210357 14228 raft_consensus.cc:359] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.211131 14228 raft_consensus.cc:385] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.102499 14231 tablet_bootstrap.cc:654] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.208360 14436 raft_consensus.cc:515] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.203657 14227 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:52.163241 14287 consensus_queue.cc:1048] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260501 14:01:52.212065 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c851785bc2fd4764ab766fd38f7597dc" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:52.215063 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c851785bc2fd4764ab766fd38f7597dc" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:52.215854 14227 ts_tablet_manager.cc:1403] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.206s	user 0.056s	sys 0.071s
W20260501 14:01:52.217025 14001 leader_election.cc:343] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.215142 14474 leader_election.cc:290] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:52.211396 14228 raft_consensus.cc:740] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
W20260501 14:01:52.218025 14000 leader_election.cc:343] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.223361 14000 leader_election.cc:304] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:52.161355 14495 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.224566 14227 raft_consensus.cc:359] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.225747 14228 consensus_queue.cc:260] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.227131 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6afe227fa3478280adc659a49382f0" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:52.224486 14495 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.224730 14496 raft_consensus.cc:2749] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:52.173540 14482 consensus_queue.cc:1048] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260501 14:01:52.229697 14228 ts_tablet_manager.cc:1434] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
W20260501 14:01:52.230338 14074 leader_election.cc:343] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.231261 14228 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:52.228139 14436 leader_election.cc:290] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:52.225296 14227 raft_consensus.cc:385] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.236865 14227 raft_consensus.cc:740] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.237607 14227 consensus_queue.cc:260] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.237905 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:52.242726 14495 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:52.243984 14228 tablet_bootstrap.cc:654] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.253691 14227 ts_tablet_manager.cc:1434] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260501 14:01:52.254107 14231 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:52.255447 14231 ts_tablet_manager.cc:1403] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.168s	user 0.008s	sys 0.014s
I20260501 14:01:52.255733 14227 tablet_bootstrap.cc:492] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:52.262169 14229 tablet_bootstrap.cc:492] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:52.262748 14229 ts_tablet_manager.cc:1403] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.262s	user 0.011s	sys 0.026s
I20260501 14:01:52.264140 14281 raft_consensus.cc:2749] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:52.266968 14227 tablet_bootstrap.cc:654] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.272639 14229 raft_consensus.cc:359] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.284475 14229 raft_consensus.cc:385] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.283615 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:52.253625 14495 raft_consensus.cc:493] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.292514 14490 raft_consensus.cc:493] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.294919 14490 raft_consensus.cc:515] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.295951 14229 raft_consensus.cc:740] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.297003 14490 leader_election.cc:290] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:52.296784 14229 consensus_queue.cc:260] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.297739 14495 raft_consensus.cc:515] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.283174 14497 consensus_queue.cc:1048] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:52.298796 13958 raft_consensus.cc:3060] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.300606 14229 ts_tablet_manager.cc:1434] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260501 14:01:52.310127 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6afe227fa3478280adc659a49382f0" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:52.312868 14228 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:52.313419 14228 ts_tablet_manager.cc:1403] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.003s
I20260501 14:01:52.316494 14228 raft_consensus.cc:359] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.316891 14482 consensus_queue.cc:1048] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:52.317209 14228 raft_consensus.cc:385] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.317564 14228 raft_consensus.cc:740] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.293545 14231 raft_consensus.cc:359] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.318161 14231 raft_consensus.cc:385] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.319033 14231 raft_consensus.cc:740] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.319837 14231 consensus_queue.cc:260] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.317739 14495 leader_election.cc:290] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:52.320613 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:52.321305 14032 raft_consensus.cc:2468] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:52.324715 14148 leader_election.cc:304] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:52.326249 14295 raft_consensus.cc:2804] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:52.326745 14295 raft_consensus.cc:493] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:52.327162 14295 raft_consensus.cc:3060] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.334313 13925 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:52.335137 14228 consensus_queue.cc:260] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
W20260501 14:01:52.337472 14075 leader_election.cc:343] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.338013 14075 leader_election.cc:304] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:52.336370 14495 raft_consensus.cc:2749] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:52.339195 14404 raft_consensus.cc:2749] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:52.340566 14228 ts_tablet_manager.cc:1434] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260501 14:01:52.341701 14228 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:52.341464 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:52.342132 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:52.345361 14231 ts_tablet_manager.cc:1434] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260501 14:01:52.346524 14231 tablet_bootstrap.cc:492] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:52.348925 14228 tablet_bootstrap.cc:654] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.358430 14229 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:52.380950 14281 raft_consensus.cc:493] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.389217 14281 raft_consensus.cc:515] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.393152 14281 leader_election.cc:290] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:52.437273 14231 tablet_bootstrap.cc:654] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.443168 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6f8feaeaa4b79b89a164e7d98c53b" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:52.444586 14228 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:52.445171 14228 ts_tablet_manager.cc:1403] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.002s
I20260501 14:01:52.445330 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:52.444600 14179 raft_consensus.cc:2393] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:52.451232 14228 raft_consensus.cc:359] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.451872 14228 raft_consensus.cc:385] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.452142 14228 raft_consensus.cc:740] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.452780 14228 consensus_queue.cc:260] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.454486 14228 ts_tablet_manager.cc:1434] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260501 14:01:52.464764 14404 consensus_queue.cc:1048] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:52.468264 14228 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:52.468816 13925 leader_election.cc:304] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:52.469805 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6f8feaeaa4b79b89a164e7d98c53b" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:52.471455 14281 raft_consensus.cc:2749] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 14:01:52.473430 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 105218us
W20260501 14:01:52.474870 14149 leader_election.cc:343] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.481863 13958 raft_consensus.cc:3060] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.490458 14497 consensus_queue.cc:1048] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:52.492632 14404 consensus_queue.cc:1048] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:52.494583 14228 tablet_bootstrap.cc:654] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:52.520408 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 44555.5us
I20260501 14:01:52.522873 14231 tablet_bootstrap.cc:492] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:52.523420 14231 ts_tablet_manager.cc:1403] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.006s
I20260501 14:01:52.524550 14404 consensus_queue.cc:1048] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:52.527245 14231 raft_consensus.cc:359] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.528069 14231 raft_consensus.cc:385] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.528324 14231 raft_consensus.cc:740] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.528975 14231 consensus_queue.cc:260] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.533133 14231 ts_tablet_manager.cc:1434] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260501 14:01:52.533948 14231 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:52.540583 14228 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:52.541188 14228 ts_tablet_manager.cc:1403] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.003s
I20260501 14:01:52.548298 13858 catalog_manager.cc:5671] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:52.550983 14228 raft_consensus.cc:359] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.556244 14228 raft_consensus.cc:385] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.556648 14228 raft_consensus.cc:740] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.557545 14228 consensus_queue.cc:260] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.561111 14228 ts_tablet_manager.cc:1434] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260501 14:01:52.559537 14231 tablet_bootstrap.cc:654] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.563176 14228 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:52.572511 14229 tablet_bootstrap.cc:654] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.575420 14497 consensus_queue.cc:1048] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:52.586133 14490 raft_consensus.cc:493] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.551470 13858 catalog_manager.cc:5671] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:52.598824 14228 tablet_bootstrap.cc:654] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.637527 14227 tablet_bootstrap.cc:492] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:52.638325 14227 ts_tablet_manager.cc:1403] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.383s	user 0.144s	sys 0.161s
I20260501 14:01:52.640849 14229 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:52.641515 14229 ts_tablet_manager.cc:1403] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.283s	user 0.038s	sys 0.023s
I20260501 14:01:52.641757 14231 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:52.642342 14231 ts_tablet_manager.cc:1403] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.109s	user 0.030s	sys 0.008s
I20260501 14:01:52.559564 14295 raft_consensus.cc:515] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.644937 14295 leader_election.cc:290] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:52.647349 14229 raft_consensus.cc:359] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.648139 14229 raft_consensus.cc:385] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.648412 14229 raft_consensus.cc:740] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
W20260501 14:01:52.650079 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:52.650306 14405 raft_consensus.cc:493] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.650799 14405 raft_consensus.cc:515] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.652531 14405 leader_election.cc:290] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:52.654450 14227 raft_consensus.cc:359] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.656320 14227 raft_consensus.cc:385] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.656594 14227 raft_consensus.cc:740] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.657326 14227 consensus_queue.cc:260] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.659624 14227 ts_tablet_manager.cc:1434] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260501 14:01:52.660853 14227 tablet_bootstrap.cc:492] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:52.674607 14231 raft_consensus.cc:359] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.675311 14231 raft_consensus.cc:385] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.675587 14231 raft_consensus.cc:740] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.664673 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c851785bc2fd4764ab766fd38f7597dc" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:52.679864 13954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:52.586751 14490 raft_consensus.cc:515] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.676309 14231 consensus_queue.cc:260] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.684777 14229 consensus_queue.cc:260] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.690126 14497 raft_consensus.cc:493] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.690665 14497 raft_consensus.cc:515] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:52.713146 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:52.714205 14034 raft_consensus.cc:3060] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.714700 14490 leader_election.cc:290] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:52.715929 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b961c5d58c420495fd18f163645f47" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:52.720036 14182 raft_consensus.cc:3060] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.731015 14497 leader_election.cc:290] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:52.698138 13958 raft_consensus.cc:2468] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:52.734561 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6afe227fa3478280adc659a49382f0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:52.734766 14482 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.735445 14482 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
W20260501 14:01:52.736579 14001 leader_election.cc:343] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.677898 14496 raft_consensus.cc:493] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.738598 14496 raft_consensus.cc:515] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.740728 14496 leader_election.cc:290] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:52.742009 14034 raft_consensus.cc:2468] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:52.743112 14229 ts_tablet_manager.cc:1434] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.101s	user 0.010s	sys 0.000s
I20260501 14:01:52.744287 14229 tablet_bootstrap.cc:492] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:52.744642 14148 leader_election.cc:304] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:52.745659 14287 raft_consensus.cc:2804] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:52.746225 14287 raft_consensus.cc:697] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:52.747210 14287 consensus_queue.cc:237] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.709928 13925 leader_election.cc:304] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:52.751356 14229 tablet_bootstrap.cc:654] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.753469 14495 raft_consensus.cc:2749] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:52.755160 14075 leader_election.cc:304] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:52.762902 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:52.763240 14528 raft_consensus.cc:2804] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 14:01:52.765163 14001 leader_election.cc:343] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.765677 14528 raft_consensus.cc:493] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:52.770874 14528 raft_consensus.cc:3060] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:52.777195 14528 raft_consensus.cc:515] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:52.760039 14149 leader_election.cc:343] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:52.781013 14482 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:52.783640 14528 leader_election.cc:290] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:52.786214 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b961c5d58c420495fd18f163645f47" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:52.787159 14107 raft_consensus.cc:2393] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:52.788326 14227 tablet_bootstrap.cc:654] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.793051 14228 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:52.793726 14228 ts_tablet_manager.cc:1403] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.232s	user 0.047s	sys 0.044s
I20260501 14:01:52.797727 14231 ts_tablet_manager.cc:1434] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.155s	user 0.021s	sys 0.006s
I20260501 14:01:52.800530 14231 tablet_bootstrap.cc:492] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:52.871752 13957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c851785bc2fd4764ab766fd38f7597dc" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:52.881127 13957 raft_consensus.cc:3060] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:52.898113 14544 log.cc:927] Time spent T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260501 14:01:52.902882 14227 tablet_bootstrap.cc:492] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:52.904364 14227 ts_tablet_manager.cc:1403] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.244s	user 0.008s	sys 0.012s
I20260501 14:01:52.895476 14490 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.934176 14490 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:52.938058 14490 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:52.951895 14547 raft_consensus.cc:493] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:52.953083 14547 raft_consensus.cc:515] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.957782 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:52.958228 14547 leader_election.cc:290] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:52.958949 14179 raft_consensus.cc:2468] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:52.975549 14231 tablet_bootstrap.cc:654] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:52.993635 14228 raft_consensus.cc:359] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:52.995294 14228 raft_consensus.cc:385] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.995709 14228 raft_consensus.cc:740] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:52.993477 14227 raft_consensus.cc:359] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:52.998736 14227 raft_consensus.cc:385] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:52.999055 14227 raft_consensus.cc:740] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.003059 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:53.004091 14228 consensus_queue.cc:260] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:53.005530 14075 leader_election.cc:343] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.010633 13926 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:53.021005 14229 tablet_bootstrap.cc:492] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:53.022076 14229 ts_tablet_manager.cc:1403] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.278s	user 0.026s	sys 0.032s
I20260501 14:01:53.033352 14487 raft_consensus.cc:2804] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.034041 14487 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.034408 14487 raft_consensus.cc:3060] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.036424 13957 raft_consensus.cc:2468] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:53.038407 14075 leader_election.cc:304] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:53.039909 14547 raft_consensus.cc:2804] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:53.040627 14547 raft_consensus.cc:697] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:53.042073 14547 consensus_queue.cc:237] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.042661 14227 consensus_queue.cc:260] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.063231 14228 ts_tablet_manager.cc:1434] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.269s	user 0.010s	sys 0.005s
I20260501 14:01:53.071367 14228 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:01:53.091660 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 64904.6us
I20260501 14:01:53.117245 14227 ts_tablet_manager.cc:1434] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.212s	user 0.008s	sys 0.004s
W20260501 14:01:53.118005 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 219158us
I20260501 14:01:53.119537 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:53.151063 14231 tablet_bootstrap.cc:492] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:53.152096 14231 ts_tablet_manager.cc:1403] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.353s	user 0.033s	sys 0.010s
I20260501 14:01:53.166496 14229 raft_consensus.cc:359] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.167106 14228 tablet_bootstrap.cc:654] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.167423 14229 raft_consensus.cc:385] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.167788 14229 raft_consensus.cc:740] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.155799 14231 raft_consensus.cc:359] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.171271 14231 raft_consensus.cc:385] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.171613 14231 raft_consensus.cc:740] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.175678 14231 consensus_queue.cc:260] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.178401 14229 consensus_queue.cc:260] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.181879 14229 ts_tablet_manager.cc:1434] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.086s	user 0.003s	sys 0.007s
I20260501 14:01:53.181267 13854 catalog_manager.cc:5671] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:53.183171 14231 ts_tablet_manager.cc:1434] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260501 14:01:53.183404 14229 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:53.184877 14231 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:53.187240 14227 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:53.188228 13958 raft_consensus.cc:3060] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.190814 14487 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.192152 13956 raft_consensus.cc:2393] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:53.194552 14231 tablet_bootstrap.cc:654] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.203914 14287 consensus_queue.cc:1048] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:53.203751 14542 consensus_queue.cc:1048] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 14:01:53.209789 14227 tablet_bootstrap.cc:654] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.213358 14487 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.215405 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.216439 14108 raft_consensus.cc:2468] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:53.216841 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:53.217547 14182 raft_consensus.cc:3060] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.219406 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:53.223269 14106 raft_consensus.cc:3060] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.222661 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6afe227fa3478280adc659a49382f0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.225324 14108 raft_consensus.cc:2468] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:53.232497 14228 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:53.233158 14228 ts_tablet_manager.cc:1403] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.162s	user 0.007s	sys 0.012s
I20260501 14:01:53.233188 14287 consensus_queue.cc:1048] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:53.234648 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.235595 14108 raft_consensus.cc:2468] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:53.238013 14229 tablet_bootstrap.cc:654] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.239180 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c851785bc2fd4764ab766fd38f7597dc" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:53.240109 14032 raft_consensus.cc:2468] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:53.240227 13857 catalog_manager.cc:5671] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:53.240927 14182 raft_consensus.cc:2468] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:53.243477 13926 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:53.244994 14281 raft_consensus.cc:2804] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:53.245319 14106 raft_consensus.cc:2468] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:53.245616 14281 raft_consensus.cc:697] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:53.246769 14281 consensus_queue.cc:237] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.247207 14496 consensus_queue.cc:1048] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:53.252563 14228 raft_consensus.cc:359] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.253400 14228 raft_consensus.cc:385] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.253731 14228 raft_consensus.cc:740] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.257043 14228 consensus_queue.cc:260] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.279137 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c851785bc2fd4764ab766fd38f7597dc" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:53.279942 14032 raft_consensus.cc:3060] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.281404 14148 leader_election.cc:304] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:53.282994 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:53.283761 14031 raft_consensus.cc:2468] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:53.284585 14490 raft_consensus.cc:2749] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.289588 14229 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:53.290351 14229 ts_tablet_manager.cc:1403] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.107s	user 0.004s	sys 0.013s
I20260501 14:01:53.306128 14000 leader_election.cc:304] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:53.307731 14474 raft_consensus.cc:2804] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.308174 14474 raft_consensus.cc:493] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.308532 14474 raft_consensus.cc:3060] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.320456 14231 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:53.321200 14231 ts_tablet_manager.cc:1403] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.009s
I20260501 14:01:53.324378 14000 leader_election.cc:304] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:53.326105 14496 raft_consensus.cc:2804] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.326499 14496 raft_consensus.cc:493] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.326910 14496 raft_consensus.cc:3060] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.328464 14227 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:53.329092 14227 ts_tablet_manager.cc:1403] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.004s
I20260501 14:01:53.335080 14227 raft_consensus.cc:359] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.335954 14227 raft_consensus.cc:385] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.336280 14227 raft_consensus.cc:740] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.336982 14227 consensus_queue.cc:260] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.339059 14227 ts_tablet_manager.cc:1434] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260501 14:01:53.315877 14032 raft_consensus.cc:2468] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:53.348631 13854 catalog_manager.cc:5671] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:53.358937 14228 ts_tablet_manager.cc:1434] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.002s
I20260501 14:01:53.362341 14231 raft_consensus.cc:359] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.363343 14231 raft_consensus.cc:385] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.363741 14231 raft_consensus.cc:740] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.364862 14231 consensus_queue.cc:260] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.364238 14474 raft_consensus.cc:515] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.369347 14231 ts_tablet_manager.cc:1434] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260501 14:01:53.370782 14228 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:53.372905 14474 leader_election.cc:290] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:53.376722 13957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6afe227fa3478280adc659a49382f0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:53.377640 13957 raft_consensus.cc:3060] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.380959 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.381922 14107 raft_consensus.cc:2393] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:53.384080 14229 raft_consensus.cc:359] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.384886 14229 raft_consensus.cc:385] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.386101 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6afe227fa3478280adc659a49382f0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:53.386855 14107 raft_consensus.cc:3060] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.387624 13957 raft_consensus.cc:2468] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:53.395166 14227 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:53.395422 14496 raft_consensus.cc:515] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.385175 14229 raft_consensus.cc:740] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.398382 14001 leader_election.cc:304] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:53.398105 14229 consensus_queue.cc:260] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.401145 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:53.401942 14182 raft_consensus.cc:3060] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.402447 14231 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:53.408442 14228 tablet_bootstrap.cc:654] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.409150 14566 raft_consensus.cc:2804] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:53.410389 14074 leader_election.cc:304] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:53.412699 14231 tablet_bootstrap.cc:654] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.416939 14229 ts_tablet_manager.cc:1434] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.004s
I20260501 14:01:53.430521 14229 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:53.432264 14227 tablet_bootstrap.cc:654] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.418282 14107 raft_consensus.cc:2468] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:53.418447 14542 raft_consensus.cc:493] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:53.418071 14566 raft_consensus.cc:697] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:53.439754 14551 raft_consensus.cc:2804] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.445959 14182 raft_consensus.cc:2468] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:53.447503 14229 tablet_bootstrap.cc:654] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.398528 14496 leader_election.cc:290] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.451120 14474 raft_consensus.cc:493] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:53.443763 14551 raft_consensus.cc:493] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.459918 14231 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:53.473006 14231 ts_tablet_manager.cc:1403] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.005s
I20260501 14:01:53.438516 14542 raft_consensus.cc:515] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.462405 14405 consensus_queue.cc:1048] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:53.478562 14542 leader_election.cc:290] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:53.479326 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:53.463900 14566 consensus_queue.cc:237] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:53.465209 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 54927.3us
I20260501 14:01:53.468096 14436 raft_consensus.cc:493] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:53.475030 14474 raft_consensus.cc:515] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.476398 14551 raft_consensus.cc:3060] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.481529 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
W20260501 14:01:53.484737 14001 leader_election.cc:343] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.484752 14436 raft_consensus.cc:515] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.491080 14231 raft_consensus.cc:359] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.497162 14001 leader_election.cc:304] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:53.501055 14436 leader_election.cc:290] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.503175 14496 raft_consensus.cc:2804] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:53.503767 14496 raft_consensus.cc:697] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:53.504880 14496 consensus_queue.cc:237] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
W20260501 14:01:53.506203 14001 leader_election.cc:343] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.506817 14001 leader_election.cc:304] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:53.508276 14541 raft_consensus.cc:2749] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.508813 14474 leader_election.cc:290] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.514106 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:53.514856 14228 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:53.515419 14228 ts_tablet_manager.cc:1403] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.145s	user 0.023s	sys 0.014s
W20260501 14:01:53.516362 14001 leader_election.cc:343] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.518793 14228 raft_consensus.cc:359] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.521224 14228 raft_consensus.cc:385] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.497925 14231 raft_consensus.cc:385] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.521529 14228 raft_consensus.cc:740] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.521939 14231 raft_consensus.cc:740] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.523257 14231 consensus_queue.cc:260] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.523948 14148 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:53.522621 14228 consensus_queue.cc:260] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.525122 14490 raft_consensus.cc:2749] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.540045 14228 ts_tablet_manager.cc:1434] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260501 14:01:53.540741 14436 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:53.540951 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:53.541352 14436 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.541766 14034 raft_consensus.cc:2468] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:53.543762 14436 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:53.546871 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:53.547662 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.548403 14106 raft_consensus.cc:2468] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:53.549263 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:53.550230 14228 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:53.549280 14074 leader_election.cc:304] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:01:53.552865 14436 raft_consensus.cc:2804] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 14:01:53.552896 14075 leader_election.cc:343] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.564951 14000 leader_election.cc:304] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
W20260501 14:01:53.569490 14074 leader_election.cc:343] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.521555 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:53.566937 14541 raft_consensus.cc:2804] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.584705 14231 ts_tablet_manager.cc:1434] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.111s	user 0.011s	sys 0.000s
I20260501 14:01:53.553673 14436 raft_consensus.cc:493] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.587123 14436 raft_consensus.cc:3060] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.546983 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:53.594419 14227 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:53.595157 14227 ts_tablet_manager.cc:1403] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.200s	user 0.019s	sys 0.013s
I20260501 14:01:53.584321 14541 raft_consensus.cc:493] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.596971 14541 raft_consensus.cc:3060] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.615473 14436 raft_consensus.cc:515] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.617949 14228 tablet_bootstrap.cc:654] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.618439 14436 leader_election.cc:290] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.623001 14541 raft_consensus.cc:515] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
W20260501 14:01:53.627521 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 72617.5us
I20260501 14:01:53.629594 14074 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:53.630093 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:53.630785 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 76480.9us
W20260501 14:01:53.631717 14001 leader_election.cc:343] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.632602 14551 raft_consensus.cc:515] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:53.634814 14551 leader_election.cc:290] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.635217 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:53.636386 14109 raft_consensus.cc:2393] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:53.637316 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:53.636440 14229 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:53.639142 14229 ts_tablet_manager.cc:1403] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.209s	user 0.008s	sys 0.021s
I20260501 14:01:53.640444 14231 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
W20260501 14:01:53.643078 14075 leader_election.cc:343] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.646462 14031 raft_consensus.cc:2393] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:53.646782 14490 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:53.647356 14490 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.628257 14541 leader_election.cc:290] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.649535 14490 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:53.630800 14405 raft_consensus.cc:2749] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.656481 14550 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:53.657261 14550 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.657662 14547 consensus_queue.cc:1048] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:53.666249 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.676837 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:53.678206 14107 raft_consensus.cc:2393] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
W20260501 14:01:53.689473 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 49211us
I20260501 14:01:53.693534 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:53.694736 13960 raft_consensus.cc:2468] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:53.696681 14227 raft_consensus.cc:359] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.705451 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:53.720840 14179 raft_consensus.cc:2393] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:53.721974 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:53.714535 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:53.726727 14550 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:53.729758 14075 leader_election.cc:304] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:53.732087 14405 raft_consensus.cc:2749] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.697477 14227 raft_consensus.cc:385] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.736452 14227 raft_consensus.cc:740] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.737685 14227 consensus_queue.cc:260] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:53.745316 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:53.761982 14229 raft_consensus.cc:359] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.769879 14229 raft_consensus.cc:385] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.770181 14182 raft_consensus.cc:2468] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:53.772863 13926 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:53.770258 14229 raft_consensus.cc:740] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
W20260501 14:01:53.731539 14075 leader_election.cc:343] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:53.773859 14107 raft_consensus.cc:2468] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:53.774120 14075 leader_election.cc:304] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:53.773905 14229 consensus_queue.cc:260] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:53.776830 14550 raft_consensus.cc:2804] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.777470 14550 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.778034 14550 raft_consensus.cc:3060] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.782814 14000 leader_election.cc:304] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:53.783780 14542 raft_consensus.cc:2749] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.783893 14487 consensus_queue.cc:1048] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260501 14:01:53.794602 14075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 63117.3us
I20260501 14:01:53.779093 13856 catalog_manager.cc:5671] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:53.798153 14436 raft_consensus.cc:2749] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:53.822834 14229 ts_tablet_manager.cc:1434] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.183s	user 0.003s	sys 0.006s
I20260501 14:01:53.824502 14229 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:53.828831 14227 ts_tablet_manager.cc:1434] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.233s	user 0.009s	sys 0.001s
I20260501 14:01:53.840184 14227 tablet_bootstrap.cc:492] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
W20260501 14:01:53.862545 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 97464.8us
I20260501 14:01:53.894531 14231 tablet_bootstrap.cc:654] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.902226 14229 tablet_bootstrap.cc:654] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.915197 14148 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:53.921917 14228 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:53.922690 14228 ts_tablet_manager.cc:1403] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.373s	user 0.030s	sys 0.008s
I20260501 14:01:53.924045 14490 raft_consensus.cc:2804] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:53.924649 14490 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:53.925086 14490 raft_consensus.cc:3060] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:53.936925 14227 tablet_bootstrap.cc:654] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:53.962317 14231 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:53.963042 14231 ts_tablet_manager.cc:1403] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.335s	user 0.012s	sys 0.011s
I20260501 14:01:53.987785 14228 raft_consensus.cc:359] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.988997 14228 raft_consensus.cc:385] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:53.989351 14228 raft_consensus.cc:740] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:53.990257 14228 consensus_queue.cc:260] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:53.994315 14228 ts_tablet_manager.cc:1434] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260501 14:01:53.999264 14229 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:54.000025 14229 ts_tablet_manager.cc:1403] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.176s	user 0.029s	sys 0.017s
I20260501 14:01:54.004863 14229 raft_consensus.cc:359] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.005726 14229 raft_consensus.cc:385] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.006134 14229 raft_consensus.cc:740] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.005867 14550 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.006969 14229 consensus_queue.cc:260] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.010217 14229 ts_tablet_manager.cc:1434] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260501 14:01:54.011565 14229 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:54.011662 14231 raft_consensus.cc:359] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.012029 14474 raft_consensus.cc:493] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:54.013177 14231 raft_consensus.cc:385] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.013487 14231 raft_consensus.cc:740] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.012760 14474 raft_consensus.cc:515] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.024034 14474 leader_election.cc:290] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:54.025408 14229 tablet_bootstrap.cc:654] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.027088 14231 consensus_queue.cc:260] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.014062 14550 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:54.030977 14228 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:54.030682 14490 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.036748 14227 tablet_bootstrap.cc:492] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:54.037427 14227 ts_tablet_manager.cc:1403] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.198s	user 0.010s	sys 0.025s
I20260501 14:01:54.039305 14490 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:01:54.037238 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 345812us
I20260501 14:01:54.041496 14227 raft_consensus.cc:359] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:54.042557 14227 raft_consensus.cc:385] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.043032 14227 raft_consensus.cc:740] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.044205 14227 consensus_queue.cc:260] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:54.048158 14227 ts_tablet_manager.cc:1434] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260501 14:01:54.050413 14227 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:54.061163 14227 tablet_bootstrap.cc:654] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.080066 14229 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:54.080864 14229 ts_tablet_manager.cc:1403] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.006s
I20260501 14:01:54.084509 14231 ts_tablet_manager.cc:1434] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.121s	user 0.010s	sys 0.000s
I20260501 14:01:54.088336 14229 raft_consensus.cc:359] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.089555 14229 raft_consensus.cc:385] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.089962 14229 raft_consensus.cc:740] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.091110 14231 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:54.090848 14229 consensus_queue.cc:260] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.093832 14229 ts_tablet_manager.cc:1434] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260501 14:01:54.095139 14229 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:54.099548 14228 tablet_bootstrap.cc:654] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.127792 14231 tablet_bootstrap.cc:654] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.134581 14578 consensus_queue.cc:1048] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:54.140295 14227 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:54.141211 14227 ts_tablet_manager.cc:1403] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.012s
I20260501 14:01:54.147022 13957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:54.148451 13957 raft_consensus.cc:2393] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:54.154395 14227 raft_consensus.cc:359] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.173215 14227 raft_consensus.cc:385] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.173668 14227 raft_consensus.cc:740] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.174500 14227 consensus_queue.cc:260] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.222239 14227 ts_tablet_manager.cc:1434] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260501 14:01:54.321039 14541 raft_consensus.cc:493] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:54.322046 14541 raft_consensus.cc:515] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.329736 14541 leader_election.cc:290] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:54.447587 14227 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
W20260501 14:01:54.294301 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 82106.8us
I20260501 14:01:54.478196 14228 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:54.486909 14579 raft_consensus.cc:493] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:54.492228 14102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:54.594303 14228 ts_tablet_manager.cc:1403] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.566s	user 0.020s	sys 0.002s
I20260501 14:01:54.594388 14579 raft_consensus.cc:515] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:54.595567 14000 leader_election.cc:343] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:54.596870 14579 leader_election.cc:290] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
W20260501 14:01:54.545055 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:54.525578 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:54.598165 14106 raft_consensus.cc:3060] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:54.598167 14228 raft_consensus.cc:359] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.599314 14228 raft_consensus.cc:385] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.599785 14228 raft_consensus.cc:740] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.600569 14228 consensus_queue.cc:260] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.602471 14228 ts_tablet_manager.cc:1434] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260501 14:01:54.603933 14228 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:54.609109 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
W20260501 14:01:54.611395 14149 leader_election.cc:343] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:54.613168 14228 tablet_bootstrap.cc:654] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.618244 14106 raft_consensus.cc:2468] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:54.624305 13925 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:54.625543 14281 raft_consensus.cc:2804] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:54.626178 14281 raft_consensus.cc:697] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:54.627472 14281 consensus_queue.cc:237] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.634231 14228 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:54.635022 14228 ts_tablet_manager.cc:1403] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.000s
I20260501 14:01:54.648438 14228 raft_consensus.cc:359] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.650772 14228 raft_consensus.cc:385] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.651221 14228 raft_consensus.cc:740] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.652321 14228 consensus_queue.cc:260] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.656571 14228 ts_tablet_manager.cc:1434] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260501 14:01:54.653434 14496 consensus_queue.cc:1048] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260501 14:01:54.656919 14229 tablet_bootstrap.cc:654] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.659240 14228 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:54.661125 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7736f72df4e4056b6e8306bb195e5d8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:54.661903 14178 raft_consensus.cc:2468] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:54.666656 14228 tablet_bootstrap.cc:654] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.666486 14001 leader_election.cc:304] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:54.668996 14541 raft_consensus.cc:2804] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:54.669445 14541 raft_consensus.cc:493] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:54.669802 14541 raft_consensus.cc:3060] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:54.684330 13957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7736f72df4e4056b6e8306bb195e5d8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:54.685421 13957 raft_consensus.cc:2468] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:54.689417 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:54.690078 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:54.690457 13960 raft_consensus.cc:2468] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:54.691067 14033 raft_consensus.cc:2468] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
W20260501 14:01:54.695210 13999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.003s	sys 0.012s
I20260501 14:01:54.699263 14231 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:54.710219 14593 raft_consensus.cc:493] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:54.711056 14593 raft_consensus.cc:515] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.740327 14593 leader_election.cc:290] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:54.719691 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:54.744653 14103 raft_consensus.cc:2393] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
W20260501 14:01:54.695765 13999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.004s	sys 0.013s
I20260501 14:01:54.726850 14295 raft_consensus.cc:493] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dba449c6af0341daa28866a4fd46cd96)
I20260501 14:01:54.746387 14295 raft_consensus.cc:515] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:54.727991 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:54.753279 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:54.753310 14183 raft_consensus.cc:2393] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:54.731029 14542 raft_consensus.cc:493] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcac793323404da6a1245c4c5264b767)
I20260501 14:01:54.763924 14542 raft_consensus.cc:515] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.752418 14231 ts_tablet_manager.cc:1403] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.662s	user 0.034s	sys 0.018s
I20260501 14:01:54.668006 14031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43084 (request call id 74) took 1008 ms. Trace:
I20260501 14:01:54.769840 14031 rpcz_store.cc:276] 0501 14:01:53.659859 (+     0us) service_pool.cc:167] Inserting onto call queue
0501 14:01:53.659993 (+   134us) service_pool.cc:224] Handling call
0501 14:01:53.660437 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0501 14:01:53.660895 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0501 14:01:53.660939 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0501 14:01:53.665101 (+  4162us) log.cc:844] Serialized 26 byte log entry
0501 14:01:53.811641 (+146540us) raft_consensus.cc:1645] Marking committed up to 0
0501 14:01:53.814293 (+  2652us) raft_consensus.cc:1697] Filling consensus response to leader.
0501 14:01:53.818741 (+  4448us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0501 14:01:54.667642 (+848901us) raft_consensus.cc:1685] finished
0501 14:01:54.667680 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0501 14:01:54.667908 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":640,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":2000,"thread_start_us":130779,"threads_started":1,"wal-append.queue_time_us":208254}
I20260501 14:01:54.774722 14001 leader_election.cc:304] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:54.767800 13856 catalog_manager.cc:5671] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:54.776497 14231 raft_consensus.cc:359] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:54.821026 14231 raft_consensus.cc:385] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.821316 14231 raft_consensus.cc:740] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.822074 14231 consensus_queue.cc:260] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:54.819921 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 45329.4us
I20260501 14:01:54.771409 14542 leader_election.cc:290] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:54.824038 14602 raft_consensus.cc:2804] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:54.835938 14602 raft_consensus.cc:493] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:54.836288 14602 raft_consensus.cc:3060] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:54.840211 14227 tablet_bootstrap.cc:654] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.842044 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:54.798154 14474 consensus_queue.cc:1048] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260501 14:01:54.832172 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:54.832247 14601 consensus_queue.cc:1048] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260501 14:01:54.848726 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:54.823792 14231 ts_tablet_manager.cc:1434] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260501 14:01:54.850580 14231 tablet_bootstrap.cc:492] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:54.855386 14295 leader_election.cc:290] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:54.863453 14231 tablet_bootstrap.cc:654] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.878257 14231 tablet_bootstrap.cc:492] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:54.878867 14231 ts_tablet_manager.cc:1403] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.010s
I20260501 14:01:54.883361 14231 raft_consensus.cc:359] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
W20260501 14:01:54.884358 14075 leader_election.cc:343] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:54.884660 14231 raft_consensus.cc:385] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.885169 14231 raft_consensus.cc:740] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
W20260501 14:01:54.886886 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 142505us
I20260501 14:01:54.888350 14148 leader_election.cc:304] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:54.889276 14474 consensus_queue.cc:1048] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:54.889470 14231 consensus_queue.cc:260] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:54.890744 14600 raft_consensus.cc:2804] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:54.891214 14600 raft_consensus.cc:493] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:54.891559 14600 raft_consensus.cc:3060] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:54.891830 14231 ts_tablet_manager.cc:1434] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260501 14:01:54.893239 14231 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:54.900758 14231 tablet_bootstrap.cc:654] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:54.901212 14001 leader_election.cc:304] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:54.903988 14474 raft_consensus.cc:2749] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:54.907785 14602 raft_consensus.cc:515] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.931201 14227 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:54.957481 14227 ts_tablet_manager.cc:1403] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.510s	user 0.019s	sys 0.004s
I20260501 14:01:54.972719 14176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:54.974011 14176 raft_consensus.cc:2468] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:54.975883 14227 raft_consensus.cc:359] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:54.977121 14227 raft_consensus.cc:385] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:54.977502 14227 raft_consensus.cc:740] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:54.981985 14227 consensus_queue.cc:260] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:55.000023 14612 raft_consensus.cc:493] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.000774 14612 raft_consensus.cc:515] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.002395 14602 leader_election.cc:290] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:55.003582 14612 leader_election.cc:290] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:54.990974 14579 raft_consensus.cc:493] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6f0deb8c1e1415693f8ab2ca413688d)
I20260501 14:01:55.005929 14579 raft_consensus.cc:515] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.015597 14578 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.018144 14578 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:55.020829 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 58841.8us
I20260501 14:01:55.020921 14542 raft_consensus.cc:493] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.022994 14542 raft_consensus.cc:515] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.023535 14579 leader_election.cc:290] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:55.023780 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce6c201d860417d91baa78d28d6a3a3" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.024583 14031 raft_consensus.cc:2468] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:55.025754 14541 raft_consensus.cc:515] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.026494 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:55.027230 13960 raft_consensus.cc:3060] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.030104 14075 leader_election.cc:304] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:55.032166 14074 leader_election.cc:304] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:01:55.036412 14612 raft_consensus.cc:2804] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:55.028406 14541 leader_election.cc:290] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:55.054143 14612 raft_consensus.cc:493] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:55.064045 14594 raft_consensus.cc:2804] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:55.067175 14227 ts_tablet_manager.cc:1434] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.003s
I20260501 14:01:55.078118 14231 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:55.079023 14231 ts_tablet_manager.cc:1403] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.186s	user 0.022s	sys 0.038s
I20260501 14:01:55.083734 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7736f72df4e4056b6e8306bb195e5d8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:55.084627 13956 raft_consensus.cc:3060] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.084702 14228 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:55.085386 14228 ts_tablet_manager.cc:1403] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.426s	user 0.038s	sys 0.054s
I20260501 14:01:55.088243 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:55.089077 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.090458 14542 leader_election.cc:290] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:55.091454 14228 raft_consensus.cc:359] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.092257 14228 raft_consensus.cc:385] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.092532 14228 raft_consensus.cc:740] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.094285 14229 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:55.094903 14229 ts_tablet_manager.cc:1403] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 1.000s	user 0.021s	sys 0.009s
I20260501 14:01:55.071266 14612 raft_consensus.cc:3060] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.097684 14228 consensus_queue.cc:260] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:55.096486 14001 leader_election.cc:343] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:55.072450 14594 raft_consensus.cc:493] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:55.073961 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:55.106263 14109 raft_consensus.cc:3060] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.109222 14487 raft_consensus.cc:493] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.109853 14487 raft_consensus.cc:515] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.113812 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:55.102684 14594 raft_consensus.cc:3060] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.125749 14227 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
W20260501 14:01:55.126878 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 65641us
I20260501 14:01:55.128724 14228 ts_tablet_manager.cc:1434] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260501 14:01:55.116065 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7736f72df4e4056b6e8306bb195e5d8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:55.115525 13960 raft_consensus.cc:2468] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:55.136454 14148 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:55.129899 14487 leader_election.cc:290] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:55.129806 14600 raft_consensus.cc:515] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.141937 14229 raft_consensus.cc:359] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.142612 14229 raft_consensus.cc:385] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.142850 14229 raft_consensus.cc:740] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.143975 14229 consensus_queue.cc:260] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.146071 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.146904 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:55.147547 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce6c201d860417d91baa78d28d6a3a3" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:55.152451 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:55.153192 13958 raft_consensus.cc:3060] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.133997 14578 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:55.138319 14182 raft_consensus.cc:3060] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.146135 14600 leader_election.cc:290] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:55.155777 14183 raft_consensus.cc:2393] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:55.164171 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.175220 14031 raft_consensus.cc:2468] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:55.175631 13958 raft_consensus.cc:2468] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:55.169767 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.177909 14149 leader_election.cc:304] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:55.178925 14600 raft_consensus.cc:2804] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:55.179443 14600 raft_consensus.cc:697] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:55.180716 14229 ts_tablet_manager.cc:1434] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.004s
I20260501 14:01:55.181963 14229 tablet_bootstrap.cc:492] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:55.181761 13956 raft_consensus.cc:2468] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:55.169890 14581 raft_consensus.cc:2749] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:55.164927 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14016a1d4de44178b73674dbf82b9c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:55.180339 14600 consensus_queue.cc:237] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.187167 14228 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:55.172278 14001 leader_election.cc:304] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
W20260501 14:01:55.188472 14001 leader_election.cc:343] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:55.188951 14001 leader_election.cc:304] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:55.189267 14602 raft_consensus.cc:2804] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:55.189975 14496 raft_consensus.cc:2749] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:55.196132 14602 raft_consensus.cc:697] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:55.196503 14550 consensus_queue.cc:1048] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:55.199535 13925 leader_election.cc:304] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:55.209455 14602 consensus_queue.cc:237] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:55.203197 14612 raft_consensus.cc:515] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.210479 14281 raft_consensus.cc:2764] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260501 14:01:55.202426 14628 log.cc:927] Time spent T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: Append to log took a long time: real 0.080s	user 0.000s	sys 0.002s
I20260501 14:01:55.224336 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:55.230217 14105 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:55.231743 13925 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:55.225476 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
W20260501 14:01:55.234994 13925 leader_election.cc:343] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:55.238655 14075 leader_election.cc:343] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:55.239483 14281 raft_consensus.cc:2804] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:55.240047 14281 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:55.240201 14001 leader_election.cc:304] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:55.240525 14281 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.241829 14231 raft_consensus.cc:359] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:55.242584 14231 raft_consensus.cc:385] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.242862 14231 raft_consensus.cc:740] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.248121 14612 leader_election.cc:290] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:55.282644 14109 raft_consensus.cc:2468] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:55.289516 14182 raft_consensus.cc:2468] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:55.306694 14281 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:55.286682 14227 tablet_bootstrap.cc:654] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:55.308992 14281 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:55.243520 14231 consensus_queue.cc:260] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:55.304926 14228 tablet_bootstrap.cc:654] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:55.304982 14148 leader_election.cc:304] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
W20260501 14:01:55.310988 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 70872.1us
I20260501 14:01:55.311161 14496 raft_consensus.cc:2804] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:55.311854 14496 raft_consensus.cc:697] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:55.312021 14627 raft_consensus.cc:2749] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:55.313094 14496 consensus_queue.cc:237] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.287248 13855 catalog_manager.cc:5671] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:55.314033 14550 consensus_queue.cc:1048] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:55.323330 14231 ts_tablet_manager.cc:1434] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.244s	user 0.009s	sys 0.000s
I20260501 14:01:55.324234 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:55.324735 14231 tablet_bootstrap.cc:492] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:55.325022 14107 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.305634 14594 raft_consensus.cc:515] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.347738 14594 leader_election.cc:290] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
W20260501 14:01:55.336621 14075 leader_election.cc:343] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:55.304275 14229 tablet_bootstrap.cc:654] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:55.324236 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:55.344579 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42855c0411ec46b3bf4bd4be757430c4" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:55.358187 14148 leader_election.cc:304] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:55.357889 14032 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.370927 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:55.371783 14182 raft_consensus.cc:3060] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.374537 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce6c201d860417d91baa78d28d6a3a3" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:55.376408 14581 raft_consensus.cc:2749] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:55.376727 14031 raft_consensus.cc:3060] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.358368 14033 raft_consensus.cc:3060] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.407392 14032 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:55.420492 13856 catalog_manager.cc:5671] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:55.434929 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce6c201d860417d91baa78d28d6a3a3" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:55.409246 14033 raft_consensus.cc:2468] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:55.476040 14228 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:55.476969 14228 ts_tablet_manager.cc:1403] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.335s	user 0.020s	sys 0.000s
I20260501 14:01:55.480178 14228 raft_consensus.cc:359] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.480947 14228 raft_consensus.cc:385] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.481220 14228 raft_consensus.cc:740] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.481978 14228 consensus_queue.cc:260] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.473057 14107 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:55.485294 14231 tablet_bootstrap.cc:654] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:55.485394 14204 debug-util.cc:398] Leaking SignalData structure 0x7b080004fe00 after lost signal to thread 6457
I20260501 14:01:55.486021 14228 ts_tablet_manager.cc:1434] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260501 14:01:55.487214 14204 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3520 after lost signal to thread 13892
I20260501 14:01:55.487635 14228 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:01:55.488960 14204 debug-util.cc:398] Leaking SignalData structure 0x7b08001711a0 after lost signal to thread 13984
I20260501 14:01:55.491487 13925 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:55.492790 14578 raft_consensus.cc:2804] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:55.493485 14578 raft_consensus.cc:697] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:55.494589 14578 consensus_queue.cc:237] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:55.497033 14204 debug-util.cc:398] Leaking SignalData structure 0x7b0800041de0 after lost signal to thread 14059
I20260501 14:01:55.494530 14182 raft_consensus.cc:2468] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:55.498389 14228 tablet_bootstrap.cc:654] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:55.499425 14204 debug-util.cc:398] Leaking SignalData structure 0x7b0800243560 after lost signal to thread 14133
W20260501 14:01:55.501073 14204 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4900 after lost signal to thread 14207
W20260501 14:01:55.505990 14075 leader_election.cc:343] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:55.507215 14075 leader_election.cc:304] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:55.509150 14593 raft_consensus.cc:2804] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:55.509760 14593 raft_consensus.cc:697] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:55.510012 14031 raft_consensus.cc:2468] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:55.510641 14593 consensus_queue.cc:237] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.511186 14229 tablet_bootstrap.cc:492] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:55.511432 14074 leader_election.cc:304] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:55.513106 14436 raft_consensus.cc:2804] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:55.514039 14229 ts_tablet_manager.cc:1403] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.332s	user 0.010s	sys 0.011s
I20260501 14:01:55.519771 14436 raft_consensus.cc:697] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:55.521044 14436 consensus_queue.cc:237] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
W20260501 14:01:55.505147 14204 debug-util.cc:398] Leaking SignalData structure 0x7b080036ec60 after lost signal to thread 14497
I20260501 14:01:55.541059 13858 catalog_manager.cc:5671] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:55.558773 14229 raft_consensus.cc:359] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.559787 14229 raft_consensus.cc:385] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.560168 14229 raft_consensus.cc:740] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.560937 14229 consensus_queue.cc:260] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.593526 14227 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:55.594280 14227 ts_tablet_manager.cc:1403] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.489s	user 0.014s	sys 0.008s
I20260501 14:01:55.625228 14229 ts_tablet_manager.cc:1434] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.004s
I20260501 14:01:55.629732 14600 raft_consensus.cc:493] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.630448 14600 raft_consensus.cc:515] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.645310 14600 leader_election.cc:290] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:55.648069 13959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
W20260501 14:01:55.650197 14149 leader_election.cc:343] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:55.660939 14227 raft_consensus.cc:359] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.661846 14227 raft_consensus.cc:385] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.662134 14227 raft_consensus.cc:740] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.662823 14227 consensus_queue.cc:260] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.666356 14227 ts_tablet_manager.cc:1434] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.002s
I20260501 14:01:55.668457 14229 tablet_bootstrap.cc:492] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:55.666587 14611 raft_consensus.cc:493] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.665311 14581 consensus_queue.cc:1048] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260501 14:01:55.702392 14611 raft_consensus.cc:515] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.705662 14611 leader_election.cc:290] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:55.708701 13855 catalog_manager.cc:5671] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:55.710103 14227 tablet_bootstrap.cc:492] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:55.715528 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.725281 14031 raft_consensus.cc:2468] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:55.717203 14231 tablet_bootstrap.cc:492] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:55.728324 14032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:55.728984 14231 ts_tablet_manager.cc:1403] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.405s	user 0.021s	sys 0.004s
I20260501 14:01:55.729307 14032 raft_consensus.cc:2468] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:55.733333 14583 consensus_queue.cc:1048] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:55.737112 14231 raft_consensus.cc:359] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.737555 14227 tablet_bootstrap.cc:654] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:55.740291 14603 consensus_queue.cc:1048] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:55.744987 14074 leader_election.cc:304] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:01:55.745370 14231 raft_consensus.cc:385] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.745826 14231 raft_consensus.cc:740] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.748170 14551 raft_consensus.cc:2804] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:01:55.749356 14551 raft_consensus.cc:493] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:55.753683 14551 raft_consensus.cc:3060] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:55.754511 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:55.755579 14182 raft_consensus.cc:2468] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
W20260501 14:01:55.760627 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:55.776232 14231 consensus_queue.cc:260] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
W20260501 14:01:55.808343 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 50411.8us
I20260501 14:01:55.809545 14148 leader_election.cc:304] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:55.813027 14231 ts_tablet_manager.cc:1434] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260501 14:01:55.814857 14581 raft_consensus.cc:2804] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:55.836259 14603 consensus_queue.cc:1048] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:55.836743 14581 raft_consensus.cc:493] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:55.838467 14581 raft_consensus.cc:3060] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:55.845541 14231 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:55.812244 14629 consensus_queue.cc:1048] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260501 14:01:55.851373 13858 catalog_manager.cc:5671] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } }
I20260501 14:01:55.889245 14231 tablet_bootstrap.cc:654] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:55.909253 14231 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:55.910049 14231 ts_tablet_manager.cc:1403] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.004s
I20260501 14:01:55.890966 13855 catalog_manager.cc:5671] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
W20260501 14:01:55.914460 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 44044us
I20260501 14:01:55.916191 14229 tablet_bootstrap.cc:654] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:55.920109 13855 catalog_manager.cc:5671] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 1 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:55.937739 14611 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.942642 14611 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.922555 14550 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:55.946460 14550 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:55.948697 14550 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:55.949061 14611 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:55.881349 14551 raft_consensus.cc:515] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:55.952623 14231 raft_consensus.cc:359] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.955418 14231 raft_consensus.cc:385] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:55.955731 14231 raft_consensus.cc:740] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:55.956204 14551 leader_election.cc:290] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:55.956583 14231 consensus_queue.cc:260] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.958427 14231 ts_tablet_manager.cc:1434] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260501 14:01:55.963970 14228 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:55.964720 14228 ts_tablet_manager.cc:1403] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.477s	user 0.024s	sys 0.018s
I20260501 14:01:55.945413 14581 raft_consensus.cc:515] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:55.989113 14231 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:55.962327 14603 consensus_queue.cc:1048] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260501 14:01:56.000259 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:56.001181 14031 raft_consensus.cc:3060] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:56.004715 14581 leader_election.cc:290] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:56.005952 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:56.007504 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:56.008623 14104 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:56.019083 14227 tablet_bootstrap.cc:492] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:56.026438 14231 tablet_bootstrap.cc:654] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:56.030970 14227 ts_tablet_manager.cc:1403] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.321s	user 0.040s	sys 0.026s
I20260501 14:01:56.039224 14228 raft_consensus.cc:359] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.043704 14228 raft_consensus.cc:385] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.044108 14228 raft_consensus.cc:740] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.045006 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:56.045753 13958 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:56.052201 14228 consensus_queue.cc:260] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.061290 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:56.075080 14228 ts_tablet_manager.cc:1434] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.000s
I20260501 14:01:56.079475 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14ddad993d446dd92f27c20aace1a34" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:56.080726 14183 raft_consensus.cc:3060] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 2
I20260501 14:01:56.081504 14542 raft_consensus.cc:493] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:01:56.081750 13926 leader_election.cc:343] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.082180 14542 raft_consensus.cc:515] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
W20260501 14:01:56.089619 14075 leader_election.cc:343] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.099440 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:56.100323 14033 raft_consensus.cc:3060] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.104781 14542 leader_election.cc:290] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:56.105857 14227 raft_consensus.cc:359] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.106890 14227 raft_consensus.cc:385] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.107185 14227 raft_consensus.cc:740] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.108101 14227 consensus_queue.cc:260] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.110239 14227 ts_tablet_manager.cc:1434] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.004s
I20260501 14:01:56.111436 14227 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:56.114960 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:56.120836 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f9563f8238491491dcfbf6b39bf91a" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:56.127058 14031 raft_consensus.cc:2468] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
W20260501 14:01:56.127907 14001 leader_election.cc:343] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.129295 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f9563f8238491491dcfbf6b39bf91a" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:56.179203 14107 raft_consensus.cc:2468] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:56.179622 14033 raft_consensus.cc:2468] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:56.185866 13925 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:56.188606 14281 raft_consensus.cc:2804] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:56.189056 14281 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:56.189416 14281 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.194679 14000 leader_election.cc:304] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
W20260501 14:01:56.168829 14149 leader_election.cc:343] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.134101 14227 tablet_bootstrap.cc:654] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:56.105834 14183 raft_consensus.cc:2468] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:01:56.135726 14436 consensus_queue.cc:1048] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:56.147809 14075 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:56.148555 14228 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:56.156466 14487 raft_consensus.cc:493] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:56.241974 14074 leader_election.cc:304] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
W20260501 14:01:56.244755 14075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 97071.2us
W20260501 14:01:56.161326 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 46809.3us
I20260501 14:01:56.255707 14612 raft_consensus.cc:2804] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:01:56.256367 14612 raft_consensus.cc:697] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:01:56.198144 14405 consensus_queue.cc:1048] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260501 14:01:56.257297 14612 consensus_queue.cc:237] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.259899 14593 raft_consensus.cc:2804] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:56.260411 14593 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:56.260773 14593 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.205933 14603 raft_consensus.cc:2804] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 14:01:56.210043 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 47914.3us
W20260501 14:01:56.273687 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 87925.1us
I20260501 14:01:56.280293 14281 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.288069 14281 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:56.193610 14652 consensus_queue.cc:1048] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.079s
I20260501 14:01:56.268765 14603 raft_consensus.cc:493] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:56.318459 14281 consensus_queue.cc:1048] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:56.252938 14487 raft_consensus.cc:515] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.324424 14603 raft_consensus.cc:3060] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.352084 14229 tablet_bootstrap.cc:492] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:56.352782 14229 ts_tablet_manager.cc:1403] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.686s	user 0.042s	sys 0.086s
W20260501 14:01:56.363219 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 81571.2us
I20260501 14:01:56.364198 14148 leader_election.cc:304] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:56.368472 14231 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:56.369426 14231 ts_tablet_manager.cc:1403] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.381s	user 0.036s	sys 0.030s
W20260501 14:01:56.382596 14075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 136065us
I20260501 14:01:56.387916 14227 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:56.388645 14227 ts_tablet_manager.cc:1403] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.277s	user 0.018s	sys 0.004s
I20260501 14:01:56.390954 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:56.394668 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 68336.1us
I20260501 14:01:56.396601 14228 tablet_bootstrap.cc:654] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:56.377911 14648 log.cc:927] Time spent T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260501 14:01:56.421540 14487 leader_election.cc:290] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:56.422813 14231 raft_consensus.cc:359] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.414450 14229 raft_consensus.cc:359] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.427423 14229 raft_consensus.cc:385] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.372301 14668 raft_consensus.cc:2804] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:56.428771 14227 raft_consensus.cc:359] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.430537 14227 raft_consensus.cc:385] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.430842 14227 raft_consensus.cc:740] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.431591 14227 consensus_queue.cc:260] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.434491 14227 ts_tablet_manager.cc:1434] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260501 14:01:56.435726 14227 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:56.423646 14231 raft_consensus.cc:385] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.442451 14231 raft_consensus.cc:740] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.443723 14231 consensus_queue.cc:260] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.428062 14229 raft_consensus.cc:740] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.447567 14668 raft_consensus.cc:697] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:01:56.451553 14227 tablet_bootstrap.cc:654] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:56.451392 14668 consensus_queue.cc:237] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:56.457091 13926 leader_election.cc:343] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:56.468513 14075 consensus_peers.cc:597] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:56.476831 14229 consensus_queue.cc:260] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.477461 14542 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:56.482062 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:56.483134 14033 raft_consensus.cc:2468] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:56.478343 14542 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:56.490163 14542 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:56.490926 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:56.492599 14229 ts_tablet_manager.cc:1434] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.140s	user 0.004s	sys 0.006s
I20260501 14:01:56.492945 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
W20260501 14:01:56.493573 14001 leader_election.cc:343] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.494314 14229 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:56.501612 13925 leader_election.cc:304] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:56.518886 14231 ts_tablet_manager.cc:1434] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.149s	user 0.012s	sys 0.000s
I20260501 14:01:56.517346 14660 raft_consensus.cc:2804] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:56.531193 14660 raft_consensus.cc:493] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:56.539291 14660 raft_consensus.cc:3060] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.531765 14603 raft_consensus.cc:515] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.544595 14603 leader_election.cc:290] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:56.547622 14593 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.554950 14102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:56.531915 13957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:56.591061 14231 tablet_bootstrap.cc:492] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
W20260501 14:01:56.610369 14001 leader_election.cc:343] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.612939 14001 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:56.611744 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f9563f8238491491dcfbf6b39bf91a" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:56.582616 14102 raft_consensus.cc:2468] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:56.614868 14103 raft_consensus.cc:3060] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.616720 14654 raft_consensus.cc:2749] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:56.618151 14109 raft_consensus.cc:2393] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:56.641340 14228 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:56.642074 14228 ts_tablet_manager.cc:1403] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.548s	user 0.033s	sys 0.017s
I20260501 14:01:56.642237 14179 raft_consensus.cc:3060] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.623306 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f9563f8238491491dcfbf6b39bf91a" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:56.660447 14227 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:56.661445 14227 ts_tablet_manager.cc:1403] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.226s	user 0.047s	sys 0.024s
I20260501 14:01:56.669152 14593 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:01:56.673857 14001 leader_election.cc:343] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.678380 14229 tablet_bootstrap.cc:654] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:56.680287 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:56.681304 13960 raft_consensus.cc:2393] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:56.704140 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:56.708801 14103 raft_consensus.cc:2468] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:56.708673 14228 raft_consensus.cc:359] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.728823 14228 raft_consensus.cc:385] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.729274 14228 raft_consensus.cc:740] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.730262 14228 consensus_queue.cc:260] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.718504 14660 raft_consensus.cc:515] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.727061 14227 raft_consensus.cc:359] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.736613 14227 raft_consensus.cc:385] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.737147 14227 raft_consensus.cc:740] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.738766 14227 consensus_queue.cc:260] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.742476 14660 leader_election.cc:290] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:56.723282 13925 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:56.749145 14660 raft_consensus.cc:2749] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260501 14:01:56.749854 14075 leader_election.cc:343] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.750464 14075 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:56.752354 14611 raft_consensus.cc:2749] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:56.757030 13854 catalog_manager.cc:5671] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 0 to 2, leader changed from <none> to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 2 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:56.763154 14228 ts_tablet_manager.cc:1434] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260501 14:01:56.764536 14228 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:56.768164 14000 leader_election.cc:304] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:56.781121 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:56.782007 14030 raft_consensus.cc:3060] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.783972 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:56.784770 14109 raft_consensus.cc:3060] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.791687 14182 raft_consensus.cc:1275] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:01:56.776649 14603 raft_consensus.cc:2804] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election won for term 1
W20260501 14:01:56.796227 14677 log.cc:927] Time spent T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
I20260501 14:01:56.796833 14603 raft_consensus.cc:697] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:56.797845 14603 consensus_queue.cc:237] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:56.799958 14436 raft_consensus.cc:493] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:56.800601 14436 raft_consensus.cc:515] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.802434 14229 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:56.802778 14436 leader_election.cc:290] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:56.803103 14229 ts_tablet_manager.cc:1403] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.309s	user 0.023s	sys 0.007s
I20260501 14:01:56.810582 14227 ts_tablet_manager.cc:1434] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260501 14:01:56.810992 14661 consensus_queue.cc:1048] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:56.812520 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:56.830940 14594 consensus_queue.cc:1048] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:56.824622 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:56.837670 14075 leader_election.cc:343] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.838505 14228 tablet_bootstrap.cc:654] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:56.837829 14231 tablet_bootstrap.cc:654] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:56.839380 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260501 14:01:56.843067 14075 leader_election.cc:343] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:56.843883 14075 leader_election.cc:304] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:56.845844 14436 raft_consensus.cc:2749] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:56.847020 14109 raft_consensus.cc:2468] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:56.851040 13925 leader_election.cc:304] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:56.876559 14229 raft_consensus.cc:359] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.877529 14229 raft_consensus.cc:385] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:56.877801 14229 raft_consensus.cc:740] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:56.856108 14487 raft_consensus.cc:2804] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:56.881210 14229 consensus_queue.cc:260] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.882267 14487 raft_consensus.cc:697] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:56.885874 14487 consensus_queue.cc:237] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:56.891021 14227 tablet_bootstrap.cc:492] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:56.894955 14229 ts_tablet_manager.cc:1434] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.092s	user 0.011s	sys 0.000s
I20260501 14:01:56.898335 14667 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:56.899097 14229 tablet_bootstrap.cc:492] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:56.898957 14667 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.902866 14667 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:56.904040 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:56.905289 13958 raft_consensus.cc:2393] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:56.909044 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:56.880928 14030 raft_consensus.cc:2468] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:56.916445 14660 raft_consensus.cc:493] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:56.917142 14660 raft_consensus.cc:515] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:56.920409 14660 leader_election.cc:290] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:56.920703 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:56.918388 13855 catalog_manager.cc:5671] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:56.891743 14033 raft_consensus.cc:1275] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:01:56.913338 14109 raft_consensus.cc:2393] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:56.938042 14148 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:56.946377 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:56.948297 13926 leader_election.cc:304] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:56.949784 14660 raft_consensus.cc:2749] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260501 14:01:56.943686 14149 consensus_peers.cc:597] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:01:56.940884 14667 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:56.953662 14436 consensus_queue.cc:1048] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260501 14:01:56.995926 14227 tablet_bootstrap.cc:654] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.018158 14229 tablet_bootstrap.cc:654] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.036410 14580 consensus_queue.cc:1048] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:57.038256 14228 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:57.038947 14228 ts_tablet_manager.cc:1403] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.275s	user 0.029s	sys 0.033s
I20260501 14:01:57.042402 14228 raft_consensus.cc:359] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.043233 14228 raft_consensus.cc:385] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.043561 14228 raft_consensus.cc:740] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.044271 14228 consensus_queue.cc:260] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.055900 14231 tablet_bootstrap.cc:492] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:57.056797 14231 ts_tablet_manager.cc:1403] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.485s	user 0.018s	sys 0.017s
I20260501 14:01:57.057051 14228 ts_tablet_manager.cc:1434] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.008s
I20260501 14:01:57.058439 14228 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:57.060243 14231 raft_consensus.cc:359] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.061316 14231 raft_consensus.cc:385] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.061677 14231 raft_consensus.cc:740] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.062783 14231 consensus_queue.cc:260] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.067684 14231 ts_tablet_manager.cc:1434] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260501 14:01:57.073376 14231 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:57.077158 14667 raft_consensus.cc:2749] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:57.090536 14229 tablet_bootstrap.cc:492] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:57.090536 14227 tablet_bootstrap.cc:492] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:57.091600 14227 ts_tablet_manager.cc:1403] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.225s	user 0.016s	sys 0.004s
I20260501 14:01:57.091612 14229 ts_tablet_manager.cc:1403] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.194s	user 0.011s	sys 0.008s
I20260501 14:01:57.090633 14228 tablet_bootstrap.cc:654] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.099690 14229 raft_consensus.cc:359] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.102128 14227 raft_consensus.cc:359] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.105600 14227 raft_consensus.cc:385] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.106012 14227 raft_consensus.cc:740] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.106973 14227 consensus_queue.cc:260] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.109834 14227 ts_tablet_manager.cc:1434] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260501 14:01:57.104635 14229 raft_consensus.cc:385] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.110559 14229 raft_consensus.cc:740] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.111290 14229 consensus_queue.cc:260] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.113296 14231 tablet_bootstrap.cc:654] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.113665 14229 ts_tablet_manager.cc:1434] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260501 14:01:57.115675 14227 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:57.124009 14229 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:57.125248 13855 catalog_manager.cc:5671] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:57.148415 14666 raft_consensus.cc:493] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.149121 14666 raft_consensus.cc:515] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.150902 14228 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:57.151361 14666 leader_election.cc:290] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:57.151584 14228 ts_tablet_manager.cc:1403] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.009s
I20260501 14:01:57.154146 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f9563f8238491491dcfbf6b39bf91a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:57.156749 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f9563f8238491491dcfbf6b39bf91a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:57.157598 14107 raft_consensus.cc:2393] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:57.160529 14228 raft_consensus.cc:359] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.162074 14228 raft_consensus.cc:385] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.162389 14228 raft_consensus.cc:740] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.163323 14148 leader_election.cc:304] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:57.163183 14228 consensus_queue.cc:260] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.164963 14667 raft_consensus.cc:3060] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.167745 14228 ts_tablet_manager.cc:1434] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260501 14:01:57.169180 14228 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:57.180876 14602 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.181488 14602 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.184257 14602 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:57.184937 14228 tablet_bootstrap.cc:654] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.179920 13854 catalog_manager.cc:5671] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:57.185817 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:57.187201 14001 leader_election.cc:343] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.189726 14227 tablet_bootstrap.cc:654] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.193333 14667 raft_consensus.cc:2749] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:57.197204 14229 tablet_bootstrap.cc:654] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.198918 14228 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:57.199529 14228 ts_tablet_manager.cc:1403] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260501 14:01:57.200408 14594 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.200953 14594 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.202574 14231 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:57.203049 14594 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:57.203086 14231 ts_tablet_manager.cc:1403] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.130s	user 0.023s	sys 0.011s
I20260501 14:01:57.207513 14231 raft_consensus.cc:359] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.208273 14231 raft_consensus.cc:385] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.209474 14231 raft_consensus.cc:740] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.210251 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:57.210330 14231 consensus_queue.cc:260] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:01:57.212110 14075 leader_election.cc:343] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.212361 14231 ts_tablet_manager.cc:1434] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260501 14:01:57.214365 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:57.215129 14107 raft_consensus.cc:2468] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:57.220799 14228 raft_consensus.cc:359] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.221894 14228 raft_consensus.cc:385] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.222210 14228 raft_consensus.cc:740] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.222929 14228 consensus_queue.cc:260] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.227213 14000 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.227540 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:57.228314 14033 raft_consensus.cc:2468] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 0.
I20260501 14:01:57.229849 14602 raft_consensus.cc:2804] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.231968 14602 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.233304 14231 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96: Bootstrap starting.
I20260501 14:01:57.233590 13956 raft_consensus.cc:3060] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.233850 14228 ts_tablet_manager.cc:1434] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260501 14:01:57.237670 14228 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:57.232372 14602 raft_consensus.cc:3060] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.245337 14231 tablet_bootstrap.cc:654] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.249110 14229 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:57.249696 14229 ts_tablet_manager.cc:1403] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.005s
I20260501 14:01:57.253335 14229 raft_consensus.cc:359] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.254881 14229 raft_consensus.cc:385] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.255185 14229 raft_consensus.cc:740] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.256194 14229 consensus_queue.cc:260] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.257596 14227 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:57.257493 14074 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.258354 14227 ts_tablet_manager.cc:1403] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.003s
I20260501 14:01:57.259213 14594 raft_consensus.cc:2804] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.259716 14594 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.260154 14594 raft_consensus.cc:3060] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.262183 14228 tablet_bootstrap.cc:654] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.264379 14227 raft_consensus.cc:359] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.265192 14227 raft_consensus.cc:385] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.265493 14227 raft_consensus.cc:740] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.266217 14227 consensus_queue.cc:260] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.267158 14602 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.268440 14229 ts_tablet_manager.cc:1434] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260501 14:01:57.295794 14229 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:57.296051 14602 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:57.297340 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:57.298949 14001 leader_election.cc:343] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.269966 14227 ts_tablet_manager.cc:1434] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260501 14:01:57.300947 14227 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: Bootstrap starting.
I20260501 14:01:57.274812 14231 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96: No bootstrap required, opened a new log
I20260501 14:01:57.304448 14231 ts_tablet_manager.cc:1403] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.006s
W20260501 14:01:57.308001 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 49057.7us
I20260501 14:01:57.285925 14541 consensus_queue.cc:1048] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:57.313445 14231 raft_consensus.cc:359] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.287484 14436 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.321861 14231 raft_consensus.cc:385] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.322247 14231 raft_consensus.cc:740] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.322096 14436 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.287261 14228 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:57.323521 14228 ts_tablet_manager.cc:1403] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.009s
I20260501 14:01:57.324617 14436 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:57.293422 14594 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.326741 14594 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:57.329489 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:57.330498 14231 consensus_queue.cc:260] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.321182 14227 tablet_bootstrap.cc:654] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:57.332021 14075 leader_election.cc:343] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.330767 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:57.334585 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:57.336313 14660 raft_consensus.cc:493] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.336817 14660 raft_consensus.cc:515] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.339054 14660 leader_election.cc:290] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
W20260501 14:01:57.336673 14075 leader_election.cc:343] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.344794 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:57.345523 14030 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:57.346189 14229 tablet_bootstrap.cc:654] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.346318 14075 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
W20260501 14:01:57.348527 14075 leader_election.cc:343] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.351244 13925 leader_election.cc:304] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:57.359571 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:57.363466 14107 raft_consensus.cc:2393] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:57.361187 14228 raft_consensus.cc:359] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.364787 14228 raft_consensus.cc:385] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.365237 14228 raft_consensus.cc:740] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.366189 14228 consensus_queue.cc:260] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.368254 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:57.351785 14436 raft_consensus.cc:2749] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:57.359345 14660 raft_consensus.cc:2804] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.369122 14033 raft_consensus.cc:2393] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:57.370313 14660 raft_consensus.cc:493] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.370760 14660 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.374096 14231 ts_tablet_manager.cc:1434] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
I20260501 14:01:57.380134 14228 ts_tablet_manager.cc:1434] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260501 14:01:57.381608 14074 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.396271 14281 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.396916 14281 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.398826 14281 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:57.391440 14436 raft_consensus.cc:2749] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:57.402400 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:01:57.404938 13926 leader_election.cc:343] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.374148 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:57.373842 14602 consensus_queue.cc:1048] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260501 14:01:57.417611 14228 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:01:57.424209 14000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 64019.9us
W20260501 14:01:57.428263 13925 leader_election.cc:343] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.440721 14487 consensus_queue.cc:1048] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:57.446522 14660 raft_consensus.cc:515] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.448784 14660 leader_election.cc:290] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:57.449981 14227 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: No bootstrap required, opened a new log
I20260501 14:01:57.450578 14227 ts_tablet_manager.cc:1403] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.018s
I20260501 14:01:57.457989 14228 tablet_bootstrap.cc:654] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.454703 14227 raft_consensus.cc:359] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.460242 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:57.470866 14227 raft_consensus.cc:385] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.471242 14227 raft_consensus.cc:740] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.477764 14229 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:57.478860 14229 ts_tablet_manager.cc:1403] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.183s	user 0.010s	sys 0.008s
I20260501 14:01:57.471969 14227 consensus_queue.cc:260] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.482971 14660 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.483582 14660 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.484247 14104 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.486223 14660 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:57.486351 14229 raft_consensus.cc:359] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.487560 14227 ts_tablet_manager.cc:1434] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260501 14:01:57.488518 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:57.486924 14229 raft_consensus.cc:385] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.489620 14229 raft_consensus.cc:740] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.490204 14229 consensus_queue.cc:260] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:57.491287 13926 leader_election.cc:343] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.496327 14229 ts_tablet_manager.cc:1434] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260501 14:01:57.497292 14229 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:57.502739 14229 tablet_bootstrap.cc:654] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
W20260501 14:01:57.508383 14000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 75186.6us
I20260501 14:01:57.508874 14104 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:57.515679 13956 raft_consensus.cc:3060] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.509402 14000 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.524050 14603 raft_consensus.cc:2749] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:57.537892 13925 leader_election.cc:304] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:57.539381 14281 raft_consensus.cc:2804] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:57.540059 14281 raft_consensus.cc:697] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:57.540859 14281 consensus_queue.cc:237] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:01:57.551128 14714 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.556432 14714 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.558629 14714 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:57.551745 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:57.561371 14033 raft_consensus.cc:2468] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:57.584223 13958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:57.584354 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:57.585469 13958 raft_consensus.cc:2468] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:57.589386 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:57.590193 14030 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.579885 14665 raft_consensus.cc:493] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcac793323404da6a1245c4c5264b767)
I20260501 14:01:57.586246 14182 raft_consensus.cc:2468] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 0.
I20260501 14:01:57.595734 14001 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:57.602887 14602 raft_consensus.cc:2804] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.603379 14602 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.602641 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:57.615116 14031 raft_consensus.cc:2468] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
I20260501 14:01:57.610148 14602 raft_consensus.cc:3060] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.613780 14229 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:57.620504 14229 ts_tablet_manager.cc:1403] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.009s
I20260501 14:01:57.623808 14229 raft_consensus.cc:359] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.626626 14229 raft_consensus.cc:385] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.627092 14229 raft_consensus.cc:740] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.632139 14229 consensus_queue.cc:260] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.634608 14229 ts_tablet_manager.cc:1434] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260501 14:01:57.610749 14665 raft_consensus.cc:515] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.639209 14228 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:57.641222 14229 tablet_bootstrap.cc:492] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:57.650997 14665 leader_election.cc:290] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:57.658738 14228 ts_tablet_manager.cc:1403] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.267s	user 0.027s	sys 0.006s
W20260501 14:01:57.673566 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 64223.9us
I20260501 14:01:57.674619 13925 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.677042 14665 raft_consensus.cc:2804] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.677520 14665 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.677923 14665 raft_consensus.cc:3060] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.684015 14229 tablet_bootstrap.cc:654] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:57.701450 13925 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.701359 14281 consensus_queue.cc:1048] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260501 14:01:57.713642 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:57.711481 14723 raft_consensus.cc:2804] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.737236 14581 raft_consensus.cc:493] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.731158 14030 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:57.778911 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489891716d5d4794b3171c3b41c6b6f0" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:57.787174 14581 raft_consensus.cc:515] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.794358 14581 leader_election.cc:290] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:57.765182 14723 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.797531 14723 raft_consensus.cc:3060] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.798480 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:57.799536 14104 raft_consensus.cc:2468] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:57.804188 14148 leader_election.cc:304] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:57.805449 14228 raft_consensus.cc:359] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.806010 14666 raft_consensus.cc:2804] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.806320 14228 raft_consensus.cc:385] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.806453 14666 raft_consensus.cc:493] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.806668 14228 raft_consensus.cc:740] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.806883 14666 raft_consensus.cc:3060] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:01:57.830511 14000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 108700us
I20260501 14:01:57.807476 14228 consensus_queue.cc:260] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.838228 13925 leader_election.cc:304] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:57.850507 14228 ts_tablet_manager.cc:1434] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.191s	user 0.007s	sys 0.000s
W20260501 14:01:57.850867 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 103892us
I20260501 14:01:57.808367 14602 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:57.851918 14722 raft_consensus.cc:2749] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:01:57.879936 14660 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:57.868438 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:57.880613 14660 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.882706 14660 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
W20260501 14:01:57.884860 14149 leader_election.cc:343] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:57.897094 14228 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:01:57.902845 14229 tablet_bootstrap.cc:492] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:57.903483 14229 ts_tablet_manager.cc:1403] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.263s	user 0.016s	sys 0.019s
I20260501 14:01:57.914242 14602 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:57.915354 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:57.916180 14108 raft_consensus.cc:2468] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 0.
W20260501 14:01:57.919759 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:57.916782 13856 catalog_manager.cc:5671] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:57.923938 13925 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:57.934688 13956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:57.898372 14665 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:57.949669 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 63735.8us
I20260501 14:01:57.947151 13956 raft_consensus.cc:2393] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:57.947154 14721 raft_consensus.cc:2804] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:57.968894 14229 raft_consensus.cc:359] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.969832 14229 raft_consensus.cc:385] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:57.970118 14229 raft_consensus.cc:740] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:57.963893 14721 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:57.974802 14229 consensus_queue.cc:260] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:57.956094 14666 raft_consensus.cc:515] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:57.983722 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:57.988930 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:57.989866 14035 raft_consensus.cc:2393] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:57.980544 14721 raft_consensus.cc:3060] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:57.981282 14665 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:57.987699 14487 consensus_queue.cc:1048] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260501 14:01:58.001958 13926 leader_election.cc:343] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:58.030587 14229 ts_tablet_manager.cc:1434] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.001s
I20260501 14:01:58.033406 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:58.034160 14178 raft_consensus.cc:3060] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.035044 14666 leader_election.cc:290] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:58.039444 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:58.047621 13925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:40057, user_credentials={real_user=slave}} blocked reactor thread for 54370.2us
I20260501 14:01:58.054919 14229 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767: Bootstrap starting.
I20260501 14:01:58.058145 14228 tablet_bootstrap.cc:654] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:58.059432 14001 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:58.027658 14723 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:01:58.056735 13926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 57318.5us
I20260501 14:01:58.067711 14102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:58.072609 14581 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:58.064231 14725 raft_consensus.cc:2749] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260501 14:01:58.093366 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 94179.1us
I20260501 14:01:58.097539 14102 raft_consensus.cc:3060] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.097940 14581 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:58.142378 14723 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:58.115926 13957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:58.163802 14178 raft_consensus.cc:2468] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:58.173028 14102 raft_consensus.cc:2468] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:01:58.181643 14229 tablet_bootstrap.cc:654] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767: Neither blocks nor log segments found. Creating new log.
I20260501 14:01:58.211658 14148 leader_election.cc:304] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:58.213207 14581 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:58.214005 14581 raft_consensus.cc:2804] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:58.216008 14581 raft_consensus.cc:697] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
W20260501 14:01:58.216799 14149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 111209us
I20260501 14:01:58.225553 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:58.225698 14035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:58.226449 13960 raft_consensus.cc:2393] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:58.226511 14035 raft_consensus.cc:2468] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 0.
I20260501 14:01:58.228756 13926 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96
I20260501 14:01:58.231328 14148 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:58.231984 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:58.232618 14731 raft_consensus.cc:2804] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:01:58.233331 14731 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:58.233771 14731 raft_consensus.cc:3060] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.240823 14660 raft_consensus.cc:2804] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:58.241539 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:58.241755 14660 raft_consensus.cc:697] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:58.232698 14033 raft_consensus.cc:3060] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.251936 14581 consensus_queue.cc:237] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.265839 14228 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: No bootstrap required, opened a new log
I20260501 14:01:58.266564 14228 ts_tablet_manager.cc:1403] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.370s	user 0.014s	sys 0.021s
W20260501 14:01:58.274341 14149 leader_election.cc:343] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:01:58.284749 13926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 56076.7us
I20260501 14:01:58.268050 14720 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:58.287791 14720 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:58.291078 14720 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:01:58.243074 14660 consensus_queue.cc:237] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:58.291410 14033 raft_consensus.cc:2468] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:58.303224 14721 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.309172 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:58.310235 14030 raft_consensus.cc:2393] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:58.311439 14281 consensus_queue.cc:1048] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:58.313815 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
W20260501 14:01:58.326300 13926 leader_election.cc:343] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:01:58.312587 13925 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:58.359974 14228 raft_consensus.cc:359] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.360925 14228 raft_consensus.cc:385] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:58.361210 14228 raft_consensus.cc:740] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:01:58.362201 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:58.362932 14105 raft_consensus.cc:3060] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.368148 14228 consensus_queue.cc:260] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.370770 14228 ts_tablet_manager.cc:1434] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260501 14:01:58.377373 14487 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:58.378180 14487 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.382335 14487 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:58.382747 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:58.384884 14103 raft_consensus.cc:2393] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:58.339658 14665 raft_consensus.cc:2804] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:58.386989 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:58.387733 14665 raft_consensus.cc:697] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:58.387912 14178 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:58.388774 14665 consensus_queue.cc:237] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:58.389683 13926 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:58.391693 14487 raft_consensus.cc:2804] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:01:58.392282 14487 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:58.393993 14487 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:58.312527 14721 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:58.399161 14148 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:58.404565 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:58.402420 14581 raft_consensus.cc:3060] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.415094 14104 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:58.433674 14229 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767: No bootstrap required, opened a new log
I20260501 14:01:58.434365 14229 ts_tablet_manager.cc:1403] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767: Time spent bootstrapping tablet: real 0.380s	user 0.061s	sys 0.057s
I20260501 14:01:58.439180 14229 raft_consensus.cc:359] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.440054 14229 raft_consensus.cc:385] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:01:58.440478 14229 raft_consensus.cc:740] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Initialized, Role: FOLLOWER
I20260501 14:01:58.441383 14229 consensus_queue.cc:260] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.443801 14229 ts_tablet_manager.cc:1434] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260501 14:01:58.447999 14581 raft_consensus.cc:2749] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:58.450309 14105 raft_consensus.cc:2468] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 1.
I20260501 14:01:58.451694 14731 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:01:58.453774 14181 raft_consensus.cc:2393] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:58.460088 14731 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:01:58.460794 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:58.461714 14030 raft_consensus.cc:2393] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:58.461478 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
I20260501 14:01:58.464279 14149 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:58.463882 13858 catalog_manager.cc:5671] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 1 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:58.470350 14731 raft_consensus.cc:2749] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:01:58.474098 13925 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: fcac793323404da6a1245c4c5264b767
I20260501 14:01:58.479184 14722 raft_consensus.cc:2804] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:01:58.479753 14722 raft_consensus.cc:697] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:58.480643 14722 consensus_queue.cc:237] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.492903 14487 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.501377 14487 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:58.502646 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:58.503466 14183 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:58.502763 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:58.505733 14105 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:58.515417 14183 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:01:58.517189 13926 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:01:58.519243 14487 raft_consensus.cc:2804] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:01:58.519883 14487 raft_consensus.cc:697] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:01:58.520861 14487 consensus_queue.cc:237] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.525048 14105 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:01:58.545239 13858 catalog_manager.cc:5671] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:58.547529 13858 catalog_manager.cc:5671] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:58.549336 13858 catalog_manager.cc:5671] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:01:58.578334 13858 catalog_manager.cc:5671] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 0 to 2, leader changed from <none> to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:01:58.682631 14722 raft_consensus.cc:493] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:58.683425 14722 raft_consensus.cc:515] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.685811 14722 leader_election.cc:290] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:58.686885 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:58.687518 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:58.688498 14105 raft_consensus.cc:2393] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe6496472aa4477cb4d5a008edd292f6 in current term 1: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:01:58.689746 13925 leader_election.cc:304] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:01:58.690554 14722 raft_consensus.cc:3060] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.700652 14722 raft_consensus.cc:2749] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:58.710449 14722 consensus_queue.cc:1048] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:58.754333 14722 consensus_queue.cc:1048] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:58.777736 14581 consensus_queue.cc:1048] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:58.795981 14581 consensus_queue.cc:1048] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:01:58.876956 14722 consensus_queue.cc:1048] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:58.902045 14721 consensus_queue.cc:1048] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:58.916108 14105 raft_consensus.cc:1275] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:01:58.923496 14665 consensus_queue.cc:1048] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:58.941032 14720 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:58.941764 14720 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:01:58.945813 14720 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:01:58.954563 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:58.955648 14107 raft_consensus.cc:2393] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 1: Already voted for candidate fe6496472aa4477cb4d5a008edd292f6 in this term.
I20260501 14:01:58.955658 13960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:01:58.959372 14148 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:01:58.962122 14720 raft_consensus.cc:3060] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:01:58.977962 14178 raft_consensus.cc:1275] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:01:58.979429 14720 raft_consensus.cc:2749] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:01:58.986868 14660 consensus_queue.cc:1048] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:59.005079 14660 consensus_queue.cc:1048] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260501 14:01:59.014557 13904 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:01:59.094527 14660 consensus_queue.cc:1048] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:01:59.579738 14661 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:59.579839 14725 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:01:59.580525 14661 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:59.580687 14725 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:59.583973 14661 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:59.584224 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:59.584247 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:01:59.585098 14178 raft_consensus.cc:2468] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:59.585320 14030 raft_consensus.cc:2468] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:01:59.586459 14075 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:59.587375 14661 raft_consensus.cc:2804] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:01:59.587424 14725 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:59.587796 14661 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:59.588992 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:01:59.589329 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:01:59.591043 14661 raft_consensus.cc:3060] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:59.591953 14178 raft_consensus.cc:2468] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:01:59.593740 14001 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:01:59.594674 14725 raft_consensus.cc:2804] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:01:59.595060 14725 raft_consensus.cc:493] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:01:59.595381 14725 raft_consensus.cc:3060] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:59.603658 14725 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:59.606894 14661 raft_consensus.cc:515] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:59.611028 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:01:59.608193 14725 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:59.609856 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:59.613198 14178 raft_consensus.cc:3060] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:01:59.613925 14104 raft_consensus.cc:2393] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dba449c6af0341daa28866a4fd46cd96 in current term 2: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:01:59.618917 14661 leader_election.cc:290] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:01:59.619176 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:01:59.621289 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b3f2390f84435b1288ad258be8b49" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:01:59.622220 14030 raft_consensus.cc:2393] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 2: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:01:59.624166 14074 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:01:59.626657 14661 raft_consensus.cc:2749] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260501 14:01:59.632000 14178 raft_consensus.cc:2468] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:01:59.639038 14001 leader_election.cc:304] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:01:59.640122 14725 raft_consensus.cc:2804] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:01:59.641084 14725 raft_consensus.cc:697] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:01:59.645360 14725 consensus_queue.cc:237] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:01:59.659005 13854 catalog_manager.cc:5671] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 0 to 2, leader changed from <none> to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:00.097543 14107 raft_consensus.cc:1275] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:02:00.098992 14725 consensus_queue.cc:1048] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:00.115475 14181 raft_consensus.cc:1275] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:02:00.118407 14725 consensus_queue.cc:1048] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:00.250128  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
W20260501 14:02:00.257267 14001 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260501 14:02:00.272465 14149 consensus_peers.cc:597] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.281549 14001 consensus_peers.cc:597] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.284526 14075 consensus_peers.cc:597] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.294675 14075 consensus_peers.cc:597] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.334873 14075 consensus_peers.cc:597] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.360920 14149 consensus_peers.cc:597] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.364671  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:00.365803  6454 tablet_replica.cc:333] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.366922  6454 raft_consensus.cc:2243] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.367762  6454 raft_consensus.cc:2272] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.368959 14075 consensus_peers.cc:597] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.370489 14149 consensus_peers.cc:597] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.375079  6454 tablet_replica.cc:333] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.376308  6454 raft_consensus.cc:2243] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.377050  6454 raft_consensus.cc:2272] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.380168  6454 tablet_replica.cc:333] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.381273  6454 raft_consensus.cc:2243] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.382440  6454 raft_consensus.cc:2272] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.386541  6454 tablet_replica.cc:333] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
W20260501 14:02:00.386760 14075 consensus_peers.cc:597] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.387537  6454 raft_consensus.cc:2243] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.388293  6454 raft_consensus.cc:2272] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.391229  6454 tablet_replica.cc:333] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.392200  6454 raft_consensus.cc:2243] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.392844  6454 raft_consensus.cc:2272] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.395994  6454 tablet_replica.cc:333] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.397020  6454 raft_consensus.cc:2243] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.398072  6454 raft_consensus.cc:2272] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.400599  6454 tablet_replica.cc:333] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.401237  6454 raft_consensus.cc:2243] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.401666  6454 raft_consensus.cc:2272] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.403604  6454 tablet_replica.cc:333] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.404279  6454 raft_consensus.cc:2243] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.404731  6454 raft_consensus.cc:2272] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.406903  6454 tablet_replica.cc:333] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.407747  6454 raft_consensus.cc:2243] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.408802  6454 raft_consensus.cc:2272] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.411540  6454 tablet_replica.cc:333] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.413707  6454 raft_consensus.cc:2243] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:00.414018 14001 consensus_peers.cc:597] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.414268  6454 raft_consensus.cc:2272] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.417886  6454 tablet_replica.cc:333] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.418861  6454 raft_consensus.cc:2243] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.446923  6454 raft_consensus.cc:2272] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.450850  6454 tablet_replica.cc:333] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.451845  6454 raft_consensus.cc:2243] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.452639  6454 raft_consensus.cc:2272] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.453011 14001 consensus_peers.cc:597] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.457671  6454 tablet_replica.cc:333] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
W20260501 14:02:00.457950 14001 consensus_peers.cc:597] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.461304  6454 raft_consensus.cc:2243] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.462098  6454 raft_consensus.cc:2272] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.478596  6454 tablet_replica.cc:333] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
W20260501 14:02:00.479442 14149 consensus_peers.cc:597] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.480105  6454 raft_consensus.cc:2243] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.480886  6454 raft_consensus.cc:2272] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.487526 14149 consensus_peers.cc:597] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.484211  6454 tablet_replica.cc:333] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.489768  6454 raft_consensus.cc:2243] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.490358  6454 raft_consensus.cc:2272] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.493644  6454 tablet_replica.cc:333] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.494675  6454 raft_consensus.cc:2243] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.495291  6454 raft_consensus.cc:2272] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.495326 14149 consensus_peers.cc:597] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.499166  6454 tablet_replica.cc:333] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.500263  6454 raft_consensus.cc:2243] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.501464  6454 raft_consensus.cc:2272] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.504513  6454 tablet_replica.cc:333] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.505411  6454 raft_consensus.cc:2243] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
W20260501 14:02:00.505802 14001 consensus_peers.cc:597] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.506517  6454 raft_consensus.cc:2272] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.509593  6454 tablet_replica.cc:333] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.510564  6454 raft_consensus.cc:2243] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.511193  6454 raft_consensus.cc:2272] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.514766  6454 tablet_replica.cc:333] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.515754  6454 raft_consensus.cc:2243] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.516431  6454 raft_consensus.cc:2272] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.519757  6454 tablet_replica.cc:333] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.520727  6454 raft_consensus.cc:2243] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.521345  6454 raft_consensus.cc:2272] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.524531  6454 tablet_replica.cc:333] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.525437  6454 raft_consensus.cc:2243] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.526655  6454 raft_consensus.cc:2272] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.529959  6454 tablet_replica.cc:333] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.530879  6454 raft_consensus.cc:2243] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.532205  6454 raft_consensus.cc:2272] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.535418  6454 tablet_replica.cc:333] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.536306  6454 raft_consensus.cc:2243] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.537382  6454 raft_consensus.cc:2272] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.540180  6454 tablet_replica.cc:333] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.541097  6454 raft_consensus.cc:2243] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.541671  6454 raft_consensus.cc:2272] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.543810 14149 consensus_peers.cc:597] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.544624 14149 consensus_peers.cc:597] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.544814  6454 tablet_replica.cc:333] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.545863  6454 raft_consensus.cc:2243] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
W20260501 14:02:00.546609 14075 consensus_peers.cc:597] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.547055  6454 raft_consensus.cc:2272] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.550699  6454 tablet_replica.cc:333] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.551707  6454 raft_consensus.cc:2243] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.553025  6454 raft_consensus.cc:2272] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.555011 14075 consensus_peers.cc:597] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.556104  6454 tablet_replica.cc:333] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.557171  6454 raft_consensus.cc:2243] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.557835  6454 raft_consensus.cc:2272] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.561211  6454 tablet_replica.cc:333] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.562140  6454 raft_consensus.cc:2243] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.563261  6454 raft_consensus.cc:2272] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.566119  6454 tablet_replica.cc:333] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.567037  6454 raft_consensus.cc:2243] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:00.567201 14001 consensus_peers.cc:597] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.567610  6454 raft_consensus.cc:2272] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.570910  6454 tablet_replica.cc:333] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.571784  6454 raft_consensus.cc:2243] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.572391  6454 raft_consensus.cc:2272] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.575594  6454 tablet_replica.cc:333] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.576526  6454 raft_consensus.cc:2243] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.577095  6454 raft_consensus.cc:2272] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.580224  6454 tablet_replica.cc:333] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.581144  6454 raft_consensus.cc:2243] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.582424  6454 raft_consensus.cc:2272] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.584993 14001 consensus_peers.cc:597] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.585618  6454 tablet_replica.cc:333] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.586529  6454 raft_consensus.cc:2243] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.587087  6454 raft_consensus.cc:2272] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.590255  6454 tablet_replica.cc:333] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.591068  6454 raft_consensus.cc:2243] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.591661  6454 raft_consensus.cc:2272] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.594635  6454 tablet_replica.cc:333] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.595496  6454 raft_consensus.cc:2243] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.596094  6454 raft_consensus.cc:2272] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.599035 14149 consensus_peers.cc:597] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.599644  6454 tablet_replica.cc:333] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.600462  6454 raft_consensus.cc:2243] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.601082  6454 raft_consensus.cc:2272] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.603747  6454 tablet_replica.cc:333] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.604413  6454 raft_consensus.cc:2243] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.605307  6454 raft_consensus.cc:2272] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.608184  6454 tablet_replica.cc:333] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.608783  6454 raft_consensus.cc:2243] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.609270  6454 raft_consensus.cc:2272] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.611620  6454 tablet_replica.cc:333] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.612349  6454 raft_consensus.cc:2243] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.612814  6454 raft_consensus.cc:2272] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.614864  6454 tablet_replica.cc:333] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.615564  6454 raft_consensus.cc:2243] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.616099  6454 raft_consensus.cc:2272] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.618839  6454 tablet_replica.cc:333] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.619715  6454 raft_consensus.cc:2243] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.620306  6454 raft_consensus.cc:2272] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.622923  6454 tablet_replica.cc:333] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.623487  6454 raft_consensus.cc:2243] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.624470  6454 raft_consensus.cc:2272] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.627272  6454 tablet_replica.cc:333] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
I20260501 14:02:00.628062  6454 raft_consensus.cc:2243] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:00.629012  6454 raft_consensus.cc:2272] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:00.631568  6454 tablet_replica.cc:333] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: stopping tablet replica
W20260501 14:02:00.631568 14075 consensus_peers.cc:597] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.632382  6454 raft_consensus.cc:2243] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:00.632941  6454 raft_consensus.cc:2272] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:00.650507 14001 consensus_peers.cc:597] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.676677 14149 consensus_peers.cc:597] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.746548  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
W20260501 14:02:00.770361 14149 consensus_peers.cc:597] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.807631 14149 consensus_peers.cc:597] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.811672 14001 consensus_peers.cc:597] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:00.812407 14001 consensus_peers.cc:597] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:00.905990  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:00.915326 14788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:00.915496 14789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:00.919912  6454 server_base.cc:1061] running on GCE node
W20260501 14:02:00.921499 14791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:00.924492  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:00.924839  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:00.925282  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644120925249 us; error 0 us; skew 500 ppm
I20260501 14:02:00.926091  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:00.960083  6454 webserver.cc:492] Webserver started at http://127.6.77.129:33293/ using document root <none> and password file <none>
I20260501 14:02:00.961020  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:00.961287  6454 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260501 14:02:00.981900  6454 fs_manager.cc:714] Time spent opening directory manager: real 0.019s	user 0.007s	sys 0.006s
I20260501 14:02:01.015691 14798 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:01.020658  6454 fs_manager.cc:730] Time spent opening block manager: real 0.027s	user 0.007s	sys 0.002s
I20260501 14:02:01.021185  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "fe6496472aa4477cb4d5a008edd292f6"
format_stamp: "Formatted at 2026-05-01 14:01:44 on dist-test-slave-1sft"
I20260501 14:02:01.021795  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:01.120000  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:01.121814  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:01.146293  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:01.231580 14805 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260501 14:02:01.329928 14769 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.330711 14769 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.333925 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.336311 14769 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:02:01.339246 14149 leader_election.cc:336] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.339653 14149 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.342190 14769 raft_consensus.cc:2749] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.485708 14796 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.486336 14796 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.488792 14796 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.491012 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
W20260501 14:02:01.494016 14149 leader_election.cc:336] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.494443 14149 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.495165 14796 raft_consensus.cc:2749] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.514580 14711 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.515255 14711 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.517316 14711 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.524315 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
W20260501 14:02:01.525125 14075 leader_election.cc:336] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.526564 14075 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.531594 14661 raft_consensus.cc:2749] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 14:02:01.558831 14769 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.559666 14769 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.570175 14769 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.575642 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.576572 14105 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 2.
W20260501 14:02:01.576859 14149 leader_election.cc:336] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.578428 14148 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.579190 14769 raft_consensus.cc:2804] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 14:02:01.579640 14769 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.580070 14769 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:01.580960 14796 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.581591 14796 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.584076 14796 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:02:01.589346 14149 leader_election.cc:336] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.597167 14769 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.600803 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.603294 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:01.604063 14105 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
W20260501 14:02:01.605347 14149 leader_election.cc:336] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.606375 14769 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.608170 14148 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.608956 14796 raft_consensus.cc:2749] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.626503 14105 raft_consensus.cc:2468] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 3.
I20260501 14:02:01.627867 14148 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.628577 14769 raft_consensus.cc:2804] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:01.629117 14769 raft_consensus.cc:697] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 3 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:01.630015 14769 consensus_queue.cc:237] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.634860 14726 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.635502 14726 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.638178 14726 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.640650 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:01.648205 14661 raft_consensus.cc:493] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.648885 14661 raft_consensus.cc:515] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.651330 14661 leader_election.cc:290] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
W20260501 14:02:01.656608 14075 leader_election.cc:336] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.657872 13855 catalog_manager.cc:5671] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 2 to 3, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 3 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:01.659698 14726 raft_consensus.cc:493] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.661540 14726 raft_consensus.cc:515] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:01.660848 14001 leader_election.cc:336] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.665928 14001 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.666848 14773 raft_consensus.cc:2749] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.670024 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.670099 14726 leader_election.cc:290] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:01.672186 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:01.675475 14074 leader_election.cc:304] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.679422 14661 raft_consensus.cc:2749] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.690814 14661 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.691555 14661 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.693969 14783 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.694589 14783 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.696642 14783 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
W20260501 14:02:01.700081 14001 leader_election.cc:336] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.701632 14001 leader_election.cc:304] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.703858 14726 raft_consensus.cc:2749] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.701066 14661 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.711190 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:01.714223 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
W20260501 14:02:01.715485 14075 leader_election.cc:336] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:01.716357 14075 leader_election.cc:336] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.717929 14726 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.718526 14726 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.718986 14074 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.720568 14074 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.722245 14783 raft_consensus.cc:2749] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.723308 14783 raft_consensus.cc:493] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.726986 14726 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.720597 14661 raft_consensus.cc:2749] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.729238 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:01.730073 14783 raft_consensus.cc:515] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.737164 14783 leader_election.cc:290] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
W20260501 14:02:01.734714 14001 leader_election.cc:336] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.737950 14001 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.739252 14773 raft_consensus.cc:2749] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:01.740031 14773 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.740715 14773 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.743172 14773 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:01.740031 14769 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.744257 14769 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.744622  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260501 14:02:01.745046  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.528s	user 0.011s	sys 0.005s
I20260501 14:02:01.745472  6454 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260501 14:02:01.746615 14769 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.748260 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:01.749010 14031 raft_consensus.cc:2468] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:02:01.752445 14148 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:01.753250 14796 raft_consensus.cc:2804] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.753654 14796 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.754011 14796 raft_consensus.cc:3060] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
W20260501 14:02:01.761696 14075 leader_election.cc:336] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:01.762904 14149 leader_election.cc:336] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.764389 14805 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:01.771522 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.772279 14107 raft_consensus.cc:2468] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
W20260501 14:02:01.773094 14001 leader_election.cc:336] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.774757 14000 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.776849 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:01.777144 14773 raft_consensus.cc:2804] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.777730 14031 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:02:01.778151 14773 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.778913 14773 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.785579 14074 leader_election.cc:304] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.787501 14711 raft_consensus.cc:2804] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.787972 14711 raft_consensus.cc:493] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.788374 14711 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.798434 14711 raft_consensus.cc:515] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.802170 14805 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:01.803355 14805 tablet_bootstrap.cc:492] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:01.804294 14797 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.804891 14797 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.807199 14797 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.809092 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:01.809396 14726 raft_consensus.cc:493] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.810038 14031 raft_consensus.cc:2468] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:02:01.815726 14805 ts_tablet_manager.cc:1403] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.004s
I20260501 14:02:01.822904 14726 raft_consensus.cc:515] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:01.822383 14149 leader_election.cc:336] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.827293 14148 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:01.827697 14805 raft_consensus.cc:359] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.828594 14805 raft_consensus.cc:740] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:01.828863 14797 raft_consensus.cc:2804] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.817561 14661 raft_consensus.cc:493] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.821573 14783 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.829552 14661 raft_consensus.cc:515] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.829305 14797 raft_consensus.cc:493] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.830564 14797 raft_consensus.cc:3060] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.831867 14726 leader_election.cc:290] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:01.831948 14661 leader_election.cc:290] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.829897 14783 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.834247 14805 consensus_queue.cc:260] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.835026 14783 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.847306 14783 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.848793 14783 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.832551 14726 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.852246 14769 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.862064 14813 raft_consensus.cc:493] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
W20260501 14:02:01.864588 14075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 47903us
I20260501 14:02:01.863327 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:01.862746 14661 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
W20260501 14:02:01.866600 14000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 91927.4us
I20260501 14:02:01.867472 14661 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.868422 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.869112 14107 raft_consensus.cc:2468] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:02:01.865706 14813 raft_consensus.cc:515] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.865510 14726 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.875651 14727 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.876292 14727 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.877936 14726 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.878312 14727 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.866418 14031 raft_consensus.cc:2468] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:02:01.880379 14813 leader_election.cc:290] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.879518 14711 leader_election.cc:290] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.872192 14661 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.866119 14769 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.886770 14769 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.885216 14809 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.888283 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.888173 14809 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.888754 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:01.889057 14104 raft_consensus.cc:2468] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 1.
I20260501 14:02:01.889436 14107 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 2.
I20260501 14:02:01.886814 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:01.873144 14783 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.890596 14178 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:01.891165 14148 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:01.892268 14148 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:01.894064 14727 raft_consensus.cc:2804] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.894244 14769 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 14:02:01.894474 14727 raft_consensus.cc:493] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.890559 14809 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.904695 14805 ts_tablet_manager.cc:1434] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.081s	user 0.018s	sys 0.016s
I20260501 14:02:01.904479 14000 leader_election.cc:304] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:01.904304 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:01.905684 14181 raft_consensus.cc:2468] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:02:01.906446 14805 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:01.909020 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:01.895332 14769 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.896087 14727 raft_consensus.cc:3060] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.915095 14797 raft_consensus.cc:515] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.912205 14769 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:01.918598 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154bd4746b484c05b7f01be4f586a706" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:01.919222 14031 raft_consensus.cc:3060] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.911005 14773 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:01.939088 14149 leader_election.cc:336] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:01.940443 14810 raft_consensus.cc:2804] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.940989 14810 raft_consensus.cc:493] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.941360 14810 raft_consensus.cc:3060] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.942039 14075 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:01.943861 14661 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 14:02:01.944252 14661 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.944626 14661 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:01.950244 14031 raft_consensus.cc:2468] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 2.
I20260501 14:02:01.952255 14661 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.881574 14796 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:01.955067 14075 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:01.926453 14797 leader_election.cc:290] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.958467 14814 raft_consensus.cc:2804] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:01.958936 14814 raft_consensus.cc:493] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.959357 14814 raft_consensus.cc:3060] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.958971 14773 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:01.954201 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:01.970636 14816 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.971406 14816 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.974310 14809 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.975006 14809 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.976007 14107 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.976521 14727 raft_consensus.cc:515] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.977798 14178 raft_consensus.cc:2393] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 2: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:02:01.978675 14727 leader_election.cc:290] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.980316 14809 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.959995 14796 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:01.981171 14769 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:01.988837 14726 raft_consensus.cc:493] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:01.996285 14726 raft_consensus.cc:515] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:01.996690 14769 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:01.997058 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:01.997706 14033 raft_consensus.cc:3060] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:01.998332 14726 leader_election.cc:290] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.004823 14816 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:01.950330 14810 raft_consensus.cc:515] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:02.007372 14075 leader_election.cc:336] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.007615 14810 leader_election.cc:290] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:01.954308 14661 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:02.008140 14814 raft_consensus.cc:515] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.009553 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:02.018009 14105 raft_consensus.cc:2468] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:02:02.018887 14148 leader_election.cc:304] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:02.011247 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:02.013585 14033 raft_consensus.cc:2468] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 2.
I20260501 14:02:02.014839 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c97fd620b464e0c91cdcd6df3e535ab" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:02.020974 14103 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:02:02.021420 14104 raft_consensus.cc:3060] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.015723 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398bfbe172bd426db8d5dfc783abed5d" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:02.019919 14000 leader_election.cc:304] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.024147 14109 raft_consensus.cc:3060] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.024502 14810 raft_consensus.cc:2804] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:02.024657 14000 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.025010 14810 raft_consensus.cc:493] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.025830 14821 raft_consensus.cc:2804] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:02.026261 14821 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.026634 14821 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.020802 14814 leader_election.cc:290] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:02.028910 14810 raft_consensus.cc:3060] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.029400 14818 raft_consensus.cc:2804] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.029968 14818 raft_consensus.cc:697] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 2 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:02.024686 14107 raft_consensus.cc:2468] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
W20260501 14:02:02.004714 14149 leader_election.cc:336] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.032248 14818 consensus_queue.cc:237] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:02.034214 14000 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.035238 14773 raft_consensus.cc:2804] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.035756 14773 raft_consensus.cc:697] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
W20260501 14:02:02.036017 14149 leader_election.cc:336] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.036779 14773 consensus_queue.cc:237] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.041574 14805 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:02.042426 14109 raft_consensus.cc:2468] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 2.
I20260501 14:02:02.040723 14148 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:02.043906 14727 raft_consensus.cc:2804] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.044445 14727 raft_consensus.cc:697] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 2 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:02.042649 14805 tablet_bootstrap.cc:492] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:02.045641 14727 consensus_queue.cc:237] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:02.046208 14104 raft_consensus.cc:2468] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:02.047530 14000 leader_election.cc:304] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.047562 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:02.048470 14726 raft_consensus.cc:2804] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.049014 14726 raft_consensus.cc:697] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:02.049984 14726 consensus_queue.cc:237] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.048691 14109 raft_consensus.cc:2393] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcac793323404da6a1245c4c5264b767 in current term 3: Already voted for candidate e6f0deb8c1e1415693f8ab2ca413688d in this term.
I20260501 14:02:02.053918 14178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:02.054615 14178 raft_consensus.cc:2468] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
W20260501 14:02:02.055238 14001 leader_election.cc:336] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.055920 14074 leader_election.cc:304] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.056852 14814 raft_consensus.cc:2764] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260501 14:02:02.059617 14148 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:02.046093 14805 ts_tablet_manager.cc:1403] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.008s
W20260501 14:02:02.065255 14075 leader_election.cc:336] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.065164 14805 raft_consensus.cc:359] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.065467 14821 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:02.108985 14001 leader_election.cc:336] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.072389 14149 leader_election.cc:336] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.110863 14805 raft_consensus.cc:740] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:02.111048 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
W20260501 14:02:02.111263 14149 leader_election.cc:336] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.111680 14107 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
W20260501 14:02:02.112129 14149 leader_election.cc:336] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.111830 14805 consensus_queue.cc:260] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.112574 14149 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.085909 14816 raft_consensus.cc:493] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.113389 14816 raft_consensus.cc:515] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.113945 14805 ts_tablet_manager.cc:1434] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260501 14:02:02.115556 14816 leader_election.cc:290] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.086275 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:02.116808 14183 raft_consensus.cc:2393] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 3: Already voted for candidate fcac793323404da6a1245c4c5264b767 in this term.
I20260501 14:02:02.089247 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:02.114915 14805 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:02.117772 14181 raft_consensus.cc:2468] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 1.
I20260501 14:02:02.090039 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39734d31bb3943c1a3477c1ced03bdb6" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:02.118981 14177 raft_consensus.cc:3060] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.090891 14810 raft_consensus.cc:515] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.123138 13855 catalog_manager.cc:5671] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.093638 14726 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.126066 14726 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.126658 14001 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.127487 14816 raft_consensus.cc:2804] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:02.094519 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:02.127913 14816 raft_consensus.cc:493] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.128217 14033 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.128350 14816 raft_consensus.cc:3060] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.094931 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:02.095306 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:02.109512 14821 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.066054 14796 raft_consensus.cc:2804] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.132550 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ebd762ee5d435fa14f8a227d9b05f9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:02.132766 14796 raft_consensus.cc:697] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 2 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:02.133226 14103 raft_consensus.cc:3060] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.125514 14810 leader_election.cc:290] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.133720 14796 consensus_queue.cc:237] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.135293 14726 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.136910 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:02.137048 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:02.137753 14104 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:02:02.137949 14818 raft_consensus.cc:2749] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 14:02:02.137579 14109 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 1.
I20260501 14:02:02.142976 14033 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:02.142688 13858 catalog_manager.cc:5671] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 2 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.144819 13858 catalog_manager.cc:5671] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 2 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.147629 14000 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.149235 14000 leader_election.cc:304] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.130637 14107 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:02.131340 14031 raft_consensus.cc:2393] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 2: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
I20260501 14:02:02.131798 14030 raft_consensus.cc:2393] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6f0deb8c1e1415693f8ab2ca413688d in current term 2: Already voted for candidate dba449c6af0341daa28866a4fd46cd96 in this term.
W20260501 14:02:02.110270 14075 leader_election.cc:336] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.151607 14103 raft_consensus.cc:2468] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:02.151861 14812 raft_consensus.cc:2804] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:02.152416 14812 raft_consensus.cc:493] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.152804 14812 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.155380 14177 raft_consensus.cc:2468] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
W20260501 14:02:02.152426 14075 leader_election.cc:336] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.157545 14075 leader_election.cc:336] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.157987 14075 leader_election.cc:336] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.158653 14075 leader_election.cc:336] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.161844 14000 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.163110 14000 leader_election.cc:304] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:02.163710 14821 raft_consensus.cc:2804] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.151091 14726 raft_consensus.cc:2804] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:02.165174 14726 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.165640 14726 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.169283 14103 raft_consensus.cc:1275] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Refusing update from remote peer fcac793323404da6a1245c4c5264b767: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 14:02:02.170486 14821 raft_consensus.cc:697] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
W20260501 14:02:02.176501 14001 leader_election.cc:336] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.177315 14075 leader_election.cc:304] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
W20260501 14:02:02.177822 14001 leader_election.cc:336] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.179311 14001 leader_election.cc:336] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.180433 14001 leader_election.cc:336] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.179474 14814 raft_consensus.cc:2749] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:02.179642 14818 consensus_queue.cc:1048] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260501 14:02:02.186753 14817 raft_consensus.cc:2804] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
W20260501 14:02:02.187645 14001 leader_election.cc:336] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.188601 14001 leader_election.cc:336] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.189159 14074 leader_election.cc:304] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.171514 14821 consensus_queue.cc:237] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:02.194269 14149 consensus_peers.cc:597] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.196018 13858 catalog_manager.cc:5671] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 2 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.196579 14074 leader_election.cc:304] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.198076 14809 raft_consensus.cc:2804] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.198690 14809 raft_consensus.cc:697] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:02.199537 14809 consensus_queue.cc:237] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
W20260501 14:02:02.203373 14001 leader_election.cc:336] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.210026 14074 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.210271 14661 raft_consensus.cc:2749] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:02.210891 14813 raft_consensus.cc:2749] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:02.212733 14816 raft_consensus.cc:515] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:02.213857 14075 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:02.215334 14812 raft_consensus.cc:515] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.216208 14075 leader_election.cc:304] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
W20260501 14:02:02.216869 14001 leader_election.cc:336] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.216058 14813 raft_consensus.cc:2804] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:02.224097 14813 raft_consensus.cc:493] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:02.224535 14813 raft_consensus.cc:3060] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.222457 14661 raft_consensus.cc:2804] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.230738 14661 raft_consensus.cc:697] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:02.231699 14661 consensus_queue.cc:237] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.232245 14816 leader_election.cc:290] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:02:02.232190 14075 leader_election.cc:336] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.235865 14075 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
W20260501 14:02:02.236959 14075 leader_election.cc:336] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.237731 14075 leader_election.cc:336] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.239732 14783 raft_consensus.cc:2749] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260501 14:02:02.241060 14817 raft_consensus.cc:697] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:02.242092 14817 consensus_queue.cc:237] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.245611 14812 leader_election.cc:290] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.248608 14726 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.250913 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:02.251225 14805 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:02.251632 14105 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.252365 14805 tablet_bootstrap.cc:492] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:02.253196 14805 ts_tablet_manager.cc:1403] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.012s
I20260501 14:02:02.250913 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3834cf44f254585909e19f7b9cccaba" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:02.254302 14177 raft_consensus.cc:3060] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:02.246025 14813 raft_consensus.cc:515] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.258149 14726 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:02.263316 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:02.264261 14109 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
W20260501 14:02:02.274945 14001 leader_election.cc:336] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.275388 13858 catalog_manager.cc:5671] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 2 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } }
W20260501 14:02:02.292292 14001 leader_election.cc:336] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:02.292909 14001 leader_election.cc:336] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.296000 14105 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:02.299198 14000 leader_election.cc:304] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.303267 14109 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:02.304699 14000 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.315758 14829 raft_consensus.cc:2804] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.316463 14829 raft_consensus.cc:697] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:02.317162 14812 raft_consensus.cc:2804] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.317801 14812 raft_consensus.cc:697] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:02.317371 14829 consensus_queue.cc:237] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.318747 14812 consensus_queue.cc:237] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.309412 14805 raft_consensus.cc:359] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.322309 14805 raft_consensus.cc:740] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:02.323333 14805 consensus_queue.cc:260] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.327085 14805 ts_tablet_manager.cc:1434] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.003s
I20260501 14:02:02.307531 14177 raft_consensus.cc:2468] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:02.327428 13855 catalog_manager.cc:5671] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.345446 13855 catalog_manager.cc:5671] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.349607 14001 leader_election.cc:304] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.359627 14816 raft_consensus.cc:2804] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.370235 14816 raft_consensus.cc:697] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:02.371260 14816 consensus_queue.cc:237] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:02.390594 14805 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:02.370256 14813 leader_election.cc:290] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:02.395913 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1903b4ee9466a83fa31497f59744e" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:02.396670 14177 raft_consensus.cc:3060] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
W20260501 14:02:02.409893 14075 leader_election.cc:336] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:02.420306 14177 raft_consensus.cc:2468] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:02.428639 14075 leader_election.cc:304] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:02.429699 14661 raft_consensus.cc:2804] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:02.430260 14661 raft_consensus.cc:697] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:02.431216 14661 consensus_queue.cc:237] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:02.434372 13858 catalog_manager.cc:5671] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 2 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.485522 14030 raft_consensus.cc:1275] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fcac793323404da6a1245c4c5264b767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.487099 14727 consensus_queue.cc:1048] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:02.497516 13855 catalog_manager.cc:5671] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 2 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.550283 14030 raft_consensus.cc:1275] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fcac793323404da6a1245c4c5264b767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.554503 14769 consensus_queue.cc:1048] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:02.556897 14107 raft_consensus.cc:1275] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fcac793323404da6a1245c4c5264b767: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.558882  6454 ts_tablet_manager.cc:616] Registered 45 tablets
I20260501 14:02:02.560041 14769 consensus_queue.cc:1048] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 14:02:02.564535 14001 consensus_peers.cc:597] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.566048  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.814s	user 0.327s	sys 0.025s
I20260501 14:02:02.568423 13855 catalog_manager.cc:5671] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.576624 14103 raft_consensus.cc:1275] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.578224 14816 consensus_queue.cc:1048] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:02.571918 13855 catalog_manager.cc:5671] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:02.582760 13855 catalog_manager.cc:5671] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:02.584607 13855 catalog_manager.cc:5671] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
W20260501 14:02:02.624081 14149 consensus_peers.cc:597] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:02.662132 14075 consensus_peers.cc:597] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:02.668344 14149 consensus_peers.cc:597] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:02.670058 14149 consensus_peers.cc:597] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.683904 14105 raft_consensus.cc:1275] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.692196 14805 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:02.693709 14805 tablet_bootstrap.cc:492] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:02.694728 14805 ts_tablet_manager.cc:1403] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.304s	user 0.036s	sys 0.017s
W20260501 14:02:02.697956 14075 consensus_peers.cc:597] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.698110 14805 raft_consensus.cc:359] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.698853 14805 raft_consensus.cc:740] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:02.702127 14812 consensus_queue.cc:1048] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:02.700158 14805 consensus_queue.cc:260] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.706058 14805 ts_tablet_manager.cc:1434] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260501 14:02:02.706933 14805 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:02.725762 14001 consensus_peers.cc:597] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.729408 14107 raft_consensus.cc:1275] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260501 14:02:02.731506 14001 consensus_peers.cc:597] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.734033 14816 consensus_queue.cc:1048] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260501 14:02:02.734539 14001 consensus_peers.cc:597] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.753006 14177 raft_consensus.cc:1275] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.756037 14783 consensus_queue.cc:1048] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:02.765188 14105 raft_consensus.cc:1275] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260501 14:02:02.769686 14001 consensus_peers.cc:597] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:02.770964 14109 raft_consensus.cc:1275] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.772269 14031 raft_consensus.cc:1275] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.772583 14812 consensus_queue.cc:1048] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:02.773941 14711 consensus_queue.cc:1048] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:02.776933 14773 consensus_queue.cc:1048] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 14:02:02.810009 14001 consensus_peers.cc:597] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:02.817828 14001 consensus_peers.cc:597] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.843254 14075 consensus_peers.cc:597] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.845849 14075 consensus_peers.cc:597] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:02.847939 14183 raft_consensus.cc:1275] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.849062 14661 consensus_queue.cc:1048] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 14:02:02.862236 14001 consensus_peers.cc:597] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.889688 14001 consensus_peers.cc:597] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.897416 14805 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:02.900282 14805 tablet_bootstrap.cc:492] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:02.902897 14805 ts_tablet_manager.cc:1403] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.196s	user 0.024s	sys 0.023s
I20260501 14:02:02.906109 14805 raft_consensus.cc:359] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.906896 14805 raft_consensus.cc:740] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:02.908177 14805 consensus_queue.cc:260] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:02.910463 14805 ts_tablet_manager.cc:1434] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260501 14:02:02.911213 14075 consensus_peers.cc:597] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.916919 14805 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:02.929236 14001 consensus_peers.cc:597] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:02.939236 14105 raft_consensus.cc:1275] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260501 14:02:02.927575 14075 consensus_peers.cc:597] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:02.940999 14816 consensus_queue.cc:1048] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260501 14:02:02.954986 14149 consensus_peers.cc:597] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.978188 14149 consensus_peers.cc:597] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.979991 14001 consensus_peers.cc:597] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.982867 14001 consensus_peers.cc:597] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:02.986060 14075 consensus_peers.cc:597] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:02.989945 14183 raft_consensus.cc:1275] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:02.991696 14812 consensus_queue.cc:1048] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:03.005030 14805 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.006292 14805 tablet_bootstrap.cc:492] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.007141 14805 ts_tablet_manager.cc:1403] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.008s
I20260501 14:02:03.010222 14805 raft_consensus.cc:359] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.011021 14805 raft_consensus.cc:740] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.011802 14805 consensus_queue.cc:260] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.082895 14805 ts_tablet_manager.cc:1434] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.075s	user 0.000s	sys 0.008s
I20260501 14:02:03.087034 14805 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:03.101238 14149 consensus_peers.cc:597] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.102080 14149 consensus_peers.cc:597] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.104620 14001 consensus_peers.cc:597] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.105432 14001 consensus_peers.cc:597] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.145351 14149 consensus_peers.cc:597] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.146214 14149 consensus_peers.cc:597] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.185575 14001 consensus_peers.cc:597] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.209549 14075 consensus_peers.cc:597] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.221585 14149 consensus_peers.cc:597] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.237972 14805 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.239638 14805 tablet_bootstrap.cc:492] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.241186 14805 ts_tablet_manager.cc:1403] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.155s	user 0.022s	sys 0.009s
W20260501 14:02:03.244058 14075 consensus_peers.cc:597] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.246361 14805 raft_consensus.cc:359] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
W20260501 14:02:03.247499 14149 consensus_peers.cc:597] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.261571 14149 consensus_peers.cc:597] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.247408 14805 raft_consensus.cc:740] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.269867 14805 consensus_queue.cc:260] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.276110 14805 ts_tablet_manager.cc:1434] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260501 14:02:03.286720 14805 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:03.297250 14075 consensus_peers.cc:597] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260501 14:02:03.314045 14001 consensus_peers.cc:597] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.323076 14805 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.324978 14805 tablet_bootstrap.cc:492] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.325834 14805 ts_tablet_manager.cc:1403] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.003s
I20260501 14:02:03.331802 14805 raft_consensus.cc:359] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.332778 14805 raft_consensus.cc:740] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.333833 14805 consensus_queue.cc:260] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.336812 14805 ts_tablet_manager.cc:1434] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260501 14:02:03.338085 14805 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:03.343987 14149 consensus_peers.cc:597] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.362715 14805 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.364024 14805 tablet_bootstrap.cc:492] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.365433 14805 ts_tablet_manager.cc:1403] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260501 14:02:03.368387 14805 raft_consensus.cc:359] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:03.368993 14805 raft_consensus.cc:740] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.369930 14805 consensus_queue.cc:260] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:03.373369 14805 ts_tablet_manager.cc:1434] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260501 14:02:03.374671 14805 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:03.387400 14149 consensus_peers.cc:597] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.397687 14805 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.398788 14805 tablet_bootstrap.cc:492] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.399497 14805 ts_tablet_manager.cc:1403] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260501 14:02:03.402215 14805 raft_consensus.cc:359] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:03.402765 14805 raft_consensus.cc:740] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.403352 14805 consensus_queue.cc:260] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:03.405463 14805 ts_tablet_manager.cc:1434] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260501 14:02:03.406545 14805 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:03.418237 14075 consensus_peers.cc:597] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:03.446621 14805 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.447739 14805 tablet_bootstrap.cc:492] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.448894 14805 ts_tablet_manager.cc:1403] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.043s	user 0.029s	sys 0.008s
I20260501 14:02:03.454470 14805 raft_consensus.cc:359] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.455502 14805 raft_consensus.cc:740] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.456458 14805 consensus_queue.cc:260] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.461017 14805 ts_tablet_manager.cc:1434] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260501 14:02:03.462193 14805 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:03.509027 14805 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.510216 14805 tablet_bootstrap.cc:492] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.511456 14805 ts_tablet_manager.cc:1403] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.006s
I20260501 14:02:03.514578 14805 raft_consensus.cc:359] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:03.519146 14805 raft_consensus.cc:740] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.520303 14805 consensus_queue.cc:260] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:03.523648 14805 ts_tablet_manager.cc:1434] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260501 14:02:03.524811 14805 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:03.566576 14815 raft_consensus.cc:493] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:03.567507 14815 raft_consensus.cc:515] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.568658 14805 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.569818 14805 tablet_bootstrap.cc:492] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.570544 14805 ts_tablet_manager.cc:1403] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.008s
I20260501 14:02:03.581795 14805 raft_consensus.cc:359] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:03.582707 14805 raft_consensus.cc:740] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.583472 14805 consensus_queue.cc:260] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:03.592409 14815 leader_election.cc:290] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:03.644173 14805 ts_tablet_manager.cc:1434] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.073s	user 0.012s	sys 0.001s
I20260501 14:02:03.670686 14805 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:03.709542 14769 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:03.710245 14769 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.713639 14769 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:03.714596 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:03.715559 14104 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 3.
I20260501 14:02:03.716996 14148 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:03.718770 14769 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260501 14:02:03.719115 14769 raft_consensus.cc:493] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:03.719409 14769 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Advancing to term 4
I20260501 14:02:03.732939 14769 raft_consensus.cc:515] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.735106 14909 raft_consensus.cc:493] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:03.735937 14909 raft_consensus.cc:515] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.736922 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:03.737452 14104 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Advancing to term 4
I20260501 14:02:03.738469 14909 leader_election.cc:290] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:03.745673 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:03.749454 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:03.769210 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1e3df02974207a6e359613777bc2a" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:03.771806 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e246a62848488dbc45a3794baac420" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:03.773705 14802 leader_election.cc:304] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:02:03.774636 14909 raft_consensus.cc:2749] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:03.775166 14802 leader_election.cc:304] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:02:03.776050 14909 raft_consensus.cc:2749] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 14:02:03.780642 14104 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 4.
I20260501 14:02:03.736372 14769 leader_election.cc:290] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 4 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:03.782052 14805 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.782922 14148 leader_election.cc:304] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:03.783365 14805 tablet_bootstrap.cc:492] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.784368 14805 ts_tablet_manager.cc:1403] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.006s
I20260501 14:02:03.785184 14727 raft_consensus.cc:2804] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 4 FOLLOWER]: Leader election won for term 4
I20260501 14:02:03.785772 14727 raft_consensus.cc:697] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 4 LEADER]: Becoming Leader. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:03.786857 14727 consensus_queue.cc:237] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.798023 14805 raft_consensus.cc:359] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.808162 14805 raft_consensus.cc:740] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.810079 14805 consensus_queue.cc:260] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.815582 14805 ts_tablet_manager.cc:1434] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260501 14:02:03.816809 14805 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:03.818697 13855 catalog_manager.cc:5671] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 reported cstate change: term changed from 2 to 4, leader changed from fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129) to fcac793323404da6a1245c4c5264b767 (127.6.77.132). New cstate: current_term: 4 leader_uuid: "fcac793323404da6a1245c4c5264b767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:03.848315 14909 raft_consensus.cc:493] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:03.849095 14909 raft_consensus.cc:515] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.854008 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:03.855556 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:03.858587 14801 leader_election.cc:304] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:02:03.859676 14815 raft_consensus.cc:2749] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:03.860497 14909 leader_election.cc:290] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:03.862520 14805 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.864073 14805 tablet_bootstrap.cc:492] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.865082 14805 ts_tablet_manager.cc:1403] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.012s
I20260501 14:02:03.869302 14805 raft_consensus.cc:359] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:03.883487 14805 raft_consensus.cc:740] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.884683 14805 consensus_queue.cc:260] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:03.891484 14805 ts_tablet_manager.cc:1434] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.001s
I20260501 14:02:03.894169 14805 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:03.946727  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:43181
I20260501 14:02:03.951478 14938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:43181 every 8 connection(s)
I20260501 14:02:03.964576 14805 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:03.966099 14805 tablet_bootstrap.cc:492] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:03.966957 14805 ts_tablet_manager.cc:1403] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.073s	user 0.032s	sys 0.018s
I20260501 14:02:03.970284 14805 raft_consensus.cc:359] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.971184 14805 raft_consensus.cc:740] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:03.972057 14805 consensus_queue.cc:260] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:03.975494 14805 ts_tablet_manager.cc:1434] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:02:03.977365 14805 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.003453 14805 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.004719 14805 tablet_bootstrap.cc:492] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.005511 14805 ts_tablet_manager.cc:1403] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260501 14:02:04.009543 14805 raft_consensus.cc:359] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.010360 14805 raft_consensus.cc:740] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.011126 14805 consensus_queue.cc:260] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.014963 14805 ts_tablet_manager.cc:1434] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:02:04.016117 14805 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.019642 14939 heartbeater.cc:344] Connected to a master server at 127.6.77.190:42909
I20260501 14:02:04.020292 14939 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:04.021366 14939 heartbeater.cc:507] Master 127.6.77.190:42909 requested a full tablet report, sending...
I20260501 14:02:04.035305 14805 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.036664 14805 tablet_bootstrap.cc:492] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.037324 14805 ts_tablet_manager.cc:1403] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260501 14:02:04.040421 14805 raft_consensus.cc:359] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:04.041052 14805 raft_consensus.cc:740] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.041703 14805 consensus_queue.cc:260] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:04.043500 14805 ts_tablet_manager.cc:1434] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260501 14:02:04.044332 14805 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.055111 13855 ts_manager.cc:194] Re-registered known tserver with Master: fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:04.062975 14805 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.064235 14805 tablet_bootstrap.cc:492] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.064999 14805 ts_tablet_manager.cc:1403] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260501 14:02:04.068217 14805 raft_consensus.cc:359] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.068989 14805 raft_consensus.cc:740] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.069830 14805 consensus_queue.cc:260] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.072404 14805 ts_tablet_manager.cc:1434] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260501 14:02:04.073366 14805 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.081987 14909 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:04.082657 14909 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.089983 14909 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:04.093075 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:04.109028 14805 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.110262 14805 tablet_bootstrap.cc:492] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.110986 14805 ts_tablet_manager.cc:1403] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.000s
I20260501 14:02:04.114166 14805 raft_consensus.cc:359] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.115017 14805 raft_consensus.cc:740] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.115803 14805 consensus_queue.cc:260] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.118279 14805 ts_tablet_manager.cc:1434] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260501 14:02:04.119235 14805 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.136642 13855 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45112
I20260501 14:02:04.143708 14805 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.144014 14939 heartbeater.cc:499] Master 127.6.77.190:42909 was elected leader, sending a full tablet report...
I20260501 14:02:04.144980 14805 tablet_bootstrap.cc:492] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.145799 14805 ts_tablet_manager.cc:1403] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260501 14:02:04.146114 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:04.148101 14801 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:02:04.148895 14805 raft_consensus.cc:359] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.149384 14909 raft_consensus.cc:2749] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:04.149785 14805 raft_consensus.cc:740] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.150579 14805 consensus_queue.cc:260] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.152959 14805 ts_tablet_manager.cc:1434] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260501 14:02:04.153900 14805 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.178563 14805 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.179481 14805 tablet_bootstrap.cc:492] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.180220 14805 ts_tablet_manager.cc:1403] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.001s
I20260501 14:02:04.183435 14805 raft_consensus.cc:359] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.184283 14805 raft_consensus.cc:740] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.185197 14805 consensus_queue.cc:260] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.188364 14805 ts_tablet_manager.cc:1434] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:02:04.189476 14805 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.211201 14805 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.212491 14805 tablet_bootstrap.cc:492] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.213220 14805 ts_tablet_manager.cc:1403] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260501 14:02:04.216274 14805 raft_consensus.cc:359] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.218297 14805 raft_consensus.cc:740] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.217610 14109 raft_consensus.cc:1275] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 4 FOLLOWER]: Refusing update from remote peer fcac793323404da6a1245c4c5264b767: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260501 14:02:04.219165 14805 consensus_queue.cc:260] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.221978 14727 consensus_queue.cc:1048] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:04.223109 14805 ts_tablet_manager.cc:1434] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260501 14:02:04.224555 14805 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.272399 14805 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.277189 14805 tablet_bootstrap.cc:492] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.278030 14805 ts_tablet_manager.cc:1403] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.004s
I20260501 14:02:04.280917 14805 raft_consensus.cc:359] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.282404 14805 raft_consensus.cc:740] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.283154 14805 consensus_queue.cc:260] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.286794 14805 ts_tablet_manager.cc:1434] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260501 14:02:04.287858 14805 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.324855 14805 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.326160 14805 tablet_bootstrap.cc:492] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.327541 14805 ts_tablet_manager.cc:1403] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.004s
I20260501 14:02:04.330552 14805 raft_consensus.cc:359] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.331388 14805 raft_consensus.cc:740] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.332134 14805 consensus_queue.cc:260] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.334466 14805 ts_tablet_manager.cc:1434] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260501 14:02:04.335355 14805 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.353942 14805 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.354849 14805 tablet_bootstrap.cc:492] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.355552 14805 ts_tablet_manager.cc:1403] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260501 14:02:04.357868 14805 raft_consensus.cc:359] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.358444 14805 raft_consensus.cc:740] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.359059 14805 consensus_queue.cc:260] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:04.361233 14805 ts_tablet_manager.cc:1434] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260501 14:02:04.362653 14805 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.378321 14909 raft_consensus.cc:493] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:04.379070 14909 raft_consensus.cc:515] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.381361 14909 leader_election.cc:290] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:04.383198 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:04.384604 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7467482380a426188c5b2ac43d54310" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:04.387719 14801 leader_election.cc:304] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:02:04.389364 14909 raft_consensus.cc:2749] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:04.401361 14805 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.403213 14805 tablet_bootstrap.cc:492] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.404078 14805 ts_tablet_manager.cc:1403] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.014s
I20260501 14:02:04.407112 14805 raft_consensus.cc:359] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.407959 14805 raft_consensus.cc:740] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.408776 14805 consensus_queue.cc:260] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.411484 14805 ts_tablet_manager.cc:1434] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260501 14:02:04.412415 14805 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.431249 14805 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.432322 14805 tablet_bootstrap.cc:492] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.433076 14805 ts_tablet_manager.cc:1403] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260501 14:02:04.436349 14805 raft_consensus.cc:359] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.437073 14805 raft_consensus.cc:740] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.437848 14805 consensus_queue.cc:260] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.445516 14805 ts_tablet_manager.cc:1434] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260501 14:02:04.446658 14805 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.464639 14805 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.465473 14805 tablet_bootstrap.cc:492] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.466106 14805 ts_tablet_manager.cc:1403] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260501 14:02:04.468464 14805 raft_consensus.cc:359] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.469231 14805 raft_consensus.cc:740] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.470014 14805 consensus_queue.cc:260] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:04.472267 14805 ts_tablet_manager.cc:1434] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260501 14:02:04.473150 14805 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.479792 14892 raft_consensus.cc:3060] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.481127 14894 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.492656 14896 raft_consensus.cc:3060] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.496449 14897 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.501993 14891 raft_consensus.cc:3060] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.506156 14895 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.530566 14890 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.541141 14889 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.604897 14909 raft_consensus.cc:493] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:04.605679 14909 raft_consensus.cc:515] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:04.615084 14909 leader_election.cc:290] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:04.617775 14887 raft_consensus.cc:3060] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.619019 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:04.634532 14888 raft_consensus.cc:3060] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.641574 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fbdffa2ccc49c9be276b75784b7fc1" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" is_pre_election: true
I20260501 14:02:04.719600 14801 leader_election.cc:304] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767
I20260501 14:02:04.770987 14965 raft_consensus.cc:2749] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260501 14:02:04.802337 14805 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:04.804426 14805 tablet_bootstrap.cc:492] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:04.805761 14805 ts_tablet_manager.cc:1403] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.333s	user 0.090s	sys 0.115s
I20260501 14:02:04.877074 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
W20260501 14:02:04.886080 14963 log.cc:927] Time spent T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260501 14:02:04.886415 14894 raft_consensus.cc:3060] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 4
I20260501 14:02:04.877550 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de26ee36254bc5966555788936888a" candidate_uuid: "fcac793323404da6a1245c4c5264b767" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fe6496472aa4477cb4d5a008edd292f6" is_pre_election: true
I20260501 14:02:04.894213 14897 raft_consensus.cc:3060] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:04.969179 14805 raft_consensus.cc:359] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:04.970078 14805 raft_consensus.cc:740] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:04.970815 14805 consensus_queue.cc:260] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:04.974020 14805 ts_tablet_manager.cc:1434] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.168s	user 0.007s	sys 0.001s
I20260501 14:02:04.975991 14805 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:04.959599 14896 raft_consensus.cc:3060] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 3
W20260501 14:02:04.928633 14801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 242041us
W20260501 14:02:05.034104 14981 log.cc:927] Time spent T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260501 14:02:05.075977 14000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 57867.2us
W20260501 14:02:05.081961 14986 log.cc:927] Time spent T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260501 14:02:05.139530 14894 raft_consensus.cc:2468] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcac793323404da6a1245c4c5264b767 in term 4.
I20260501 14:02:05.143026 14888 raft_consensus.cc:1275] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 4 FOLLOWER]: Refusing update from remote peer fcac793323404da6a1245c4c5264b767: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260501 14:02:05.159076 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.129:43181, user_credentials={real_user=slave}} blocked reactor thread for 111105us
W20260501 14:02:05.171975 14000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 53419us
W20260501 14:02:05.237205 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 166814us
I20260501 14:02:05.245312 14805 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.246589 14805 tablet_bootstrap.cc:492] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.247413 14805 ts_tablet_manager.cc:1403] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.272s	user 0.028s	sys 0.024s
I20260501 14:02:05.249601 14995 consensus_queue.cc:1048] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:05.250507 14805 raft_consensus.cc:359] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:05.257028 14909 raft_consensus.cc:493] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcac793323404da6a1245c4c5264b767)
I20260501 14:02:05.257726 14909 raft_consensus.cc:515] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.262291 14909 leader_election.cc:290] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:05.263800 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:05.251341 14805 raft_consensus.cc:740] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.272161 14805 consensus_queue.cc:260] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:05.274791 14805 ts_tablet_manager.cc:1434] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.006s
I20260501 14:02:05.284848 14805 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.285108 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b188afe7907439098cfaf8f874665bc" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dba449c6af0341daa28866a4fd46cd96" is_pre_election: true
I20260501 14:02:05.287015 14801 leader_election.cc:304] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe6496472aa4477cb4d5a008edd292f6; no voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767
I20260501 14:02:05.288388 14965 raft_consensus.cc:2749] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 14:02:05.328547 14805 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.329758 14805 tablet_bootstrap.cc:492] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.330505 14805 ts_tablet_manager.cc:1403] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.001s
I20260501 14:02:05.333504 14805 raft_consensus.cc:359] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.334244 14805 raft_consensus.cc:740] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.334951 14805 consensus_queue.cc:260] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.349371 14805 ts_tablet_manager.cc:1434] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260501 14:02:05.350363 14805 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.431675 14805 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.437798 14805 tablet_bootstrap.cc:492] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.438632 14805 ts_tablet_manager.cc:1403] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.012s
I20260501 14:02:05.441707 14805 raft_consensus.cc:359] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.442466 14805 raft_consensus.cc:740] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.443171 14805 consensus_queue.cc:260] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.445664 14805 ts_tablet_manager.cc:1434] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260501 14:02:05.448040 14805 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.481181 14805 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.483100 14805 tablet_bootstrap.cc:492] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.484023 14805 ts_tablet_manager.cc:1403] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.005s
I20260501 14:02:05.487607 14805 raft_consensus.cc:359] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.488449 14805 raft_consensus.cc:740] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.489221 14805 consensus_queue.cc:260] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
W20260501 14:02:05.497444 14075 consensus_peers.cc:597] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260501 14:02:05.509845 14805 ts_tablet_manager.cc:1434] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260501 14:02:05.511554 14805 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.574698 14805 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.575838 14805 tablet_bootstrap.cc:492] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.585876 14805 ts_tablet_manager.cc:1403] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.001s
I20260501 14:02:05.599741 14805 raft_consensus.cc:359] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:05.601416 14805 raft_consensus.cc:740] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.618510 14805 consensus_queue.cc:260] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:05.621394 14805 ts_tablet_manager.cc:1434] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260501 14:02:05.685022 14805 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
W20260501 14:02:05.686960 14075 consensus_peers.cc:597] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260501 14:02:05.689781 14001 consensus_peers.cc:597] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260501 14:02:05.690899 14075 consensus_peers.cc:597] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260501 14:02:05.703222 14888 raft_consensus.cc:3060] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:05.825843 14805 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.827006 14805 tablet_bootstrap.cc:492] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.827772 14805 ts_tablet_manager.cc:1403] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.001s
I20260501 14:02:05.830706 14805 raft_consensus.cc:359] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.831424 14805 raft_consensus.cc:740] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.836154 14805 consensus_queue.cc:260] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.838519 14805 ts_tablet_manager.cc:1434] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260501 14:02:05.841044 14805 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.873147 14805 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.874439 14805 tablet_bootstrap.cc:492] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.875285 14805 ts_tablet_manager.cc:1403] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.006s
I20260501 14:02:05.878329 14805 raft_consensus.cc:359] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.879087 14805 raft_consensus.cc:740] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.879805 14805 consensus_queue.cc:260] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:05.882215 14805 ts_tablet_manager.cc:1434] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260501 14:02:05.883188 14805 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.905117 14805 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.906283 14805 tablet_bootstrap.cc:492] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.907061 14805 ts_tablet_manager.cc:1403] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260501 14:02:05.910012 14805 raft_consensus.cc:359] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:05.910784 14805 raft_consensus.cc:740] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.911468 14805 consensus_queue.cc:260] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:05.914218 14805 ts_tablet_manager.cc:1434] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260501 14:02:05.915858 14805 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:05.934543 14805 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:05.935628 14805 tablet_bootstrap.cc:492] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:05.936453 14805 ts_tablet_manager.cc:1403] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260501 14:02:05.939462 14805 raft_consensus.cc:359] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:05.940209 14805 raft_consensus.cc:740] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:05.940901 14805 consensus_queue.cc:260] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:05.943477 14805 ts_tablet_manager.cc:1434] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 14:02:05.944576 14805 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:06.031039 14805 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:06.044373 14805 tablet_bootstrap.cc:492] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:06.045215 14805 ts_tablet_manager.cc:1403] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.101s	user 0.037s	sys 0.037s
I20260501 14:02:06.048316 14805 raft_consensus.cc:359] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:06.049024 14805 raft_consensus.cc:740] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:06.049711 14805 consensus_queue.cc:260] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:06.052300 14805 ts_tablet_manager.cc:1434] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260501 14:02:06.053182 14805 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:06.131856 14805 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:06.132929 14805 tablet_bootstrap.cc:492] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:06.133692 14805 ts_tablet_manager.cc:1403] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.081s	user 0.027s	sys 0.035s
W20260501 14:02:06.145644 14001 consensus_peers.cc:597] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260501 14:02:06.152943 14805 raft_consensus.cc:359] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:06.153785 14805 raft_consensus.cc:740] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:06.154501 14805 consensus_queue.cc:260] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:06.161567 14805 ts_tablet_manager.cc:1434] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260501 14:02:06.162560 14805 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:06.211412 14805 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:06.212653 14805 tablet_bootstrap.cc:492] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:06.213449 14805 ts_tablet_manager.cc:1403] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.003s
I20260501 14:02:06.215793 14805 raft_consensus.cc:359] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:06.216557 14805 raft_consensus.cc:740] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:06.217324 14805 consensus_queue.cc:260] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:06.230386 14805 ts_tablet_manager.cc:1434] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260501 14:02:06.235636 14805 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:06.268047 14805 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:06.269344 14805 tablet_bootstrap.cc:492] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:06.270205 14805 ts_tablet_manager.cc:1403] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.009s
I20260501 14:02:06.272933 14805 raft_consensus.cc:359] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:06.273645 14805 raft_consensus.cc:740] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:06.274333 14805 consensus_queue.cc:260] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:06.276260 14805 ts_tablet_manager.cc:1434] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260501 14:02:06.277046 14805 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:06.305599 14805 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:06.308269 14805 tablet_bootstrap.cc:492] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:06.309142 14805 ts_tablet_manager.cc:1403] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.007s
I20260501 14:02:06.312263 14805 raft_consensus.cc:359] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:06.313005 14805 raft_consensus.cc:740] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:06.313849 14805 consensus_queue.cc:260] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:06.316551 14805 ts_tablet_manager.cc:1434] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260501 14:02:06.318666 14805 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap starting.
I20260501 14:02:06.342448 14805 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260501 14:02:06.343928 14805 tablet_bootstrap.cc:492] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Bootstrap complete.
I20260501 14:02:06.345757 14805 ts_tablet_manager.cc:1403] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260501 14:02:06.349423 14805 raft_consensus.cc:359] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:06.350225 14805 raft_consensus.cc:740] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Initialized, Role: FOLLOWER
I20260501 14:02:06.350984 14805 consensus_queue.cc:260] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:06.353479 14805 ts_tablet_manager.cc:1434] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260501 14:02:06.435765 14896 raft_consensus.cc:3060] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
W20260501 14:02:12.673214 14935 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0d00 after lost signal to thread 6457
W20260501 14:02:12.674611 14935 debug-util.cc:398] Leaking SignalData structure 0x7b08003e69a0 after lost signal to thread 13892
W20260501 14:02:12.675988 14935 debug-util.cc:398] Leaking SignalData structure 0x7b08002a06c0 after lost signal to thread 14059
W20260501 14:02:12.677218 14935 debug-util.cc:398] Leaking SignalData structure 0x7b080000e640 after lost signal to thread 14133
W20260501 14:02:12.678427 14935 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecf40 after lost signal to thread 14207
W20260501 14:02:12.680042 14935 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5be0 after lost signal to thread 14938
W20260501 14:02:13.758507 14001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 83259us
I20260501 14:02:14.133607  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:14.221451 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:14.222479 14030 raft_consensus.cc:606] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:14.244058 14105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59040
I20260501 14:02:14.244882 14105 raft_consensus.cc:606] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:14.247998 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:14.248652 14030 raft_consensus.cc:606] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:14.251361 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:14.251991 14030 raft_consensus.cc:606] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:14.270354 14177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e"
dest_uuid: "fcac793323404da6a1245c4c5264b767"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59356
I20260501 14:02:14.271030 14177 raft_consensus.cc:606] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:14.275538 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:14.276279 14030 raft_consensus.cc:606] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Received request to transfer leadership to TS e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:02:14.279170 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:14.279724 14030 raft_consensus.cc:606] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:14.280966  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260501 14:02:14.283064  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:14.284325  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:14.298472 15058 raft_consensus.cc:993] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower e6f0deb8c1e1415693f8ab2ca413688d to start an election
I20260501 14:02:14.299175 15058 raft_consensus.cc:1081] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Signalling peer e6f0deb8c1e1415693f8ab2ca413688d to start an election
I20260501 14:02:14.301519 14105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
 from {username='slave'} at 127.0.0.1:57038
I20260501 14:02:14.302248 14105 raft_consensus.cc:493] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.302699 14105 raft_consensus.cc:3060] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.327064 14105 raft_consensus.cc:515] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:14.329826 14105 leader_election.cc:290] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:14.332389 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:14.333201 14030 raft_consensus.cc:3055] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:14.333504 14030 raft_consensus.cc:740] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:14.334542 14030 consensus_queue.cc:260] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:14.336011 14030 raft_consensus.cc:3060] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.337249 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8267536f1bb4b159dc87ac7afca5b70" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:14.337965 14177 raft_consensus.cc:3060] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.347072 14030 raft_consensus.cc:2468] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:14.348323 14177 raft_consensus.cc:2468] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:14.348749 14074 leader_election.cc:304] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:14.350167 15060 raft_consensus.cc:2804] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:14.350796 15060 raft_consensus.cc:697] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:14.352479 15060 consensus_queue.cc:237] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:14.366859 15061 raft_consensus.cc:993] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.368085 15058 raft_consensus.cc:1081] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.372884 15059 raft_consensus.cc:993] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.373389 15059 raft_consensus.cc:1081] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.375610 14890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:14.376297 14890 raft_consensus.cc:493] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.376683 14890 raft_consensus.cc:3060] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.376909 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:14.377784 14897 raft_consensus.cc:493] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.378154 14897 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:14.394811 15058 raft_consensus.cc:993] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.395619 15058 raft_consensus.cc:1081] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.382743 13854 catalog_manager.cc:5671] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 1 to 2, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 2 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:14.398249 14896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:14.398880 14896 raft_consensus.cc:493] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.399219 14896 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:14.400874 14890 raft_consensus.cc:515] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.410326 14890 leader_election.cc:290] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:14.411609 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:14.412421 14030 raft_consensus.cc:3055] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:14.412717 14030 raft_consensus.cc:740] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:14.413625 14030 consensus_queue.cc:260] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.416477 15061 raft_consensus.cc:993] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.416749 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f77c3cf0c443cf8e717a27fc040aab" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:14.417402 15061 raft_consensus.cc:1081] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.417650 14105 raft_consensus.cc:3060] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.415149 14030 raft_consensus.cc:3060] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.419509 14890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:14.420238 14890 raft_consensus.cc:493] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.422391 14890 raft_consensus.cc:3060] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.429098 14897 raft_consensus.cc:515] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.440250 14897 leader_election.cc:290] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:14.421406 14896 raft_consensus.cc:515] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.442589 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:14.443027 14896 leader_election.cc:290] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:14.443276 14031 raft_consensus.cc:3055] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:14.443629 14031 raft_consensus.cc:740] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:14.444566 14031 consensus_queue.cc:260] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.446048 14031 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:14.430339 14030 raft_consensus.cc:2468] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.449488 14102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071fccc276bd4528803ab25b4d2dd3a7" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:14.450096 14801 leader_election.cc:304] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:14.450198 14102 raft_consensus.cc:3060] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:14.451790 14890 raft_consensus.cc:515] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:14.453203 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:14.453922 14103 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:14.454670 14890 leader_election.cc:290] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:14.456084 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:14.456738 14181 raft_consensus.cc:3060] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.456619 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfb57bc54a04297a88d40804890af15" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:14.464637 14030 raft_consensus.cc:3055] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:14.466167 14030 raft_consensus.cc:740] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:14.471258 14030 consensus_queue.cc:260] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.476629 14030 raft_consensus.cc:3060] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:14.483268 15069 raft_consensus.cc:2804] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:14.485231 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d7624d3964ef8a521561e8bb5a8e0" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:14.495472 14034 raft_consensus.cc:3055] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:14.495810 14034 raft_consensus.cc:740] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:14.496641 14034 consensus_queue.cc:260] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:14.473795 14105 raft_consensus.cc:2468] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.498093 14034 raft_consensus.cc:3060] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.490649 14181 raft_consensus.cc:2468] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.504081 14802 leader_election.cc:304] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:14.520409 14030 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:14.520409 14103 raft_consensus.cc:2468] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:14.530977 15073 raft_consensus.cc:2804] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:14.536583 14801 leader_election.cc:304] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:14.534475 14102 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:14.540068 15069 raft_consensus.cc:697] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:14.541350 15074 raft_consensus.cc:2804] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:14.548161 15074 raft_consensus.cc:697] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:14.550451 15073 raft_consensus.cc:697] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:14.551674 15073 consensus_queue.cc:237] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:14.494676 14031 raft_consensus.cc:2468] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:14.553774 15074 consensus_queue.cc:237] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.541519 15069 consensus_queue.cc:237] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.573629 14801 leader_election.cc:304] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:14.575649 15075 raft_consensus.cc:2804] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:14.576225 15075 raft_consensus.cc:697] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:14.577195 15075 consensus_queue.cc:237] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:14.585383 14034 raft_consensus.cc:2468] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
W20260501 14:02:14.607407 14802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.132:37909, user_credentials={real_user=slave}} blocked reactor thread for 103597us
I20260501 14:02:14.616072 15057 raft_consensus.cc:993] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.616871 15057 raft_consensus.cc:1081] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.619648 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38582
I20260501 14:02:14.620462 14897 raft_consensus.cc:493] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.620914 14897 raft_consensus.cc:3060] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.639802 13854 catalog_manager.cc:5671] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:14.643989 14897 raft_consensus.cc:515] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:14.648125 14897 leader_election.cc:290] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:14.645613 13854 catalog_manager.cc:5671] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:14.650007 14031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:14.650677 14031 raft_consensus.cc:3060] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.651110 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "844973e68bc642b788a5ef4c699eca7e" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:14.651762 14177 raft_consensus.cc:3055] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:14.652124 14177 raft_consensus.cc:740] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:14.653144 14177 consensus_queue.cc:260] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:14.658634 14177 raft_consensus.cc:3060] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.674206 14177 raft_consensus.cc:2468] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.675546 14802 leader_election.cc:304] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:14.676539 15075 raft_consensus.cc:2804] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:14.677170 15075 raft_consensus.cc:697] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:14.677239 14031 raft_consensus.cc:2468] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.678354 15075 consensus_queue.cc:237] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:14.701768 13854 catalog_manager.cc:5671] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 2 to 3, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:14.703708 13854 catalog_manager.cc:5671] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from fcac793323404da6a1245c4c5264b767 (127.6.77.132) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:14.705562 13854 catalog_manager.cc:5671] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 2 to 3, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:14.741178 15060 raft_consensus.cc:993] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.741802 15060 raft_consensus.cc:1081] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:14.745185 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38678
I20260501 14:02:14.745930 14897 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:14.746338 14897 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.755559 14897 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:14.758642 14897 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:14.758972 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:14.759754 14181 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.758669 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:14.761032 14103 raft_consensus.cc:3055] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:14.761406 14103 raft_consensus.cc:740] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:14.762411 14103 consensus_queue.cc:260] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:14.764128 14103 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:14.767128 14181 raft_consensus.cc:2468] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.768538 14802 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:14.769407 15075 raft_consensus.cc:2804] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:14.769939 15075 raft_consensus.cc:697] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:14.770996 15075 consensus_queue.cc:237] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:14.772778 14103 raft_consensus.cc:2468] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:14.781379 13854 catalog_manager.cc:5671] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:14.832350 14034 raft_consensus.cc:1275] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:14.833798 15060 consensus_queue.cc:1048] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:14.984736 14183 raft_consensus.cc:1275] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:14.993829 15054 consensus_queue.cc:1048] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:15.022039 14031 raft_consensus.cc:1275] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.023964 15075 consensus_queue.cc:1048] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:15.033988 14030 raft_consensus.cc:1275] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:15.036043 15075 consensus_queue.cc:1048] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:15.067168 14105 raft_consensus.cc:1275] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:15.069994 15075 consensus_queue.cc:1048] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:15.072995 14033 raft_consensus.cc:1275] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.075203 15074 consensus_queue.cc:1048] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:15.079171 14183 raft_consensus.cc:1275] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.080830 15075 consensus_queue.cc:1048] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:15.085364 14108 raft_consensus.cc:1275] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:15.087296 15074 consensus_queue.cc:1048] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:15.200884 14182 raft_consensus.cc:1275] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.211620 14033 raft_consensus.cc:1275] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:15.215926 14108 raft_consensus.cc:1275] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.227314 15074 consensus_queue.cc:1048] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260501 14:02:15.244299 14183 raft_consensus.cc:1275] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.256050 15099 consensus_queue.cc:1048] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260501 14:02:15.289740 14801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:42573, user_credentials={real_user=slave}} blocked reactor thread for 76013.8us
I20260501 14:02:15.294912 15102 consensus_queue.cc:1048] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260501 14:02:15.341850 15073 consensus_queue.cc:1048] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:15.347204 14034 raft_consensus.cc:1275] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.359356 14108 raft_consensus.cc:1275] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:15.394073 15099 consensus_queue.cc:1048] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:15.395094 15073 consensus_queue.cc:1048] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:15.540205  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:15.596354 14034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:15.597090 14034 raft_consensus.cc:606] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:15.600522 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df"
dest_uuid: "fcac793323404da6a1245c4c5264b767"
mode: GRACEFUL
new_leader_uuid: "dba449c6af0341daa28866a4fd46cd96"
 from {username='slave'} at 127.0.0.1:59356
I20260501 14:02:15.601146 14183 raft_consensus.cc:606] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Received request to transfer leadership to TS dba449c6af0341daa28866a4fd46cd96
I20260501 14:02:15.603881 14034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:15.604555 14034 raft_consensus.cc:606] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Received request to transfer leadership to TS e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:02:15.607401 14105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93952479e863465a8930469c1e593ae8"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59040
I20260501 14:02:15.608089 14105 raft_consensus.cc:606] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:15.611045 14034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:15.611686 14034 raft_consensus.cc:606] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:15.613045  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 14:02:15.615224  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:15.616115  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:15.651397 15085 raft_consensus.cc:993] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: : Instructing follower dba449c6af0341daa28866a4fd46cd96 to start an election
I20260501 14:02:15.652122 15057 raft_consensus.cc:1081] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Signalling peer dba449c6af0341daa28866a4fd46cd96 to start an election
I20260501 14:02:15.653723 14034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
 from {username='slave'} at 127.0.0.1:43074
I20260501 14:02:15.654232 14034 raft_consensus.cc:493] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:15.654554 14034 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.661499 14034 raft_consensus.cc:515] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:15.665680 14034 leader_election.cc:290] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:15.666385 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:15.667071 14105 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.665576 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:15.668316 14183 raft_consensus.cc:3055] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:15.671082 14183 raft_consensus.cc:740] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:15.671937 14183 consensus_queue.cc:260] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:15.677266 14183 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.677660 14105 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:15.679152 14000 leader_election.cc:304] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, e6f0deb8c1e1415693f8ab2ca413688d; no voters: 
I20260501 14:02:15.680150 15061 raft_consensus.cc:2804] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:15.680645 15061 raft_consensus.cc:697] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:15.681535 15061 consensus_queue.cc:237] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:15.698290 13855 catalog_manager.cc:5671] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fcac793323404da6a1245c4c5264b767 (127.6.77.132) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:15.698282 14183 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:15.708911 15086 raft_consensus.cc:993] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:15.709542 15061 raft_consensus.cc:1081] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:15.711867 14896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:15.712499 14896 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:15.712867 14896 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:15.721418 14896 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.741446 14896 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:15.742065 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:15.742735 14105 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:15.741601 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ebbe901baf4a2abe83987271e91687" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:15.745416 14034 raft_consensus.cc:3055] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:15.745698 14034 raft_consensus.cc:740] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:15.746450 14034 consensus_queue.cc:260] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.747689 14034 raft_consensus.cc:3060] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:15.754148 14105 raft_consensus.cc:2468] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:15.755620 14801 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:15.757053 14034 raft_consensus.cc:2468] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:15.757812 15102 raft_consensus.cc:2804] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:15.758361 15102 raft_consensus.cc:697] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:15.759393 15102 consensus_queue.cc:237] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.771955 15060 raft_consensus.cc:993] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:15.772531 15060 raft_consensus.cc:1081] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:15.782056 14896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93952479e863465a8930469c1e593ae8"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38678
I20260501 14:02:15.782805 14896 raft_consensus.cc:493] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:15.783244 14896 raft_consensus.cc:3060] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.796294 13855 catalog_manager.cc:5671] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 2 to 3, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:15.797751 14896 raft_consensus.cc:515] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.803306 15084 raft_consensus.cc:993] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower e6f0deb8c1e1415693f8ab2ca413688d to start an election
I20260501 14:02:15.803807 15086 raft_consensus.cc:993] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:15.804076 15084 raft_consensus.cc:1081] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Signalling peer e6f0deb8c1e1415693f8ab2ca413688d to start an election
I20260501 14:02:15.804391 15086 raft_consensus.cc:1081] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:15.806123 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:15.806703 14897 raft_consensus.cc:493] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:15.807062 14897 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:15.807456 14108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
 from {username='slave'} at 127.0.0.1:57038
I20260501 14:02:15.808071 14108 raft_consensus.cc:493] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:15.808100 14896 leader_election.cc:290] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:15.808454 14108 raft_consensus.cc:3060] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.814018 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:15.814754 14034 raft_consensus.cc:3060] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.823001 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93952479e863465a8930469c1e593ae8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:15.823887 14103 raft_consensus.cc:3055] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:15.824254 14103 raft_consensus.cc:740] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:15.825209 14103 consensus_queue.cc:260] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.826543 14103 raft_consensus.cc:3060] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.874864 14034 raft_consensus.cc:2468] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:15.877566 14108 raft_consensus.cc:515] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:15.885990 14108 leader_election.cc:290] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:15.874471 14103 raft_consensus.cc:2468] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:15.880524 14801 leader_election.cc:304] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:15.902840 15099 raft_consensus.cc:2804] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:15.903437 15099 raft_consensus.cc:697] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:15.904501 15099 consensus_queue.cc:237] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.889317 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:15.894438 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2e48efa4624f60b08bea18bc9413e1" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:15.908701 14033 raft_consensus.cc:3055] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:15.909081 14033 raft_consensus.cc:740] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:15.909750 14183 raft_consensus.cc:3060] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.909931 14033 consensus_queue.cc:260] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:15.911522 14033 raft_consensus.cc:3060] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:15.926607 14183 raft_consensus.cc:2468] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:15.878104 14897 raft_consensus.cc:515] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.939729 14033 raft_consensus.cc:2468] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:15.939977 14897 leader_election.cc:290] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:15.941459 14075 leader_election.cc:304] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:15.947474 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:15.948153 14034 raft_consensus.cc:3055] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:15.948469 14034 raft_consensus.cc:740] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:15.949321 14034 consensus_queue.cc:260] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:15.950731 14034 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:15.958545 15054 raft_consensus.cc:2804] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:15.959172 15054 raft_consensus.cc:697] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:15.960075 15054 consensus_queue.cc:237] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:15.970021 13855 catalog_manager.cc:5671] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:15.980293 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d779c5709e49a2aad6974b29b62fe8" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:15.981074 14103 raft_consensus.cc:3060] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:15.990868 14103 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:15.998507 14801 leader_election.cc:304] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:15.999997 15099 raft_consensus.cc:2804] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:16.000572 15099 raft_consensus.cc:697] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:16.001538 15099 consensus_queue.cc:237] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:16.010596 14034 raft_consensus.cc:2468] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:16.022357 13855 catalog_manager.cc:5671] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 1 to 2, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 2 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:16.033352 13858 catalog_manager.cc:5671] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 2 to 3, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:16.154310 14103 raft_consensus.cc:1275] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:16.155607 15099 consensus_queue.cc:1048] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:16.171762 14034 raft_consensus.cc:1275] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:16.173149 15073 consensus_queue.cc:1048] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:16.267642 14183 raft_consensus.cc:1275] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:16.269196 15061 consensus_queue.cc:1048] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:16.301770 14103 raft_consensus.cc:1275] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:16.303809 15086 consensus_queue.cc:1048] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:16.334264 14034 raft_consensus.cc:1275] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:16.336109 15073 consensus_queue.cc:1048] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:16.372320 14103 raft_consensus.cc:1275] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:16.381892 15073 consensus_queue.cc:1048] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:16.424975 14033 raft_consensus.cc:1275] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:16.428804 15118 consensus_queue.cc:1048] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:16.440976 14183 raft_consensus.cc:1275] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:16.442343 15119 consensus_queue.cc:1048] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:16.485390 14108 raft_consensus.cc:1275] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:16.486903 15073 consensus_queue.cc:1048] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:16.524283 14030 raft_consensus.cc:1275] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:16.527801 15116 consensus_queue.cc:1048] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 14:02:16.673586  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:16.730572 14108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a371931392243bc9beed91b6eb227db"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59040
I20260501 14:02:16.731333 14108 raft_consensus.cc:606] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:16.734462 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce"
dest_uuid: "fcac793323404da6a1245c4c5264b767"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59356
I20260501 14:02:16.735113 14183 raft_consensus.cc:606] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:16.737993 14030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:16.738607 14030 raft_consensus.cc:606] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:16.743081 14182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9"
dest_uuid: "fcac793323404da6a1245c4c5264b767"
mode: GRACEFUL
new_leader_uuid: "dba449c6af0341daa28866a4fd46cd96"
 from {username='slave'} at 127.0.0.1:59356
I20260501 14:02:16.743770 14182 raft_consensus.cc:606] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Received request to transfer leadership to TS dba449c6af0341daa28866a4fd46cd96
I20260501 14:02:16.754119 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936"
dest_uuid: "fcac793323404da6a1245c4c5264b767"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59356
I20260501 14:02:16.770776 14183 raft_consensus.cc:606] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:16.755174 15086 raft_consensus.cc:993] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:16.772454 15061 raft_consensus.cc:1081] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:16.774757 14889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38564
I20260501 14:02:16.775386 14889 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:16.775799 14889 raft_consensus.cc:3060] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:16.781529  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260501 14:02:16.786563  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:16.789466  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:16.796476 15046 raft_consensus.cc:993] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: : Instructing follower dba449c6af0341daa28866a4fd46cd96 to start an election
I20260501 14:02:16.804944 15046 raft_consensus.cc:1081] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Signalling peer dba449c6af0341daa28866a4fd46cd96 to start an election
I20260501 14:02:16.812003 14030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
 from {username='slave'} at 127.0.0.1:43074
I20260501 14:02:16.812780 14030 raft_consensus.cc:493] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:16.813199 14030 raft_consensus.cc:3060] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:16.825321 14889 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:16.833667 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:16.834383 14183 raft_consensus.cc:3060] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:16.846547 14033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71137f69a744b4a92765dd2b7e0b25" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:16.847189 14033 raft_consensus.cc:3055] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:16.847554 14033 raft_consensus.cc:740] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:16.848340 14033 consensus_queue.cc:260] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:16.849541 14033 raft_consensus.cc:3060] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:16.847144 14889 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:16.865403 14033 raft_consensus.cc:2468] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:16.895541 15119 raft_consensus.cc:993] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:16.846262 14030 raft_consensus.cc:515] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:16.897075 15054 raft_consensus.cc:1081] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:16.903947 14801 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:16.904640 14030 leader_election.cc:290] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:16.882742 14183 raft_consensus.cc:2468] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:16.907706 15102 raft_consensus.cc:2804] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:16.908440 15102 raft_consensus.cc:697] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:16.909504 15102 consensus_queue.cc:237] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:16.911525 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:16.912273 14183 raft_consensus.cc:3055] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:16.912617 14183 raft_consensus.cc:740] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:16.913494 14183 consensus_queue.cc:260] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:16.916004 14183 raft_consensus.cc:3060] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:16.925382 14183 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:16.926726 14001 leader_election.cc:304] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dba449c6af0341daa28866a4fd46cd96, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:16.931458 15061 raft_consensus.cc:2804] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:16.932173 15061 raft_consensus.cc:697] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Leader. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:16.940274 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c529b25f04145b69a8055b71ce4b9" candidate_uuid: "dba449c6af0341daa28866a4fd46cd96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:16.941079 14103 raft_consensus.cc:3060] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:16.939446 15061 consensus_queue.cc:237] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:16.949251 13856 catalog_manager.cc:5671] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:16.960721 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a371931392243bc9beed91b6eb227db"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38678
I20260501 14:02:16.961428 14897 raft_consensus.cc:493] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:16.961789 14897 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:16.965588 14103 raft_consensus.cc:2468] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba449c6af0341daa28866a4fd46cd96 in term 2.
I20260501 14:02:16.996346 13855 catalog_manager.cc:5671] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 reported cstate change: term changed from 1 to 2, leader changed from fcac793323404da6a1245c4c5264b767 (127.6.77.132) to dba449c6af0341daa28866a4fd46cd96 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "dba449c6af0341daa28866a4fd46cd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:17.009265 14897 raft_consensus.cc:515] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:17.023314 14897 leader_election.cc:290] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573)
I20260501 14:02:17.024060 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:17.025877 14030 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:17.026463 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a371931392243bc9beed91b6eb227db" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:17.027155 14103 raft_consensus.cc:3055] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:17.027493 14103 raft_consensus.cc:740] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:17.028468 14103 consensus_queue.cc:260] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:17.029697 14103 raft_consensus.cc:3060] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:17.047988 14103 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:17.048372 14030 raft_consensus.cc:2468] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 3.
I20260501 14:02:17.049255 14801 leader_election.cc:304] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:17.051172 15073 raft_consensus.cc:2804] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:17.051954 15073 raft_consensus.cc:697] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:17.053181 15073 consensus_queue.cc:237] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:17.055044 15136 raft_consensus.cc:993] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:17.055630 15136 raft_consensus.cc:1081] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:17.057535 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38582
I20260501 14:02:17.058097 14897 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:17.058472 14897 raft_consensus.cc:3060] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:17.079408 14897 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:17.082288 14897 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:17.083493 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:17.084313 14177 raft_consensus.cc:3055] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:17.084619 14177 raft_consensus.cc:740] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:17.085608 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:17.085415 14177 consensus_queue.cc:260] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:17.086326 14103 raft_consensus.cc:3060] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:17.087318 14177 raft_consensus.cc:3060] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:17.095386 14103 raft_consensus.cc:2468] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:17.096724 14801 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:17.098084 15116 raft_consensus.cc:2804] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:17.098642 15116 raft_consensus.cc:697] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:17.099361 13856 catalog_manager.cc:5671] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 2 to 3, leader changed from e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 3 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:17.099666 15116 consensus_queue.cc:237] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:17.102442 14177 raft_consensus.cc:2468] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:17.118455 13856 catalog_manager.cc:5671] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from fcac793323404da6a1245c4c5264b767 (127.6.77.132) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:17.252856 15046 raft_consensus.cc:993] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:17.253423 15057 raft_consensus.cc:1081] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:17.255061 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38582
I20260501 14:02:17.255673 14897 raft_consensus.cc:493] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:17.256067 14897 raft_consensus.cc:3060] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:17.264705 14897 raft_consensus.cc:515] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:17.266837 14897 leader_election.cc:290] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:17.267774 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:17.267998 14030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead3c38847ad4f6ca3c0e3001b4a3936" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:17.268663 14177 raft_consensus.cc:3055] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:17.268694 14030 raft_consensus.cc:3060] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:17.269038 14177 raft_consensus.cc:740] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcac793323404da6a1245c4c5264b767, State: Running, Role: LEADER
I20260501 14:02:17.269851 14177 consensus_queue.cc:260] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:17.270998 14177 raft_consensus.cc:3060] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:17.278288 14030 raft_consensus.cc:2468] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:17.278674 14177 raft_consensus.cc:2468] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:17.279793 14802 leader_election.cc:304] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:17.280663 15073 raft_consensus.cc:2804] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:17.281112 15073 raft_consensus.cc:697] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:17.282068 15073 consensus_queue.cc:237] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:17.295686 13856 catalog_manager.cc:5671] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from fcac793323404da6a1245c4c5264b767 (127.6.77.132) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:17.342254 14177 raft_consensus.cc:1275] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.343528 15073 consensus_queue.cc:1048] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:17.387286 14030 raft_consensus.cc:1275] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.389038 15116 consensus_queue.cc:1048] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:17.442597 14103 raft_consensus.cc:1275] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.444854 15137 consensus_queue.cc:1048] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:17.493650 14182 raft_consensus.cc:1275] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer dba449c6af0341daa28866a4fd46cd96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.495267 15086 consensus_queue.cc:1048] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:17.538223 14177 raft_consensus.cc:1275] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.539880 15073 consensus_queue.cc:1048] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:17.558454 14105 raft_consensus.cc:1275] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.561769 15073 consensus_queue.cc:1048] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:17.599192 14103 raft_consensus.cc:1275] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:17.601307 15099 consensus_queue.cc:1048] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:17.617851 14034 raft_consensus.cc:1275] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:17.625000 15116 consensus_queue.cc:1048] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260501 14:02:17.756004 14177 raft_consensus.cc:1275] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.757714 15116 consensus_queue.cc:1048] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:17.775394 14034 raft_consensus.cc:1275] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:17.777027 15116 consensus_queue.cc:1048] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:17.879292  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:17.980063 14034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df"
dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
mode: GRACEFUL
new_leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
 from {username='slave'} at 127.0.0.1:46100
I20260501 14:02:17.985522 14034 raft_consensus.cc:606] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Received request to transfer leadership to TS e6f0deb8c1e1415693f8ab2ca413688d
I20260501 14:02:17.987521  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260501 14:02:17.990115  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:17.991009  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:18.127069 15137 raft_consensus.cc:993] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: : Instructing follower e6f0deb8c1e1415693f8ab2ca413688d to start an election
I20260501 14:02:18.127668 15137 raft_consensus.cc:1081] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Signalling peer e6f0deb8c1e1415693f8ab2ca413688d to start an election
I20260501 14:02:18.129459 14102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
 from {username='slave'} at 127.0.0.1:57038
I20260501 14:02:18.130127 14102 raft_consensus.cc:493] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:18.130527 14102 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:18.138185 14102 raft_consensus.cc:515] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:18.140786 14102 leader_election.cc:290] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: Requested vote from peers dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:18.141500 14034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dba449c6af0341daa28866a4fd46cd96"
I20260501 14:02:18.141796 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c018894af1c4282b43813c828e0f3df" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:18.142714 14034 raft_consensus.cc:3055] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:18.142843 14182 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:18.143092 14034 raft_consensus.cc:740] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dba449c6af0341daa28866a4fd46cd96, State: Running, Role: LEADER
I20260501 14:02:18.143977 14034 consensus_queue.cc:260] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:18.146350 14034 raft_consensus.cc:3060] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:18.150461 14182 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 3.
I20260501 14:02:18.151945 14075 leader_election.cc:304] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:18.153004 15146 raft_consensus.cc:2804] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:18.153517 15146 raft_consensus.cc:697] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 3 LEADER]: Becoming Leader. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:18.154332 15146 consensus_queue.cc:237] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } }
I20260501 14:02:18.156122 14034 raft_consensus.cc:2468] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 3.
I20260501 14:02:18.166525 13856 catalog_manager.cc:5671] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d reported cstate change: term changed from 2 to 3, leader changed from dba449c6af0341daa28866a4fd46cd96 (127.6.77.130) to e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131). New cstate: current_term: 3 leader_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:18.618521 14177 raft_consensus.cc:1275] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:18.620100 15119 consensus_queue.cc:1048] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:18.642205 14030 raft_consensus.cc:1275] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Refusing update from remote peer e6f0deb8c1e1415693f8ab2ca413688d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:18.644004 15146 consensus_queue.cc:1048] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:19.038623  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:19.085572 14105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08"
dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
mode: GRACEFUL
new_leader_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:59040
I20260501 14:02:19.086329 14105 raft_consensus.cc:606] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Received request to transfer leadership to TS fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:19.088855  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260501 14:02:19.091203  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:19.092216  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:19.178540 15146 raft_consensus.cc:993] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: : Instructing follower fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:19.179385 15119 raft_consensus.cc:1081] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Signalling peer fe6496472aa4477cb4d5a008edd292f6 to start an election
I20260501 14:02:19.181052 14889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08"
dest_uuid: "fe6496472aa4477cb4d5a008edd292f6"
 from {username='slave'} at 127.0.0.1:38678
I20260501 14:02:19.181711 14889 raft_consensus.cc:493] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:19.182060 14889 raft_consensus.cc:3060] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:19.188259 14889 raft_consensus.cc:515] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:19.190923 14889 leader_election.cc:290] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Requested vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909)
I20260501 14:02:19.191620 14102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6f0deb8c1e1415693f8ab2ca413688d"
I20260501 14:02:19.192068 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257ae2a81f03487bac5d569393c8ee08" candidate_uuid: "fe6496472aa4477cb4d5a008edd292f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:19.192418 14102 raft_consensus.cc:3055] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:19.192704 14177 raft_consensus.cc:3060] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:19.192785 14102 raft_consensus.cc:740] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6f0deb8c1e1415693f8ab2ca413688d, State: Running, Role: LEADER
I20260501 14:02:19.193905 14102 consensus_queue.cc:260] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:19.195295 14102 raft_consensus.cc:3060] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:19.201359 14177 raft_consensus.cc:2468] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:19.202978 14802 leader_election.cc:304] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6; no voters: 
I20260501 14:02:19.204598 15116 raft_consensus.cc:2804] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:19.204600 14102 raft_consensus.cc:2468] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6496472aa4477cb4d5a008edd292f6 in term 2.
I20260501 14:02:19.206110 15116 raft_consensus.cc:697] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Becoming Leader. State: Replica: fe6496472aa4477cb4d5a008edd292f6, State: Running, Role: LEADER
I20260501 14:02:19.207019 15116 consensus_queue.cc:237] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:19.219036 13856 catalog_manager.cc:5671] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 reported cstate change: term changed from 1 to 2, leader changed from e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131) to fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "fe6496472aa4477cb4d5a008edd292f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:19.615389 14182 raft_consensus.cc:1275] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:19.616940 15102 consensus_queue.cc:1048] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:19.666229 14102 raft_consensus.cc:1275] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Refusing update from remote peer fe6496472aa4477cb4d5a008edd292f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:19.667644 15187 consensus_queue.cc:1048] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:20.133546  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:20.181110  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:20.183250  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:20.184175  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:20.230001  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:20.267560  6454 tablet_server.cc:179] TabletServer@127.6.77.129:43181 shutting down...
W20260501 14:02:20.282034 14075 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 272 similar messages]
W20260501 14:02:20.293491 14075 consensus_peers.cc:597] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.302629 14075 consensus_peers.cc:597] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.325445  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:20.327994  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.329367  6454 raft_consensus.cc:2243] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:20.329746 14149 consensus_peers.cc:597] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.330000  6454 raft_consensus.cc:2272] T 489891716d5d4794b3171c3b41c6b6f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.330502 14149 consensus_peers.cc:597] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.335486  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.337999  6454 raft_consensus.cc:2243] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:20.338423 14001 consensus_peers.cc:597] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.338555  6454 raft_consensus.cc:2272] T 2e3a7258fde148469fc13884190b3b50 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.341578  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.342307  6454 raft_consensus.cc:2243] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.343186  6454 raft_consensus.cc:2272] T 93952479e863465a8930469c1e593ae8 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.346066  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.346843  6454 raft_consensus.cc:2243] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.347357  6454 raft_consensus.cc:2272] T f7736f72df4e4056b6e8306bb195e5d8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.349826  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.350802  6454 raft_consensus.cc:2243] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.351975  6454 raft_consensus.cc:2272] T 22408a26005c43e69c31f3ef8fbe401b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.356068  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.356726  6454 raft_consensus.cc:2243] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.357916  6454 raft_consensus.cc:2272] T 814949c890d34428a715ffeaaed0d1ce P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.360355  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.361016  6454 raft_consensus.cc:2243] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.361425  6454 raft_consensus.cc:2272] T 3d1cbf2b2ed64fd19070d2c318260e59 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.363770  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.364555  6454 raft_consensus.cc:2243] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.364997  6454 raft_consensus.cc:2272] T 9c46ee8477ac4c76b73d11145f5948f9 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.367961  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.368562  6454 raft_consensus.cc:2243] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.369000  6454 raft_consensus.cc:2272] T 21abf15277ce40ea892dd216ab77ea2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.371496  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.372362  6454 raft_consensus.cc:2243] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.373477  6454 raft_consensus.cc:2272] T 97ebbe901baf4a2abe83987271e91687 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.377009 14075 consensus_peers.cc:597] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.378731 14149 consensus_peers.cc:597] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.378954  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.380149  6454 raft_consensus.cc:2243] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.380649  6454 raft_consensus.cc:2272] T 8c97fd620b464e0c91cdcd6df3e535ab P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.382861  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.383525  6454 raft_consensus.cc:2243] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.384016  6454 raft_consensus.cc:2272] T 39734d31bb3943c1a3477c1ced03bdb6 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.386796  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.387434  6454 raft_consensus.cc:2243] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.387912  6454 raft_consensus.cc:2272] T f959d4d3d985474291a0b7bf62481690 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.389791 14149 consensus_peers.cc:597] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.390941  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.391924  6454 raft_consensus.cc:2243] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.392350  6454 raft_consensus.cc:2272] T 20a6f8feaeaa4b79b89a164e7d98c53b P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.395287  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.396035  6454 raft_consensus.cc:2243] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.396476  6454 raft_consensus.cc:2272] T c851785bc2fd4764ab766fd38f7597dc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.398994  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.399638  6454 raft_consensus.cc:2243] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.400528  6454 raft_consensus.cc:2272] T 3a371931392243bc9beed91b6eb227db P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.402879  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.403489  6454 raft_consensus.cc:2243] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.403921  6454 raft_consensus.cc:2272] T be6afe227fa3478280adc659a49382f0 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.406172  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.406802  6454 raft_consensus.cc:2243] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.407234  6454 raft_consensus.cc:2272] T 42855c0411ec46b3bf4bd4be757430c4 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.409400  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.410036  6454 raft_consensus.cc:2243] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.410902  6454 raft_consensus.cc:2272] T 1c91939f293a4c53b18c1c18f4449f06 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.413115  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.413760  6454 raft_consensus.cc:2243] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.415055  6454 raft_consensus.cc:2272] T 071fccc276bd4528803ab25b4d2dd3a7 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.418336  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.419184  6454 raft_consensus.cc:2243] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
W20260501 14:02:20.419939 14149 consensus_peers.cc:597] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.420288  6454 raft_consensus.cc:2272] T f5f77c3cf0c443cf8e717a27fc040aab P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.421224 14149 consensus_peers.cc:597] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.422984  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.423714  6454 raft_consensus.cc:2243] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.424158  6454 raft_consensus.cc:2272] T f18a923244304708a082b89059b70764 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.426465  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.427115  6454 raft_consensus.cc:2243] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.427551  6454 raft_consensus.cc:2272] T dba1e3df02974207a6e359613777bc2a P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.429983  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.430766  6454 raft_consensus.cc:2243] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.431272  6454 raft_consensus.cc:2272] T f3de26ee36254bc5966555788936888a P fe6496472aa4477cb4d5a008edd292f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.434345  6454 tablet_replica.cc:333] stopping tablet replica
W20260501 14:02:20.434518 14075 consensus_peers.cc:597] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.435137  6454 raft_consensus.cc:2243] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.436187  6454 raft_consensus.cc:2272] T bf71137f69a744b4a92765dd2b7e0b25 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.438521  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.439133  6454 raft_consensus.cc:2243] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.439567  6454 raft_consensus.cc:2272] T 81b6408b3eea487ea04c6bc19768a4fb P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.442404  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.443212  6454 raft_consensus.cc:2243] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.443742  6454 raft_consensus.cc:2272] T 0265e96f503c4b65adaa438fe44216d7 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.444703 14149 consensus_peers.cc:597] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.446975  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.447719  6454 raft_consensus.cc:2243] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.448263  6454 raft_consensus.cc:2272] T c3834cf44f254585909e19f7b9cccaba P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.451489  6454 tablet_replica.cc:333] stopping tablet replica
W20260501 14:02:20.452234 14001 consensus_peers.cc:597] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.452351  6454 raft_consensus.cc:2243] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.452920  6454 raft_consensus.cc:2272] T 1c534f0c5c5845f592e3cec990b099bc P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.455257  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.456100  6454 raft_consensus.cc:2243] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.457120  6454 raft_consensus.cc:2272] T 4dfb57bc54a04297a88d40804890af15 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.460213  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.460812  6454 raft_consensus.cc:2243] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.461266  6454 raft_consensus.cc:2272] T 00d1903b4ee9466a83fa31497f59744e P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.463647  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.464262  6454 raft_consensus.cc:2243] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.464649  6454 raft_consensus.cc:2272] T 759b9fe010354272a79f83b2a223aaa8 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.466761  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.467317  6454 raft_consensus.cc:2243] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.467733  6454 raft_consensus.cc:2272] T a7467482380a426188c5b2ac43d54310 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.470520  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.471264  6454 raft_consensus.cc:2243] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.471724  6454 raft_consensus.cc:2272] T 2156db7c0cd944eda5eebd2ee3275d8e P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.474315  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.475088  6454 raft_consensus.cc:2243] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.475669  6454 raft_consensus.cc:2272] T 36fbdffa2ccc49c9be276b75784b7fc1 P fe6496472aa4477cb4d5a008edd292f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.476332 14001 consensus_peers.cc:597] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.478327  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.479068  6454 raft_consensus.cc:2243] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.479627  6454 raft_consensus.cc:2272] T f6e246a62848488dbc45a3794baac420 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.482414  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.483119  6454 raft_consensus.cc:2243] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.484177  6454 raft_consensus.cc:2272] T 28d779c5709e49a2aad6974b29b62fe8 P fe6496472aa4477cb4d5a008edd292f6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.484997 14149 consensus_peers.cc:597] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.486690  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.487412  6454 raft_consensus.cc:2243] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.488348  6454 raft_consensus.cc:2272] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.490583  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.491333  6454 raft_consensus.cc:2243] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.491794  6454 raft_consensus.cc:2272] T 154bd4746b484c05b7f01be4f586a706 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.494309  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.494876  6454 raft_consensus.cc:2243] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.495918  6454 raft_consensus.cc:2272] T 844973e68bc642b788a5ef4c699eca7e P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.498546  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.499212  6454 raft_consensus.cc:2243] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.499643  6454 raft_consensus.cc:2272] T 7b188afe7907439098cfaf8f874665bc P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.502012  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.502765  6454 raft_consensus.cc:2243] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.503369  6454 raft_consensus.cc:2272] T 33ebd762ee5d435fa14f8a227d9b05f9 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.503934 14075 consensus_peers.cc:597] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.506368  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.507072  6454 raft_consensus.cc:2243] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.508009  6454 raft_consensus.cc:2272] T ead3c38847ad4f6ca3c0e3001b4a3936 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.511309  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.512182  6454 raft_consensus.cc:2243] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.512909  6454 raft_consensus.cc:2272] T 398bfbe172bd426db8d5dfc783abed5d P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.516434  6454 tablet_replica.cc:333] stopping tablet replica
I20260501 14:02:20.517048  6454 raft_consensus.cc:2243] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.518023  6454 raft_consensus.cc:2272] T 257ae2a81f03487bac5d569393c8ee08 P fe6496472aa4477cb4d5a008edd292f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.536696 14149 consensus_peers.cc:597] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.541543 14001 consensus_peers.cc:597] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.573539 14149 consensus_peers.cc:597] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.593266 14001 consensus_peers.cc:597] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.596309 14149 consensus_peers.cc:597] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.602196 14075 consensus_peers.cc:597] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.609091 14001 consensus_peers.cc:597] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.624445  6454 tablet_server.cc:196] TabletServer@127.6.77.129:43181 shutdown complete.
W20260501 14:02:20.635538 14001 consensus_peers.cc:597] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.640614 14001 consensus_peers.cc:597] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.640801 14149 consensus_peers.cc:597] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.649232 14001 consensus_peers.cc:597] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.676383 14149 consensus_peers.cc:597] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.736420 14001 consensus_peers.cc:597] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.744196  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
W20260501 14:02:20.776576 14074 consensus_peers.cc:597] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.781515 14075 consensus_peers.cc:597] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.818578 14149 consensus_peers.cc:597] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 -> Peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Couldn't send request to peer fe6496472aa4477cb4d5a008edd292f6. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.824268 14074 consensus_peers.cc:597] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:20.826768 14074 consensus_peers.cc:597] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.880991  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:20.885211  6454 tablet_replica.cc:333] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.887336  6454 raft_consensus.cc:2243] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.890151  6454 raft_consensus.cc:2272] T c3834cf44f254585909e19f7b9cccaba P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.895037  6454 tablet_replica.cc:333] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.899660  6454 raft_consensus.cc:2243] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.901095  6454 raft_consensus.cc:2272] T 67f9563f8238491491dcfbf6b39bf91a P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.904287  6454 tablet_replica.cc:333] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
W20260501 14:02:20.906363 14148 consensus_peers.cc:597] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.906555  6454 raft_consensus.cc:2243] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.910104  6454 raft_consensus.cc:2272] T 071fccc276bd4528803ab25b4d2dd3a7 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.930863  6454 tablet_replica.cc:333] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.931931  6454 raft_consensus.cc:2243] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.932668  6454 raft_consensus.cc:2272] T 489891716d5d4794b3171c3b41c6b6f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.938810  6454 tablet_replica.cc:333] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.939863  6454 raft_consensus.cc:2243] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.941201  6454 raft_consensus.cc:2272] T f7736f72df4e4056b6e8306bb195e5d8 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.942201 14074 consensus_peers.cc:597] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.944905  6454 tablet_replica.cc:333] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.945732  6454 raft_consensus.cc:2243] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.946303  6454 raft_consensus.cc:2272] T f14ddad993d446dd92f27c20aace1a34 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.949426  6454 tablet_replica.cc:333] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.950528  6454 raft_consensus.cc:2243] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.951792  6454 raft_consensus.cc:2272] T e8b961c5d58c420495fd18f163645f47 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.953118 14148 consensus_peers.cc:597] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.955252  6454 tablet_replica.cc:333] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.956306  6454 raft_consensus.cc:2243] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.956892  6454 raft_consensus.cc:2272] T 3a371931392243bc9beed91b6eb227db P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.959518  6454 tablet_replica.cc:333] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.960537  6454 raft_consensus.cc:2243] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.961095  6454 raft_consensus.cc:2272] T 42855c0411ec46b3bf4bd4be757430c4 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:20.965340 14074 consensus_peers.cc:597] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:20.970130  6454 tablet_replica.cc:333] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.971243  6454 raft_consensus.cc:2243] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.972520  6454 raft_consensus.cc:2272] T be6afe227fa3478280adc659a49382f0 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.976325  6454 tablet_replica.cc:333] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.976977  6454 raft_consensus.cc:2243] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.977455  6454 raft_consensus.cc:2272] T c851785bc2fd4764ab766fd38f7597dc P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.979705  6454 tablet_replica.cc:333] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.980381  6454 raft_consensus.cc:2243] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:20.981246  6454 raft_consensus.cc:2272] T f959d4d3d985474291a0b7bf62481690 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.983470  6454 tablet_replica.cc:333] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.984159  6454 raft_consensus.cc:2243] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.984586  6454 raft_consensus.cc:2272] T 9ce6c201d860417d91baa78d28d6a3a3 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.986691  6454 tablet_replica.cc:333] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.987234  6454 raft_consensus.cc:2243] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.987628  6454 raft_consensus.cc:2272] T 844973e68bc642b788a5ef4c699eca7e P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.989705  6454 tablet_replica.cc:333] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.990250  6454 raft_consensus.cc:2243] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.990686  6454 raft_consensus.cc:2272] T 7b188afe7907439098cfaf8f874665bc P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.993062  6454 tablet_replica.cc:333] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:20.993955  6454 raft_consensus.cc:2243] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:20.996623  6454 raft_consensus.cc:2272] T 93952479e863465a8930469c1e593ae8 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:20.999653  6454 tablet_replica.cc:333] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.000609  6454 raft_consensus.cc:2243] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.001243  6454 raft_consensus.cc:2272] T 4dfb57bc54a04297a88d40804890af15 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.002557 14148 consensus_peers.cc:597] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.004077  6454 tablet_replica.cc:333] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.004859  6454 raft_consensus.cc:2243] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.005964  6454 raft_consensus.cc:2272] T 8c97fd620b464e0c91cdcd6df3e535ab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.008519  6454 tablet_replica.cc:333] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.009352  6454 raft_consensus.cc:2243] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.010550  6454 raft_consensus.cc:2272] T 33ebd762ee5d435fa14f8a227d9b05f9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.013638  6454 tablet_replica.cc:333] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.014696  6454 raft_consensus.cc:2243] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.016055  6454 raft_consensus.cc:2272] T d26c529b25f04145b69a8055b71ce4b9 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.018941  6454 tablet_replica.cc:333] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.019842  6454 raft_consensus.cc:2243] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.020438  6454 raft_consensus.cc:2272] T ead3c38847ad4f6ca3c0e3001b4a3936 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.025642  6454 tablet_replica.cc:333] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.026741  6454 raft_consensus.cc:2243] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.027483  6454 raft_consensus.cc:2272] T c8267536f1bb4b159dc87ac7afca5b70 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.030491  6454 tablet_replica.cc:333] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.031229  6454 raft_consensus.cc:2243] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.031757  6454 raft_consensus.cc:2272] T a14016a1d4de44178b73674dbf82b9c4 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.034685  6454 tablet_replica.cc:333] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.035352  6454 raft_consensus.cc:2243] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.035974  6454 raft_consensus.cc:2272] T 2c73e59416ac4bbab3ca71bc9ccb8395 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.038691  6454 tablet_replica.cc:333] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.039570  6454 raft_consensus.cc:2243] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.040798  6454 raft_consensus.cc:2272] T a955fb193fda436098188379de1edb2c P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.043686  6454 tablet_replica.cc:333] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.044477  6454 raft_consensus.cc:2243] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.044938  6454 raft_consensus.cc:2272] T 2e3a7258fde148469fc13884190b3b50 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.047463  6454 tablet_replica.cc:333] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.048199  6454 raft_consensus.cc:2243] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.049280  6454 raft_consensus.cc:2272] T 0265e96f503c4b65adaa438fe44216d7 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.051481  6454 tablet_replica.cc:333] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.052259  6454 raft_consensus.cc:2243] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.052783  6454 raft_consensus.cc:2272] T 81b6408b3eea487ea04c6bc19768a4fb P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.055182  6454 tablet_replica.cc:333] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.055874  6454 raft_consensus.cc:2243] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.056358  6454 raft_consensus.cc:2272] T 22408a26005c43e69c31f3ef8fbe401b P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.058557  6454 tablet_replica.cc:333] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.059263  6454 raft_consensus.cc:2243] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.060278  6454 raft_consensus.cc:2272] T 3d1cbf2b2ed64fd19070d2c318260e59 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.062711  6454 tablet_replica.cc:333] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.063356  6454 raft_consensus.cc:2243] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.063849  6454 raft_consensus.cc:2272] T 9c46ee8477ac4c76b73d11145f5948f9 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.066236  6454 tablet_replica.cc:333] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.067013  6454 raft_consensus.cc:2243] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.067464  6454 raft_consensus.cc:2272] T f5f77c3cf0c443cf8e717a27fc040aab P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.069761  6454 tablet_replica.cc:333] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.070497  6454 raft_consensus.cc:2243] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.070955  6454 raft_consensus.cc:2272] T 7c2e48efa4624f60b08bea18bc9413e1 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.073143  6454 tablet_replica.cc:333] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.073767  6454 raft_consensus.cc:2243] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.074227  6454 raft_consensus.cc:2272] T bf71137f69a744b4a92765dd2b7e0b25 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.076463  6454 tablet_replica.cc:333] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.077037  6454 raft_consensus.cc:2243] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.077489  6454 raft_consensus.cc:2272] T 75a3f16449384bc982d2662b9bbcaeba P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.079545  6454 tablet_replica.cc:333] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.080178  6454 raft_consensus.cc:2243] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.081121  6454 raft_consensus.cc:2272] T f18a923244304708a082b89059b70764 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.083602  6454 tablet_replica.cc:333] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.084487  6454 raft_consensus.cc:2243] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.085055  6454 raft_consensus.cc:2272] T 97ebbe901baf4a2abe83987271e91687 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.087679  6454 tablet_replica.cc:333] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.088227  6454 raft_consensus.cc:2243] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.088655  6454 raft_consensus.cc:2272] T 154bd4746b484c05b7f01be4f586a706 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.090706  6454 tablet_replica.cc:333] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.091203  6454 raft_consensus.cc:2243] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.091570  6454 raft_consensus.cc:2272] T 4d9d7624d3964ef8a521561e8bb5a8e0 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.093688  6454 tablet_replica.cc:333] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.094162  6454 raft_consensus.cc:2243] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.095197  6454 raft_consensus.cc:2272] T a7467482380a426188c5b2ac43d54310 P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.097802  6454 tablet_replica.cc:333] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.098456  6454 raft_consensus.cc:2243] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:21.098755 14074 consensus_peers.cc:597] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.099067  6454 raft_consensus.cc:2272] T fbe7f10257e74bee9c9de08d91394e3d P dba449c6af0341daa28866a4fd46cd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.101716  6454 tablet_replica.cc:333] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.102440  6454 raft_consensus.cc:2243] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.103538  6454 raft_consensus.cc:2272] T f74b3f2390f84435b1288ad258be8b49 P dba449c6af0341daa28866a4fd46cd96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.106571  6454 tablet_replica.cc:333] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.107172  6454 raft_consensus.cc:2243] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.107641  6454 raft_consensus.cc:2272] T 4c018894af1c4282b43813c828e0f3df P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.109745  6454 tablet_replica.cc:333] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96: stopping tablet replica
I20260501 14:02:21.110384  6454 raft_consensus.cc:2243] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.110857  6454 raft_consensus.cc:2272] T 28d779c5709e49a2aad6974b29b62fe8 P dba449c6af0341daa28866a4fd46cd96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.114629 14074 consensus_peers.cc:597] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.126215 14148 consensus_peers.cc:597] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.154856 14148 consensus_peers.cc:597] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.158720 14148 consensus_peers.cc:597] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.197942  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
W20260501 14:02:21.209755 14148 consensus_peers.cc:597] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.265013 14074 consensus_peers.cc:597] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.268079 14074 consensus_peers.cc:597] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.270762 14074 consensus_peers.cc:597] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.294970  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
W20260501 14:02:21.307624 14148 consensus_peers.cc:597] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.322671 14074 consensus_peers.cc:597] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d -> Peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Couldn't send request to peer dba449c6af0341daa28866a4fd46cd96. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.347090 14148 consensus_peers.cc:597] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.351939  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:21.353036  6454 tablet_replica.cc:333] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.354247  6454 raft_consensus.cc:2243] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.354984  6454 raft_consensus.cc:2272] T 36fbdffa2ccc49c9be276b75784b7fc1 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.358096  6454 tablet_replica.cc:333] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.358876  6454 raft_consensus.cc:2243] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.359392  6454 raft_consensus.cc:2272] T f6e246a62848488dbc45a3794baac420 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.362327  6454 tablet_replica.cc:333] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.363395  6454 raft_consensus.cc:2243] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.364521  6454 raft_consensus.cc:2272] T 9ce6c201d860417d91baa78d28d6a3a3 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.367312  6454 tablet_replica.cc:333] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.368193  6454 raft_consensus.cc:2243] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.369295  6454 raft_consensus.cc:2272] T f14ddad993d446dd92f27c20aace1a34 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.372437  6454 tablet_replica.cc:333] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.373023  6454 raft_consensus.cc:2243] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.373435  6454 raft_consensus.cc:2272] T e8b961c5d58c420495fd18f163645f47 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.375557  6454 tablet_replica.cc:333] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.376277  6454 raft_consensus.cc:2243] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.376696  6454 raft_consensus.cc:2272] T 3a371931392243bc9beed91b6eb227db P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.378820  6454 tablet_replica.cc:333] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.379375  6454 raft_consensus.cc:2243] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.380290 15204 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.380474  6454 raft_consensus.cc:2272] T c851785bc2fd4764ab766fd38f7597dc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.381006 15204 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:21.384109  6454 tablet_replica.cc:333] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.384750 15204 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:21.385293  6454 raft_consensus.cc:2243] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.386018  6454 raft_consensus.cc:2272] T be6afe227fa3478280adc659a49382f0 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.388284 14148 leader_election.cc:336] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260501 14:02:21.389000 14149 leader_election.cc:336] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.389374 14149 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:21.389456  6454 tablet_replica.cc:333] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.390467 15204 raft_consensus.cc:2749] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 14:02:21.390775  6454 raft_consensus.cc:2243] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.392014  6454 raft_consensus.cc:2272] T 39734d31bb3943c1a3477c1ced03bdb6 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.392226 14148 consensus_peers.cc:597] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.395155  6454 tablet_replica.cc:333] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
W20260501 14:02:21.395200 14148 consensus_peers.cc:597] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.396108  6454 raft_consensus.cc:2243] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.397209  6454 raft_consensus.cc:2272] T 20a6f8feaeaa4b79b89a164e7d98c53b P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.399760  6454 tablet_replica.cc:333] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.400509  6454 raft_consensus.cc:2243] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.401051  6454 raft_consensus.cc:2272] T 93952479e863465a8930469c1e593ae8 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.403728  6454 tablet_replica.cc:333] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.404685  6454 raft_consensus.cc:2243] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.405263  6454 raft_consensus.cc:2272] T 33ebd762ee5d435fa14f8a227d9b05f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.408385  6454 tablet_replica.cc:333] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.409202  6454 raft_consensus.cc:2243] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.409741  6454 raft_consensus.cc:2272] T 398bfbe172bd426db8d5dfc783abed5d P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.412459  6454 tablet_replica.cc:333] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.413033  6454 raft_consensus.cc:2243] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.413434  6454 raft_consensus.cc:2272] T d26c529b25f04145b69a8055b71ce4b9 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.415577  6454 tablet_replica.cc:333] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.416196  6454 raft_consensus.cc:2243] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.416642  6454 raft_consensus.cc:2272] T 8c97fd620b464e0c91cdcd6df3e535ab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.418936  6454 tablet_replica.cc:333] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.419682  6454 raft_consensus.cc:2243] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.420696  6454 raft_consensus.cc:2272] T a14016a1d4de44178b73674dbf82b9c4 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.423517  6454 tablet_replica.cc:333] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.424355  6454 raft_consensus.cc:2243] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.425218 15201 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.425468  6454 raft_consensus.cc:2272] T c8267536f1bb4b159dc87ac7afca5b70 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.425822 15201 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:21.428730  6454 tablet_replica.cc:333] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.428871 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:21.429625 14182 raft_consensus.cc:2468] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 2.
I20260501 14:02:21.429968  6454 raft_consensus.cc:2243] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.430630  6454 raft_consensus.cc:2272] T 071fccc276bd4528803ab25b4d2dd3a7 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.430868 14075 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: 
I20260501 14:02:21.431030 15201 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:21.431689 15146 raft_consensus.cc:2804] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260501 14:02:21.432094 15146 raft_consensus.cc:493] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.432500 15146 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:21.433921  6454 tablet_replica.cc:333] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
W20260501 14:02:21.436659 14075 leader_election.cc:336] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.440026 15146 raft_consensus.cc:515] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:21.440840  6454 raft_consensus.cc:2243] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.441879 15146 leader_election.cc:290] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: Requested vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:21.442790 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91939f293a4c53b18c1c18f4449f06" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767"
I20260501 14:02:21.443413 14182 raft_consensus.cc:3060] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:21.443657  6454 raft_consensus.cc:2272] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.446545 14075 leader_election.cc:336] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.447139  6454 tablet_replica.cc:333] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.448212  6454 raft_consensus.cc:2243] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.448799  6454 raft_consensus.cc:2272] T 67f9563f8238491491dcfbf6b39bf91a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.449942 15146 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.450502 15146 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:21.452330  6454 tablet_replica.cc:333] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.453505  6454 raft_consensus.cc:2243] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.454188  6454 raft_consensus.cc:2272] T 257ae2a81f03487bac5d569393c8ee08 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.455242 14177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814949c890d34428a715ffeaaed0d1ce" candidate_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcac793323404da6a1245c4c5264b767" is_pre_election: true
I20260501 14:02:21.458099  6454 tablet_replica.cc:333] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.459388  6454 raft_consensus.cc:2243] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.460117  6454 raft_consensus.cc:2272] T f74b3f2390f84435b1288ad258be8b49 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.453264 15146 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcac793323404da6a1245c4c5264b767 (127.6.77.132:37909), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
I20260501 14:02:21.463316 14182 raft_consensus.cc:2468] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f0deb8c1e1415693f8ab2ca413688d in term 3.
I20260501 14:02:21.465039  6454 tablet_replica.cc:333] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.465963  6454 raft_consensus.cc:2243] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.467141  6454 raft_consensus.cc:2272] T 4c018894af1c4282b43813c828e0f3df P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.468559 14075 leader_election.cc:304] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d, fcac793323404da6a1245c4c5264b767; no voters: fe6496472aa4477cb4d5a008edd292f6
W20260501 14:02:21.468899 14148 consensus_peers.cc:597] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:21.469530 14075 raft_consensus.cc:2686] T 1c91939f293a4c53b18c1c18f4449f06 P e6f0deb8c1e1415693f8ab2ca413688d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260501 14:02:21.470523  6454 tablet_replica.cc:333] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.471556  6454 raft_consensus.cc:2243] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:21.472177 14075 leader_election.cc:336] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.472265  6454 raft_consensus.cc:2272] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.472652 14075 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: fcac793323404da6a1245c4c5264b767, fe6496472aa4477cb4d5a008edd292f6
W20260501 14:02:21.473163 14075 raft_consensus.cc:2686] T 814949c890d34428a715ffeaaed0d1ce P e6f0deb8c1e1415693f8ab2ca413688d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260501 14:02:21.475618  6454 tablet_replica.cc:333] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.476694  6454 raft_consensus.cc:2243] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.477702  6454 raft_consensus.cc:2272] T 2c73e59416ac4bbab3ca71bc9ccb8395 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.480113  6454 tablet_replica.cc:333] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.480727  6454 raft_consensus.cc:2243] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.481139  6454 raft_consensus.cc:2272] T a955fb193fda436098188379de1edb2c P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.483337  6454 tablet_replica.cc:333] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.483989  6454 raft_consensus.cc:2243] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.484398  6454 raft_consensus.cc:2272] T 1c534f0c5c5845f592e3cec990b099bc P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.486819  6454 tablet_replica.cc:333] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.487577  6454 raft_consensus.cc:2243] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.488770  6454 raft_consensus.cc:2272] T 2e3a7258fde148469fc13884190b3b50 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.491763  6454 tablet_replica.cc:333] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.492579  6454 raft_consensus.cc:2243] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.493045  6454 raft_consensus.cc:2272] T f5f77c3cf0c443cf8e717a27fc040aab P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.495323  6454 tablet_replica.cc:333] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.496086  6454 raft_consensus.cc:2243] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.497077  6454 raft_consensus.cc:2272] T dba1e3df02974207a6e359613777bc2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.499539  6454 tablet_replica.cc:333] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.500213  6454 raft_consensus.cc:2243] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.501055  6454 raft_consensus.cc:2272] T 7c2e48efa4624f60b08bea18bc9413e1 P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.503116  6454 tablet_replica.cc:333] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.503705  6454 raft_consensus.cc:2243] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.504673  6454 raft_consensus.cc:2272] T 75a3f16449384bc982d2662b9bbcaeba P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.506800  6454 tablet_replica.cc:333] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.507411  6454 raft_consensus.cc:2243] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.507964  6454 raft_consensus.cc:2272] T f18a923244304708a082b89059b70764 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.510706  6454 tablet_replica.cc:333] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.511586  6454 raft_consensus.cc:2243] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.512253  6454 raft_consensus.cc:2272] T f3de26ee36254bc5966555788936888a P e6f0deb8c1e1415693f8ab2ca413688d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.515390  6454 tablet_replica.cc:333] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.516238  6454 raft_consensus.cc:2243] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.516772  6454 raft_consensus.cc:2272] T 2156db7c0cd944eda5eebd2ee3275d8e P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.519454  6454 tablet_replica.cc:333] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.519802 15146 raft_consensus.cc:493] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.520181  6454 raft_consensus.cc:2243] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.520426 15146 raft_consensus.cc:515] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } } peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } }
I20260501 14:02:21.520848  6454 raft_consensus.cc:2272] T a7467482380a426188c5b2ac43d54310 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.522637 15146 leader_election.cc:290] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:21.523788  6454 tablet_replica.cc:333] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.524857  6454 raft_consensus.cc:2243] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.525472  6454 raft_consensus.cc:2272] T fbe7f10257e74bee9c9de08d91394e3d P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.527971 14075 leader_election.cc:336] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.528867  6454 tablet_replica.cc:333] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.530772  6454 raft_consensus.cc:2243] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.531484  6454 raft_consensus.cc:2272] T 4dfb57bc54a04297a88d40804890af15 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.534722  6454 tablet_replica.cc:333] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
W20260501 14:02:21.534861 14074 leader_election.cc:336] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111)
I20260501 14:02:21.535380 14074 leader_election.cc:304] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6f0deb8c1e1415693f8ab2ca413688d; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:21.535547  6454 raft_consensus.cc:2243] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.536135 15146 raft_consensus.cc:2749] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260501 14:02:21.536806  6454 raft_consensus.cc:2272] T 00d1903b4ee9466a83fa31497f59744e P e6f0deb8c1e1415693f8ab2ca413688d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.540174  6454 tablet_replica.cc:333] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.540952  6454 raft_consensus.cc:2243] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.541507  6454 raft_consensus.cc:2272] T 759b9fe010354272a79f83b2a223aaa8 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.544600  6454 tablet_replica.cc:333] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.545089  6454 raft_consensus.cc:2243] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.545504  6454 raft_consensus.cc:2272] T 97ebbe901baf4a2abe83987271e91687 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.547597  6454 tablet_replica.cc:333] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.548166  6454 raft_consensus.cc:2243] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.548544  6454 raft_consensus.cc:2272] T 21abf15277ce40ea892dd216ab77ea2a P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.550532  6454 tablet_replica.cc:333] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.550967  6454 raft_consensus.cc:2243] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.551777  6454 raft_consensus.cc:2272] T 9c46ee8477ac4c76b73d11145f5948f9 P e6f0deb8c1e1415693f8ab2ca413688d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.554018  6454 tablet_replica.cc:333] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d: stopping tablet replica
I20260501 14:02:21.554580  6454 raft_consensus.cc:2243] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.555168  6454 raft_consensus.cc:2272] T 28d779c5709e49a2aad6974b29b62fe8 P e6f0deb8c1e1415693f8ab2ca413688d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.608074 14148 consensus_peers.cc:597] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.634245  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 14:02:21.643911 15202 raft_consensus.cc:493] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.644642 15202 raft_consensus.cc:515] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:21.646878 15202 leader_election.cc:290] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:02:21.651584 14149 leader_election.cc:336] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:21.652405 14148 leader_election.cc:336] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Network error: Client connection negotiation failed: client connection to 127.6.77.131:42573: connect: Connection refused (error 111)
I20260501 14:02:21.652812 14148 leader_election.cc:304] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:21.653496 15202 raft_consensus.cc:2749] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 14:02:21.686019 15202 raft_consensus.cc:493] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.686731 15202 raft_consensus.cc:515] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:21.689179 15202 leader_election.cc:290] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:21.691197 15202 raft_consensus.cc:493] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.692270 15202 raft_consensus.cc:515] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6f0deb8c1e1415693f8ab2ca413688d" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 42573 } } peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } }
I20260501 14:02:21.694381 15202 leader_election.cc:290] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573), fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181)
W20260501 14:02:21.700392 14149 leader_election.cc:336] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
W20260501 14:02:21.701046 14148 leader_election.cc:336] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111)
I20260501 14:02:21.701591 14148 leader_election.cc:304] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
W20260501 14:02:21.704407 14149 leader_election.cc:336] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.705477 15202 raft_consensus.cc:2749] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 14:02:21.705873 14148 leader_election.cc:336] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Network error: Client connection negotiation failed: client connection to 127.6.77.131:42573: connect: Connection refused (error 111)
I20260501 14:02:21.707573 14148 leader_election.cc:304] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: e6f0deb8c1e1415693f8ab2ca413688d, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:21.708480 15202 raft_consensus.cc:2749] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260501 14:02:21.729871  6454 tablet_server.cc:179] TabletServer@127.6.77.132:0 shutting down...
I20260501 14:02:21.786139  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:21.786967  6454 tablet_replica.cc:333] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.787708  6454 raft_consensus.cc:2243] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.788750  6454 raft_consensus.cc:2272] T 36fbdffa2ccc49c9be276b75784b7fc1 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.791160  6454 tablet_replica.cc:333] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.791796  6454 raft_consensus.cc:2243] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.792740  6454 raft_consensus.cc:2272] T f6e246a62848488dbc45a3794baac420 P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.795040  6454 tablet_replica.cc:333] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.795713  6454 raft_consensus.cc:2243] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.796236  6454 raft_consensus.cc:2272] T f14ddad993d446dd92f27c20aace1a34 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.798535  6454 tablet_replica.cc:333] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.799153  6454 raft_consensus.cc:2243] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.800058  6454 raft_consensus.cc:2272] T 489891716d5d4794b3171c3b41c6b6f0 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.802167  6454 tablet_replica.cc:333] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.802804  6454 raft_consensus.cc:2243] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.803249  6454 raft_consensus.cc:2272] T f7736f72df4e4056b6e8306bb195e5d8 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.805614  6454 tablet_replica.cc:333] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.806272  6454 raft_consensus.cc:2243] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.806809  6454 raft_consensus.cc:2272] T e8b961c5d58c420495fd18f163645f47 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.809880  6454 tablet_replica.cc:333] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.810758  6454 raft_consensus.cc:2243] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.811923  6454 raft_consensus.cc:2272] T 42855c0411ec46b3bf4bd4be757430c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.814554  6454 tablet_replica.cc:333] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.815444  6454 raft_consensus.cc:2243] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.816169  6454 raft_consensus.cc:2272] T 39734d31bb3943c1a3477c1ced03bdb6 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.819063  6454 tablet_replica.cc:333] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.820024  6454 raft_consensus.cc:2243] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.820618  6454 raft_consensus.cc:2272] T f959d4d3d985474291a0b7bf62481690 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.821116 14148 consensus_peers.cc:597] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.131:42573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.823161  6454 tablet_replica.cc:333] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.823933  6454 raft_consensus.cc:2243] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.824359  6454 raft_consensus.cc:2272] T 20a6f8feaeaa4b79b89a164e7d98c53b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.826725  6454 tablet_replica.cc:333] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.827378  6454 raft_consensus.cc:2243] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.827894  6454 raft_consensus.cc:2272] T 9ce6c201d860417d91baa78d28d6a3a3 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.830430  6454 tablet_replica.cc:333] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.831053  6454 raft_consensus.cc:2243] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.831493  6454 raft_consensus.cc:2272] T 844973e68bc642b788a5ef4c699eca7e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.833551  6454 tablet_replica.cc:333] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.833895 15193 raft_consensus.cc:493] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe6496472aa4477cb4d5a008edd292f6)
I20260501 14:02:21.834403  6454 raft_consensus.cc:2243] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.834462 15193 raft_consensus.cc:515] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcac793323404da6a1245c4c5264b767" member_type: VOTER last_known_addr { host: "127.6.77.132" port: 37909 } } peers { permanent_uuid: "fe6496472aa4477cb4d5a008edd292f6" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 43181 } } peers { permanent_uuid: "dba449c6af0341daa28866a4fd46cd96" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 40057 } }
I20260501 14:02:21.835773  6454 raft_consensus.cc:2272] T 7b188afe7907439098cfaf8f874665bc P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.836872 15193 leader_election.cc:290] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181), dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057)
I20260501 14:02:21.839442  6454 tablet_replica.cc:333] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.840435  6454 raft_consensus.cc:2243] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 2 LEADER]: Raft consensus shutting down.
W20260501 14:02:21.840981 14149 leader_election.cc:336] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe6496472aa4477cb4d5a008edd292f6 (127.6.77.129:43181): Network error: Client connection negotiation failed: client connection to 127.6.77.129:43181: connect: Connection refused (error 111)
I20260501 14:02:21.841648  6454 raft_consensus.cc:2272] T 398bfbe172bd426db8d5dfc783abed5d P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:21.842557 14148 leader_election.cc:336] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dba449c6af0341daa28866a4fd46cd96 (127.6.77.130:40057): Network error: Client connection negotiation failed: client connection to 127.6.77.130:40057: connect: Connection refused (error 111)
I20260501 14:02:21.843005 14148 leader_election.cc:304] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcac793323404da6a1245c4c5264b767; no voters: dba449c6af0341daa28866a4fd46cd96, fe6496472aa4477cb4d5a008edd292f6
I20260501 14:02:21.843721 15193 raft_consensus.cc:2749] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260501 14:02:21.844139 14148 consensus_peers.cc:597] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.131:42573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.844766  6454 tablet_replica.cc:333] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.845386  6454 raft_consensus.cc:2243] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.845774  6454 raft_consensus.cc:2272] T d26c529b25f04145b69a8055b71ce4b9 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.847707  6454 tablet_replica.cc:333] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.848321  6454 raft_consensus.cc:2243] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.848688  6454 raft_consensus.cc:2272] T ead3c38847ad4f6ca3c0e3001b4a3936 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.850664  6454 tablet_replica.cc:333] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.851255  6454 raft_consensus.cc:2243] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.851656  6454 raft_consensus.cc:2272] T c8267536f1bb4b159dc87ac7afca5b70 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.853538  6454 tablet_replica.cc:333] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.854046  6454 raft_consensus.cc:2243] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.854439  6454 raft_consensus.cc:2272] T a14016a1d4de44178b73674dbf82b9c4 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.856484  6454 tablet_replica.cc:333] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.857026  6454 raft_consensus.cc:2243] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.857407  6454 raft_consensus.cc:2272] T 2c73e59416ac4bbab3ca71bc9ccb8395 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.859388  6454 tablet_replica.cc:333] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.859964  6454 raft_consensus.cc:2243] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.860333  6454 raft_consensus.cc:2272] T a955fb193fda436098188379de1edb2c P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.862418  6454 tablet_replica.cc:333] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.863057  6454 raft_consensus.cc:2243] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.863588  6454 raft_consensus.cc:2272] T 67f9563f8238491491dcfbf6b39bf91a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.865666  6454 tablet_replica.cc:333] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.866261  6454 raft_consensus.cc:2243] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.866691  6454 raft_consensus.cc:2272] T 257ae2a81f03487bac5d569393c8ee08 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.869621  6454 tablet_replica.cc:333] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.870482  6454 raft_consensus.cc:2243] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.871174  6454 raft_consensus.cc:2272] T c3834cf44f254585909e19f7b9cccaba P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.874205  6454 tablet_replica.cc:333] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767: stopping tablet replica
W20260501 14:02:21.874239 14148 consensus_peers.cc:597] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 -> Peer e6f0deb8c1e1415693f8ab2ca413688d (127.6.77.131:42573): Couldn't send request to peer e6f0deb8c1e1415693f8ab2ca413688d. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.131:42573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:21.874954  6454 raft_consensus.cc:2243] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.875936  6454 raft_consensus.cc:2272] T 1c534f0c5c5845f592e3cec990b099bc P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.878345  6454 tablet_replica.cc:333] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.879037  6454 raft_consensus.cc:2243] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.879565  6454 raft_consensus.cc:2272] T 1c91939f293a4c53b18c1c18f4449f06 P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.881876  6454 tablet_replica.cc:333] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.882540  6454 raft_consensus.cc:2243] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.883019  6454 raft_consensus.cc:2272] T 0265e96f503c4b65adaa438fe44216d7 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.885630  6454 tablet_replica.cc:333] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.886302  6454 raft_consensus.cc:2243] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.887218  6454 raft_consensus.cc:2272] T 81b6408b3eea487ea04c6bc19768a4fb P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.889597  6454 tablet_replica.cc:333] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.890239  6454 raft_consensus.cc:2243] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.890759  6454 raft_consensus.cc:2272] T f74b3f2390f84435b1288ad258be8b49 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.893153  6454 tablet_replica.cc:333] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.893783  6454 raft_consensus.cc:2243] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.894277  6454 raft_consensus.cc:2272] T 4c018894af1c4282b43813c828e0f3df P fcac793323404da6a1245c4c5264b767 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.896615  6454 tablet_replica.cc:333] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.897256  6454 raft_consensus.cc:2243] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.897727  6454 raft_consensus.cc:2272] T 814949c890d34428a715ffeaaed0d1ce P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.900110  6454 tablet_replica.cc:333] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.900684  6454 raft_consensus.cc:2243] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.901521  6454 raft_consensus.cc:2272] T 154bd4746b484c05b7f01be4f586a706 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.903919  6454 tablet_replica.cc:333] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.904498  6454 raft_consensus.cc:2243] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.904963  6454 raft_consensus.cc:2272] T 4d9d7624d3964ef8a521561e8bb5a8e0 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.907019  6454 tablet_replica.cc:333] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.907548  6454 raft_consensus.cc:2243] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.907984  6454 raft_consensus.cc:2272] T 00d1903b4ee9466a83fa31497f59744e P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.910952  6454 tablet_replica.cc:333] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.911698  6454 raft_consensus.cc:2243] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.912845  6454 raft_consensus.cc:2272] T 759b9fe010354272a79f83b2a223aaa8 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.915398  6454 tablet_replica.cc:333] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.916193  6454 raft_consensus.cc:2243] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.917079  6454 raft_consensus.cc:2272] T 2156db7c0cd944eda5eebd2ee3275d8e P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.919445  6454 tablet_replica.cc:333] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.920120  6454 raft_consensus.cc:2243] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.921046  6454 raft_consensus.cc:2272] T fbe7f10257e74bee9c9de08d91394e3d P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.923578  6454 tablet_replica.cc:333] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.924463  6454 raft_consensus.cc:2243] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.925678  6454 raft_consensus.cc:2272] T 22408a26005c43e69c31f3ef8fbe401b P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.928117  6454 tablet_replica.cc:333] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.929011  6454 raft_consensus.cc:2243] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.930265  6454 raft_consensus.cc:2272] T 21abf15277ce40ea892dd216ab77ea2a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.933434  6454 tablet_replica.cc:333] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.934183  6454 raft_consensus.cc:2243] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.934738  6454 raft_consensus.cc:2272] T 3d1cbf2b2ed64fd19070d2c318260e59 P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.936930  6454 tablet_replica.cc:333] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.937482  6454 raft_consensus.cc:2243] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.937923  6454 raft_consensus.cc:2272] T dba1e3df02974207a6e359613777bc2a P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.940214  6454 tablet_replica.cc:333] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.940935  6454 raft_consensus.cc:2243] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.941581  6454 raft_consensus.cc:2272] T 7c2e48efa4624f60b08bea18bc9413e1 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.943782  6454 tablet_replica.cc:333] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.944451  6454 raft_consensus.cc:2243] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.944955  6454 raft_consensus.cc:2272] T bf71137f69a744b4a92765dd2b7e0b25 P fcac793323404da6a1245c4c5264b767 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.946981  6454 tablet_replica.cc:333] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.947525  6454 raft_consensus.cc:2243] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:21.948028  6454 raft_consensus.cc:2272] T 75a3f16449384bc982d2662b9bbcaeba P fcac793323404da6a1245c4c5264b767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:21.950152  6454 tablet_replica.cc:333] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767: stopping tablet replica
I20260501 14:02:21.950718  6454 raft_consensus.cc:2243] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 4 LEADER]: Raft consensus shutting down.
I20260501 14:02:21.951579  6454 raft_consensus.cc:2272] T f3de26ee36254bc5966555788936888a P fcac793323404da6a1245c4c5264b767 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:22.083606  6454 tablet_server.cc:196] TabletServer@127.6.77.132:0 shutdown complete.
I20260501 14:02:22.160071  6454 master.cc:562] Master@127.6.77.190:42909 shutting down...
I20260501 14:02:22.191393  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:22.192075  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:22.192430  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9ab43bf4be274f00982a66a498b6c11f: stopping tablet replica
I20260501 14:02:22.215994  6454 master.cc:584] Master@127.6.77.190:42909 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37567 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:475: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (8 ms)
[----------] 5 tests from LeaderRebalancerTest (307084 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260501 14:02:22.326772  6454 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.77.190:35697
I20260501 14:02:22.328130  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:22.334976 15212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.335172 15211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.336069 15214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:22.336202  6454 server_base.cc:1061] running on GCE node
I20260501 14:02:22.337738  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:22.337977  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:22.338160  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644142338107 us; error 0 us; skew 500 ppm
I20260501 14:02:22.338753  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:22.341447  6454 webserver.cc:492] Webserver started at http://127.6.77.190:41759/ using document root <none> and password file <none>
I20260501 14:02:22.341979  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:22.342195  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:22.342504  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:22.343750  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/master-0-root/instance:
uuid: "bacfc0b980524390afbebf16f2a2c3bc"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.348663  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260501 14:02:22.352499 15219 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.353365  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260501 14:02:22.353674  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/master-0-root
uuid: "bacfc0b980524390afbebf16f2a2c3bc"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.353986  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:22.363583  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:22.365041  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:22.408334  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.190:35697
I20260501 14:02:22.408458 15270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.190:35697 every 8 connection(s)
I20260501 14:02:22.412639 15271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:22.424448 15271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc: Bootstrap starting.
I20260501 14:02:22.429926 15271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:22.434736 15271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc: No bootstrap required, opened a new log
I20260501 14:02:22.437428 15271 raft_consensus.cc:359] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bacfc0b980524390afbebf16f2a2c3bc" member_type: VOTER }
I20260501 14:02:22.437865 15271 raft_consensus.cc:385] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:22.438138 15271 raft_consensus.cc:740] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bacfc0b980524390afbebf16f2a2c3bc, State: Initialized, Role: FOLLOWER
I20260501 14:02:22.438810 15271 consensus_queue.cc:260] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bacfc0b980524390afbebf16f2a2c3bc" member_type: VOTER }
I20260501 14:02:22.439287 15271 raft_consensus.cc:399] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260501 14:02:22.439546 15271 raft_consensus.cc:493] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260501 14:02:22.439813 15271 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:22.445379 15271 raft_consensus.cc:515] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bacfc0b980524390afbebf16f2a2c3bc" member_type: VOTER }
I20260501 14:02:22.445958 15271 leader_election.cc:304] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bacfc0b980524390afbebf16f2a2c3bc; no voters: 
I20260501 14:02:22.447271 15271 leader_election.cc:290] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260501 14:02:22.447896 15274 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:22.449442 15274 raft_consensus.cc:697] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 1 LEADER]: Becoming Leader. State: Replica: bacfc0b980524390afbebf16f2a2c3bc, State: Running, Role: LEADER
I20260501 14:02:22.450150 15274 consensus_queue.cc:237] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bacfc0b980524390afbebf16f2a2c3bc" member_type: VOTER }
I20260501 14:02:22.450486 15271 sys_catalog.cc:565] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [sys.catalog]: configured and running, proceeding with master startup.
I20260501 14:02:22.455021 15275 sys_catalog.cc:455] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bacfc0b980524390afbebf16f2a2c3bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bacfc0b980524390afbebf16f2a2c3bc" member_type: VOTER } }
I20260501 14:02:22.455672 15275 sys_catalog.cc:458] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [sys.catalog]: This master's current role is: LEADER
I20260501 14:02:22.455022 15276 sys_catalog.cc:455] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader bacfc0b980524390afbebf16f2a2c3bc. Latest consensus state: current_term: 1 leader_uuid: "bacfc0b980524390afbebf16f2a2c3bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bacfc0b980524390afbebf16f2a2c3bc" member_type: VOTER } }
I20260501 14:02:22.457139 15276 sys_catalog.cc:458] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [sys.catalog]: This master's current role is: LEADER
I20260501 14:02:22.458209 15281 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260501 14:02:22.463428 15281 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260501 14:02:22.468859  6454 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260501 14:02:22.473371 15281 catalog_manager.cc:1357] Generated new cluster ID: 13fc400724a6423798734137c3d384e6
I20260501 14:02:22.473688 15281 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260501 14:02:22.489874 15281 catalog_manager.cc:1380] Generated new certificate authority record
I20260501 14:02:22.491304 15281 catalog_manager.cc:1514] Loading token signing keys...
I20260501 14:02:22.503981 15281 catalog_manager.cc:6044] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc: Generated new TSK 0
I20260501 14:02:22.504674 15281 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260501 14:02:22.537103  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:22.543684 15292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.545850 15293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.546802 15295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:22.547360  6454 server_base.cc:1061] running on GCE node
I20260501 14:02:22.548539  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:22.548727  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:22.548852  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644142548841 us; error 0 us; skew 500 ppm
I20260501 14:02:22.549331  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:22.551937  6454 webserver.cc:492] Webserver started at http://127.6.77.129:40341/ using document root <none> and password file <none>
I20260501 14:02:22.552462  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:22.552670  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:22.552896  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:22.554132  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-0-root/instance:
uuid: "bedc021636444be1990fbe2fe8023d78"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.559149  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260501 14:02:22.562866 15300 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.563709  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260501 14:02:22.564095  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "bedc021636444be1990fbe2fe8023d78"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.564432  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:22.576573  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:22.578014  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:22.579658  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:22.582190  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:02:22.582422  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.582706  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:02:22.582904  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.629472  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:37701
I20260501 14:02:22.629645 15362 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:37701 every 8 connection(s)
I20260501 14:02:22.635113  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:22.644088 15367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.646871 15368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.648048 15370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:22.648741  6454 server_base.cc:1061] running on GCE node
I20260501 14:02:22.650383  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:22.650660  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:22.650857  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644142650815 us; error 0 us; skew 500 ppm
I20260501 14:02:22.651613  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:22.653882 15363 heartbeater.cc:344] Connected to a master server at 127.6.77.190:35697
I20260501 14:02:22.654407 15363 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:22.654744  6454 webserver.cc:492] Webserver started at http://127.6.77.130:35611/ using document root <none> and password file <none>
I20260501 14:02:22.655397 15363 heartbeater.cc:507] Master 127.6.77.190:35697 requested a full tablet report, sending...
I20260501 14:02:22.655517  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:22.655995  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:22.656366  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:22.657575  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-1-root/instance:
uuid: "0c790e8630214fafaaea14dd4823621e"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.658061 15236 ts_manager.cc:194] Registered new tserver with Master: bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701)
I20260501 14:02:22.660079 15236 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56958
I20260501 14:02:22.662900  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260501 14:02:22.666963 15375 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.667797  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260501 14:02:22.668193  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-1-root
uuid: "0c790e8630214fafaaea14dd4823621e"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.668504  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:22.688236  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:22.689646  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:22.691305  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:22.693884  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:02:22.694073  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.694372  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:02:22.694540  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.741267  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.130:37319
I20260501 14:02:22.741457 15437 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.130:37319 every 8 connection(s)
I20260501 14:02:22.746752  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:22.755795 15441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:22.757185 15442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:22.760597  6454 server_base.cc:1061] running on GCE node
I20260501 14:02:22.760903 15438 heartbeater.cc:344] Connected to a master server at 127.6.77.190:35697
W20260501 14:02:22.761097 15444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:22.761461 15438 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:22.762207  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:22.762548  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:22.762427 15438 heartbeater.cc:507] Master 127.6.77.190:35697 requested a full tablet report, sending...
I20260501 14:02:22.762953  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644142762931 us; error 0 us; skew 500 ppm
I20260501 14:02:22.763762  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:22.765319 15236 ts_manager.cc:194] Registered new tserver with Master: 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:22.767135  6454 webserver.cc:492] Webserver started at http://127.6.77.131:33653/ using document root <none> and password file <none>
I20260501 14:02:22.767323 15236 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56966
I20260501 14:02:22.767905  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:22.768173  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:22.768473  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:22.770203  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-2-root/instance:
uuid: "c41dc0c9feeb455892cb36be03a44dfc"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.776012  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260501 14:02:22.780066 15449 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.781158  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260501 14:02:22.781474  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-2-root
uuid: "c41dc0c9feeb455892cb36be03a44dfc"
format_stamp: "Formatted at 2026-05-01 14:02:22 on dist-test-slave-1sft"
I20260501 14:02:22.781759  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1777643835062054-6454-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:22.799304  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:22.800747  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:22.802328  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:22.804973  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:02:22.805263  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.805546  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:02:22.805719  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:22.852700  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.131:40901
I20260501 14:02:22.852780 15511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.131:40901 every 8 connection(s)
I20260501 14:02:22.868104 15512 heartbeater.cc:344] Connected to a master server at 127.6.77.190:35697
I20260501 14:02:22.868675 15512 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:22.869637 15512 heartbeater.cc:507] Master 127.6.77.190:35697 requested a full tablet report, sending...
I20260501 14:02:22.871902 15236 ts_manager.cc:194] Registered new tserver with Master: c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:22.872411  6454 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016221016s
I20260501 14:02:22.873951 15236 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56980
I20260501 14:02:22.902447 15236 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56990:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 14:02:22.905587 15236 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260501 14:02:22.988590 15403 tablet_service.cc:1511] Processing CreateTablet for tablet 41f096d988b64be3bb923f38a5945642 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:22.990376 15403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f096d988b64be3bb923f38a5945642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:22.993364 15402 tablet_service.cc:1511] Processing CreateTablet for tablet 6414c162a72646f3baa93e3bd88618c2 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:22.995178 15402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6414c162a72646f3baa93e3bd88618c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.002679 15401 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebe8edc59ef4f19802210e6702a9c82 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:23.004451 15401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebe8edc59ef4f19802210e6702a9c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.008967 15400 tablet_service.cc:1511] Processing CreateTablet for tablet 4beb1f0e3ad04e3ca4215673e98b1b64 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:23.010677 15400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4beb1f0e3ad04e3ca4215673e98b1b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.010716 15477 tablet_service.cc:1511] Processing CreateTablet for tablet 41f096d988b64be3bb923f38a5945642 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:23.013566 15476 tablet_service.cc:1511] Processing CreateTablet for tablet 6414c162a72646f3baa93e3bd88618c2 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:23.016141 15475 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebe8edc59ef4f19802210e6702a9c82 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:23.018697 15474 tablet_service.cc:1511] Processing CreateTablet for tablet 4beb1f0e3ad04e3ca4215673e98b1b64 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:23.020573 15399 tablet_service.cc:1511] Processing CreateTablet for tablet 634b7213f4b849d99a127b1ae6c25af5 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:23.022395 15399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634b7213f4b849d99a127b1ae6c25af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.022717 15473 tablet_service.cc:1511] Processing CreateTablet for tablet 634b7213f4b849d99a127b1ae6c25af5 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:23.024515 15477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f096d988b64be3bb923f38a5945642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.027385 15398 tablet_service.cc:1511] Processing CreateTablet for tablet a77df37953a147ca95ff18f00e7ae1c3 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:23.028254 15473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634b7213f4b849d99a127b1ae6c25af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.028970 15398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77df37953a147ca95ff18f00e7ae1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.029906 15472 tablet_service.cc:1511] Processing CreateTablet for tablet a77df37953a147ca95ff18f00e7ae1c3 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:23.034448 15397 tablet_service.cc:1511] Processing CreateTablet for tablet 4b06bcf7645241b3b16e7a80baaf825b (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:23.036134 15397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b06bcf7645241b3b16e7a80baaf825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.036257 15472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77df37953a147ca95ff18f00e7ae1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.038269 15476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6414c162a72646f3baa93e3bd88618c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.044330 15474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4beb1f0e3ad04e3ca4215673e98b1b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.047781 15471 tablet_service.cc:1511] Processing CreateTablet for tablet 4b06bcf7645241b3b16e7a80baaf825b (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:23.049443 15471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b06bcf7645241b3b16e7a80baaf825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.052923 15475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebe8edc59ef4f19802210e6702a9c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.058550 15403 tablet_service.cc:1511] Processing CreateTablet for tablet cbc4ab70badb46419deb6510bcbff523 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:23.060308 15403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc4ab70badb46419deb6510bcbff523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.061513 15470 tablet_service.cc:1511] Processing CreateTablet for tablet cbc4ab70badb46419deb6510bcbff523 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:23.063951 15470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc4ab70badb46419deb6510bcbff523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.070452 15396 tablet_service.cc:1511] Processing CreateTablet for tablet 4266bc93eb4e4b52935a762d48ecc6f9 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:23.074661 15396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4266bc93eb4e4b52935a762d48ecc6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.075157 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 41f096d988b64be3bb923f38a5945642 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:23.077172 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f096d988b64be3bb923f38a5945642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.079548 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 6414c162a72646f3baa93e3bd88618c2 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:23.081717 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6414c162a72646f3baa93e3bd88618c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.087119 15469 tablet_service.cc:1511] Processing CreateTablet for tablet 4266bc93eb4e4b52935a762d48ecc6f9 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:23.089262 15469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4266bc93eb4e4b52935a762d48ecc6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.095090 15326 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebe8edc59ef4f19802210e6702a9c82 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:23.096829 15326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebe8edc59ef4f19802210e6702a9c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.114744 15325 tablet_service.cc:1511] Processing CreateTablet for tablet 4beb1f0e3ad04e3ca4215673e98b1b64 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:23.117096 15324 tablet_service.cc:1511] Processing CreateTablet for tablet 634b7213f4b849d99a127b1ae6c25af5 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:23.118673 15324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634b7213f4b849d99a127b1ae6c25af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.121138 15323 tablet_service.cc:1511] Processing CreateTablet for tablet a77df37953a147ca95ff18f00e7ae1c3 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:23.122720 15323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77df37953a147ca95ff18f00e7ae1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.126233 15527 tablet_bootstrap.cc:492] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.126417 15320 tablet_service.cc:1511] Processing CreateTablet for tablet 4266bc93eb4e4b52935a762d48ecc6f9 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:23.128285 15322 tablet_service.cc:1511] Processing CreateTablet for tablet 4b06bcf7645241b3b16e7a80baaf825b (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:23.130044 15321 tablet_service.cc:1511] Processing CreateTablet for tablet cbc4ab70badb46419deb6510bcbff523 (DEFAULT_TABLE table=test-workload [id=1bb43e4f9a194664b1fcbffeb6199e2c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:23.131520 15325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4beb1f0e3ad04e3ca4215673e98b1b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.133289 15527 tablet_bootstrap.cc:654] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.134920 15322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b06bcf7645241b3b16e7a80baaf825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.139318 15321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc4ab70badb46419deb6510bcbff523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.143015 15320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4266bc93eb4e4b52935a762d48ecc6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:23.212486 15527 tablet_bootstrap.cc:492] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.213215 15527 ts_tablet_manager.cc:1403] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.035s
I20260501 14:02:23.236563 15529 tablet_bootstrap.cc:492] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.236886 15527 raft_consensus.cc:359] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.237753 15527 raft_consensus.cc:385] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.238040 15527 raft_consensus.cc:740] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.238895 15527 consensus_queue.cc:260] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.244614 15530 tablet_bootstrap.cc:492] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.255466 15529 tablet_bootstrap.cc:654] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.273727 15438 heartbeater.cc:499] Master 127.6.77.190:35697 was elected leader, sending a full tablet report...
I20260501 14:02:23.274590 15527 ts_tablet_manager.cc:1434] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.061s	user 0.018s	sys 0.020s
I20260501 14:02:23.275803 15527 tablet_bootstrap.cc:492] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.276299 15530 tablet_bootstrap.cc:654] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.284426 15527 tablet_bootstrap.cc:654] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.291024 15530 tablet_bootstrap.cc:492] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.291079 15529 tablet_bootstrap.cc:492] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.292111 15530 ts_tablet_manager.cc:1403] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.011s
I20260501 14:02:23.292269 15529 ts_tablet_manager.cc:1403] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.004s
I20260501 14:02:23.359144 15530 raft_consensus.cc:359] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.359154 15529 raft_consensus.cc:359] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.362166 15529 raft_consensus.cc:385] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.362417 15527 tablet_bootstrap.cc:492] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.362627 15529 raft_consensus.cc:740] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.361564 15530 raft_consensus.cc:385] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.363781 15527 ts_tablet_manager.cc:1403] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.002s
I20260501 14:02:23.364315 15530 raft_consensus.cc:740] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.365582 15530 consensus_queue.cc:260] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.367012 15529 consensus_queue.cc:260] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.371618 15532 raft_consensus.cc:493] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.373075 15532 raft_consensus.cc:515] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.376506 15527 raft_consensus.cc:359] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.377700 15527 raft_consensus.cc:385] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.378062 15527 raft_consensus.cc:740] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.378536 15530 ts_tablet_manager.cc:1434] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.086s	user 0.013s	sys 0.003s
I20260501 14:02:23.379207 15527 consensus_queue.cc:260] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.380014 15512 heartbeater.cc:499] Master 127.6.77.190:35697 was elected leader, sending a full tablet report...
I20260501 14:02:23.389303 15530 tablet_bootstrap.cc:492] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.390218 15527 ts_tablet_manager.cc:1434] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.004s
I20260501 14:02:23.393595 15363 heartbeater.cc:499] Master 127.6.77.190:35697 was elected leader, sending a full tablet report...
I20260501 14:02:23.394923 15527 tablet_bootstrap.cc:492] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.400326 15530 tablet_bootstrap.cc:654] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.404428 15529 ts_tablet_manager.cc:1434] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.111s	user 0.022s	sys 0.011s
I20260501 14:02:23.406023 15527 tablet_bootstrap.cc:654] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.406352 15529 tablet_bootstrap.cc:492] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.410344 15532 leader_election.cc:290] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.418040 15530 tablet_bootstrap.cc:492] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.418965 15530 ts_tablet_manager.cc:1403] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.030s	user 0.000s	sys 0.020s
I20260501 14:02:23.425060 15530 raft_consensus.cc:359] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.425999 15530 raft_consensus.cc:385] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.426347 15530 raft_consensus.cc:740] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.427635 15527 tablet_bootstrap.cc:492] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.427312 15530 consensus_queue.cc:260] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.428330 15527 ts_tablet_manager.cc:1403] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.013s
I20260501 14:02:23.430305 15530 ts_tablet_manager.cc:1434] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.008s
I20260501 14:02:23.431787 15530 tablet_bootstrap.cc:492] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.435573 15529 tablet_bootstrap.cc:654] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.436388 15527 raft_consensus.cc:359] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.437391 15527 raft_consensus.cc:385] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.437726 15527 raft_consensus.cc:740] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.438832 15527 consensus_queue.cc:260] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.440261 15530 tablet_bootstrap.cc:654] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.441845 15527 ts_tablet_manager.cc:1434] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260501 14:02:23.443604 15527 tablet_bootstrap.cc:492] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.450654 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6414c162a72646f3baa93e3bd88618c2" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
W20260501 14:02:23.453101 15378 leader_election.cc:343] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.455754 15527 tablet_bootstrap.cc:654] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.466615 15530 tablet_bootstrap.cc:492] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.467279 15530 ts_tablet_manager.cc:1403] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.007s
I20260501 14:02:23.469079 15527 tablet_bootstrap.cc:492] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.469851 15527 ts_tablet_manager.cc:1403] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.001s
I20260501 14:02:23.469081 15529 tablet_bootstrap.cc:492] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.471318 15530 raft_consensus.cc:359] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.472260 15530 raft_consensus.cc:385] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.472594 15530 raft_consensus.cc:740] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.473675 15530 consensus_queue.cc:260] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.473721 15527 raft_consensus.cc:359] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.474706 15527 raft_consensus.cc:385] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.475029 15527 raft_consensus.cc:740] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
W20260501 14:02:23.475996 15284 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:02:23.476015 15527 consensus_queue.cc:260] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.476747 15530 ts_tablet_manager.cc:1434] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260501 14:02:23.478268 15530 tablet_bootstrap.cc:492] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.479323 15527 ts_tablet_manager.cc:1434] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260501 14:02:23.480180 15529 ts_tablet_manager.cc:1403] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.012s
I20260501 14:02:23.483853 15529 raft_consensus.cc:359] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.484709 15529 raft_consensus.cc:385] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.485023 15529 raft_consensus.cc:740] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.486457 15530 tablet_bootstrap.cc:654] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.487300 15529 consensus_queue.cc:260] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.490571 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6414c162a72646f3baa93e3bd88618c2" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.490890 15529 ts_tablet_manager.cc:1434] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260501 14:02:23.490774 15527 tablet_bootstrap.cc:492] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.492349 15529 tablet_bootstrap.cc:492] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
W20260501 14:02:23.492739 15376 leader_election.cc:343] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.493350 15376 leader_election.cc:304] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:23.494874 15532 raft_consensus.cc:2749] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:23.496217 15536 raft_consensus.cc:493] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260501 14:02:23.496462 15439 tablet.cc:2404] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260501 14:02:23.496984 15536 raft_consensus.cc:515] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.501618 15529 tablet_bootstrap.cc:654] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.508074 15527 tablet_bootstrap.cc:654] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.554502 15536 leader_election.cc:290] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.556185 15530 tablet_bootstrap.cc:492] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.556922 15530 ts_tablet_manager.cc:1403] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.079s	user 0.034s	sys 0.038s
I20260501 14:02:23.563422 15529 tablet_bootstrap.cc:492] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.564271 15529 ts_tablet_manager.cc:1403] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.009s
I20260501 14:02:23.566093 15527 tablet_bootstrap.cc:492] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.566857 15527 ts_tablet_manager.cc:1403] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.042s
I20260501 14:02:23.568158 15529 raft_consensus.cc:359] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.569073 15529 raft_consensus.cc:385] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.569396 15529 raft_consensus.cc:740] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.570667 15529 consensus_queue.cc:260] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.571341 15527 raft_consensus.cc:359] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.572446 15527 raft_consensus.cc:385] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.572850 15527 raft_consensus.cc:740] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.572631 15530 raft_consensus.cc:359] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.573524 15530 raft_consensus.cc:385] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.573840 15530 raft_consensus.cc:740] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.574290 15527 consensus_queue.cc:260] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.574661 15530 consensus_queue.cc:260] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.576819 15529 ts_tablet_manager.cc:1434] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260501 14:02:23.579034 15530 ts_tablet_manager.cc:1434] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.008s
I20260501 14:02:23.580440 15530 tablet_bootstrap.cc:492] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.582227 15527 ts_tablet_manager.cc:1434] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.008s
I20260501 14:02:23.587064 15527 tablet_bootstrap.cc:492] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.588955 15530 tablet_bootstrap.cc:654] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.592965 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f096d988b64be3bb923f38a5945642" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:23.593907 15413 raft_consensus.cc:2468] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:23.595659 15302 leader_election.cc:304] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:23.596726 15536 raft_consensus.cc:2804] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:23.597148 15536 raft_consensus.cc:493] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.597695 15536 raft_consensus.cc:3060] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.600250 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f096d988b64be3bb923f38a5945642" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
W20260501 14:02:23.602172 15303 leader_election.cc:343] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.604779 15529 tablet_bootstrap.cc:492] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.605197 15527 tablet_bootstrap.cc:654] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.606839 15530 tablet_bootstrap.cc:492] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.607473 15530 ts_tablet_manager.cc:1403] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260501 14:02:23.610473 15537 raft_consensus.cc:493] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.611106 15537 raft_consensus.cc:515] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.611430 15530 raft_consensus.cc:359] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.612421 15530 raft_consensus.cc:385] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.612818 15530 raft_consensus.cc:740] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.613900 15530 consensus_queue.cc:260] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.616925 15529 tablet_bootstrap.cc:654] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.625093 15537 leader_election.cc:290] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:23.625898 15537 raft_consensus.cc:493] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.626439 15537 raft_consensus.cc:515] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.633899 15536 raft_consensus.cc:515] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.636353 15537 leader_election.cc:290] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:23.643061 15559 raft_consensus.cc:493] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.644673 15559 raft_consensus.cc:515] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.646746 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f096d988b64be3bb923f38a5945642" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:23.649164 15413 raft_consensus.cc:3060] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.647706 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f096d988b64be3bb923f38a5945642" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:23.648434 15536 leader_election.cc:290] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
W20260501 14:02:23.654307 15303 leader_election.cc:343] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.655332 15530 ts_tablet_manager.cc:1434] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.048s	user 0.023s	sys 0.022s
I20260501 14:02:23.656940 15530 tablet_bootstrap.cc:492] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.657228 15527 tablet_bootstrap.cc:492] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.657862 15527 ts_tablet_manager.cc:1403] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.013s
I20260501 14:02:23.663623 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4ab70badb46419deb6510bcbff523" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:23.663939 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:23.664743 15411 raft_consensus.cc:2468] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:23.665028 15530 tablet_bootstrap.cc:654] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
W20260501 14:02:23.666600 15451 leader_election.cc:343] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.667390 15451 leader_election.cc:304] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:23.668315 15529 tablet_bootstrap.cc:492] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.668337 15537 raft_consensus.cc:493] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.669147 15529 ts_tablet_manager.cc:1403] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.014s
I20260501 14:02:23.669416 15559 leader_election.cc:290] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.671294 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:23.661998 15527 raft_consensus.cc:359] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.672026 15411 raft_consensus.cc:2468] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:23.672628 15527 raft_consensus.cc:385] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.672996 15527 raft_consensus.cc:740] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.669195 15537 raft_consensus.cc:515] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.673424 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:23.673673 15302 leader_election.cc:304] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:23.673949 15527 consensus_queue.cc:260] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.675310 15537 leader_election.cc:290] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:23.675362 15554 raft_consensus.cc:2804] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:23.676882 15487 raft_consensus.cc:2468] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:23.677255 15527 ts_tablet_manager.cc:1434] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260501 14:02:23.677386 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.678432 15337 raft_consensus.cc:2468] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:23.679286 15527 tablet_bootstrap.cc:492] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.679889 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4ab70badb46419deb6510bcbff523" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.682155 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.679670 15529 raft_consensus.cc:359] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.683163 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
W20260501 14:02:23.684264 15450 leader_election.cc:343] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.684811 15450 leader_election.cc:304] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:23.685545 15559 raft_consensus.cc:2804] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 14:02:23.684988 15451 leader_election.cc:343] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.686041 15559 raft_consensus.cc:493] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.686506 15559 raft_consensus.cc:3060] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.687263 15537 raft_consensus.cc:2749] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:23.688216 15527 tablet_bootstrap.cc:654] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
W20260501 14:02:23.688675 15450 leader_election.cc:343] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.689498 15450 leader_election.cc:304] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:23.690966 15537 raft_consensus.cc:2749] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:23.677392 15554 raft_consensus.cc:493] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.691959 15529 raft_consensus.cc:385] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.692348 15554 raft_consensus.cc:3060] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.693277 15529 raft_consensus.cc:740] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.694466 15529 consensus_queue.cc:260] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.700207 15529 ts_tablet_manager.cc:1434] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260501 14:02:23.701565 15529 tablet_bootstrap.cc:492] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.707571 15554 raft_consensus.cc:515] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.702256 15413 raft_consensus.cc:2468] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:23.710022 15302 leader_election.cc:304] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:23.711687 15536 raft_consensus.cc:2804] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:23.715276 15559 raft_consensus.cc:515] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.720992 15530 tablet_bootstrap.cc:492] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.723618 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:23.724722 15487 raft_consensus.cc:2393] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bedc021636444be1990fbe2fe8023d78 in current term 1: Already voted for candidate c41dc0c9feeb455892cb36be03a44dfc in this term.
I20260501 14:02:23.724897 15554 leader_election.cc:290] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:23.725589 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:23.726619 15338 raft_consensus.cc:2393] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c41dc0c9feeb455892cb36be03a44dfc in current term 1: Already voted for candidate bedc021636444be1990fbe2fe8023d78 in this term.
I20260501 14:02:23.723698 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:23.727205 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebe8edc59ef4f19802210e6702a9c82" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:23.728176 15413 raft_consensus.cc:3060] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.729768 15527 tablet_bootstrap.cc:492] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.730585 15527 ts_tablet_manager.cc:1403] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.008s
I20260501 14:02:23.730680 15530 ts_tablet_manager.cc:1403] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.022s
I20260501 14:02:23.720082 15529 tablet_bootstrap.cc:654] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.732556 15451 leader_election.cc:304] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:23.734277 15554 raft_consensus.cc:2749] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:02:23.734913 15527 raft_consensus.cc:359] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.735978 15527 raft_consensus.cc:385] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.736224 15559 leader_election.cc:290] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.736454 15536 raft_consensus.cc:697] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:23.737587 15530 raft_consensus.cc:359] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.736305 15527 raft_consensus.cc:740] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.737597 15536 consensus_queue.cc:237] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.739516 15527 consensus_queue.cc:260] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.741200 15413 raft_consensus.cc:2468] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:23.741369 15559 raft_consensus.cc:493] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.742096 15559 raft_consensus.cc:515] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.745728 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:23.746052 15527 ts_tablet_manager.cc:1434] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.011s
W20260501 14:02:23.747582 15302 leader_election.cc:343] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.738405 15530 raft_consensus.cc:385] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.748596 15530 raft_consensus.cc:740] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.749526 15530 consensus_queue.cc:260] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.750629 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:23.751576 15487 raft_consensus.cc:2468] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:23.752540 15530 ts_tablet_manager.cc:1434] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260501 14:02:23.753122 15303 leader_election.cc:304] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:23.754097 15530 tablet_bootstrap.cc:492] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.762882 15562 raft_consensus.cc:2804] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:23.763988 15302 leader_election.cc:304] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:23.764282 15562 raft_consensus.cc:493] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.764446 15530 tablet_bootstrap.cc:654] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.748034 15527 tablet_bootstrap.cc:492] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.764835 15536 raft_consensus.cc:493] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.765115 15559 leader_election.cc:290] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.767493 15536 raft_consensus.cc:515] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.765028 15562 raft_consensus.cc:3060] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.768149 15532 raft_consensus.cc:493] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.768832 15532 raft_consensus.cc:515] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.769141 15233 catalog_manager.cc:5671] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:23.771183 15532 leader_election.cc:290] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.773015 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6414c162a72646f3baa93e3bd88618c2" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:23.764299 15529 tablet_bootstrap.cc:492] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.775475 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.776063 15559 raft_consensus.cc:2804] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:23.777809 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
W20260501 14:02:23.779673 15376 leader_election.cc:343] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.780742 15487 raft_consensus.cc:2468] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:23.781432 15529 ts_tablet_manager.cc:1403] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.013s
I20260501 14:02:23.776855 15536 leader_election.cc:290] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.781570 15559 raft_consensus.cc:697] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:23.784147 15532 raft_consensus.cc:493] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.784718 15532 raft_consensus.cc:515] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.785329 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6414c162a72646f3baa93e3bd88618c2" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:23.784852 15559 consensus_queue.cc:237] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.786005 15413 raft_consensus.cc:2468] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:23.787569 15302 leader_election.cc:304] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:23.787916 15532 leader_election.cc:290] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.792419 15529 raft_consensus.cc:359] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
W20260501 14:02:23.792855 15378 leader_election.cc:343] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.793463 15529 raft_consensus.cc:385] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.793954 15529 raft_consensus.cc:740] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.793702 15378 leader_election.cc:304] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:23.794986 15536 raft_consensus.cc:2804] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:23.795531 15536 raft_consensus.cc:493] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.801448 15536 raft_consensus.cc:3060] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.802260 15530 tablet_bootstrap.cc:492] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.803081 15530 ts_tablet_manager.cc:1403] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.008s
I20260501 14:02:23.804724 15529 consensus_queue.cc:260] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.798885 15532 raft_consensus.cc:2749] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:23.792498 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:23.806859 15530 raft_consensus.cc:359] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.808022 15487 raft_consensus.cc:2468] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:23.808252 15530 raft_consensus.cc:385] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.808772 15530 raft_consensus.cc:740] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.800817 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.809965 15530 consensus_queue.cc:260] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.811147 15529 ts_tablet_manager.cc:1434] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260501 14:02:23.811295 15378 leader_election.cc:304] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:23.812541 15538 raft_consensus.cc:2804] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:23.812913 15530 ts_tablet_manager.cc:1434] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260501 14:02:23.812951 15538 raft_consensus.cc:493] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.813678 15538 raft_consensus.cc:3060] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.814426 15530 tablet_bootstrap.cc:492] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
W20260501 14:02:23.814515 15376 leader_election.cc:343] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.816391 15562 raft_consensus.cc:515] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.820103 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
W20260501 14:02:23.822227 15302 leader_election.cc:343] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.824497 15529 tablet_bootstrap.cc:492] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.828109 15527 tablet_bootstrap.cc:654] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.828313 15536 raft_consensus.cc:515] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.831125 15562 leader_election.cc:290] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.833025 15530 tablet_bootstrap.cc:654] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.836270 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:23.837087 15487 raft_consensus.cc:3060] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.839063 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6414c162a72646f3baa93e3bd88618c2" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:23.840174 15413 raft_consensus.cc:3060] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.845749 15529 tablet_bootstrap.cc:654] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.861146 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6414c162a72646f3baa93e3bd88618c2" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:23.862356 15486 raft_consensus.cc:3060] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.866969 15413 raft_consensus.cc:2468] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:23.867377 15529 tablet_bootstrap.cc:492] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.868031 15529 ts_tablet_manager.cc:1403] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.016s
I20260501 14:02:23.871179 15302 leader_election.cc:304] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:23.872646 15562 raft_consensus.cc:2804] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:23.873422 15562 raft_consensus.cc:697] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:23.872838 15529 raft_consensus.cc:359] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.874122 15529 raft_consensus.cc:385] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.874569 15529 raft_consensus.cc:740] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.875597 15529 consensus_queue.cc:260] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.881816 15529 ts_tablet_manager.cc:1434] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260501 14:02:23.874775 15562 consensus_queue.cc:237] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.883886 15529 tablet_bootstrap.cc:492] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.894282 15529 tablet_bootstrap.cc:654] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.904732 15536 leader_election.cc:290] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.909354 15529 tablet_bootstrap.cc:492] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:23.910386 15529 ts_tablet_manager.cc:1403] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260501 14:02:23.917079 15538 raft_consensus.cc:515] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.927918 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
W20260501 14:02:23.930183 15376 leader_election.cc:343] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:23.931103 15486 raft_consensus.cc:2468] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:23.931882 15529 raft_consensus.cc:359] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.933111 15529 raft_consensus.cc:385] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.933549 15529 raft_consensus.cc:740] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.934856 15529 consensus_queue.cc:260] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.939075 15529 ts_tablet_manager.cc:1434] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.000s
I20260501 14:02:23.940903 15529 tablet_bootstrap.cc:492] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:23.941581 15236 catalog_manager.cc:5671] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:23.923130 15487 raft_consensus.cc:2468] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:23.947031 15538 leader_election.cc:290] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.949725 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:23.950803 15486 raft_consensus.cc:3060] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.957371 15303 leader_election.cc:304] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:23.958273 15236 catalog_manager.cc:5671] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:23.959303 15536 raft_consensus.cc:2804] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:23.957999 15538 raft_consensus.cc:493] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:23.959869 15536 raft_consensus.cc:697] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:23.961130 15529 tablet_bootstrap.cc:654] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.960886 15536 consensus_queue.cc:237] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.964450 15530 tablet_bootstrap.cc:492] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:23.965078 15530 ts_tablet_manager.cc:1403] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.151s	user 0.030s	sys 0.091s
I20260501 14:02:23.967746 15527 tablet_bootstrap.cc:492] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:23.968376 15527 ts_tablet_manager.cc:1403] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.221s	user 0.049s	sys 0.076s
I20260501 14:02:23.969274 15530 raft_consensus.cc:359] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.970294 15530 raft_consensus.cc:385] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.970561 15530 raft_consensus.cc:740] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.971338 15530 consensus_queue.cc:260] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.972875 15527 raft_consensus.cc:359] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.973659 15527 raft_consensus.cc:385] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:23.973937 15527 raft_consensus.cc:740] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:23.974854 15527 consensus_queue.cc:260] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.960040 15538 raft_consensus.cc:515] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:23.977639 15527 ts_tablet_manager.cc:1434] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260501 14:02:23.978820 15530 ts_tablet_manager.cc:1434] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260501 14:02:23.980365 15530 tablet_bootstrap.cc:492] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:23.978886 15527 tablet_bootstrap.cc:492] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:23.987625 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:23.988196 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:23.988534 15487 raft_consensus.cc:2468] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:23.989027 15338 raft_consensus.cc:2468] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:23.990263 15378 leader_election.cc:304] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:23.991250 15532 raft_consensus.cc:2804] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:23.991614 15532 raft_consensus.cc:493] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:23.992033 15532 raft_consensus.cc:3060] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:23.997228 15527 tablet_bootstrap.cc:654] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:23.998375 15538 leader_election.cc:290] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:23.991920 15530 tablet_bootstrap.cc:654] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:24.002529 15486 raft_consensus.cc:2468] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:24.002457 15532 raft_consensus.cc:515] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.004205 15378 leader_election.cc:304] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: bedc021636444be1990fbe2fe8023d78
I20260501 14:02:24.005626 15538 raft_consensus.cc:2804] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:24.007004 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:24.007920 15338 raft_consensus.cc:3060] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.011400 15538 raft_consensus.cc:697] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:24.003089 15235 catalog_manager.cc:5671] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:24.014565 15538 consensus_queue.cc:237] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.021004 15530 tablet_bootstrap.cc:492] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:24.021704 15530 ts_tablet_manager.cc:1403] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.000s
I20260501 14:02:24.024184 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:24.025450 15486 raft_consensus.cc:3060] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.025350 15530 raft_consensus.cc:359] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.026322 15530 raft_consensus.cc:385] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:24.026640 15530 raft_consensus.cc:740] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:24.029016 15530 consensus_queue.cc:260] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.031718 15529 tablet_bootstrap.cc:492] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:24.032439 15529 ts_tablet_manager.cc:1403] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.012s
I20260501 14:02:24.032279 15532 leader_election.cc:290] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.035709 15527 tablet_bootstrap.cc:492] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:24.036422 15527 ts_tablet_manager.cc:1403] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.019s
I20260501 14:02:24.037755 15530 ts_tablet_manager.cc:1434] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260501 14:02:24.038626 15338 raft_consensus.cc:2468] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:24.039922 15527 raft_consensus.cc:359] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.040740 15527 raft_consensus.cc:385] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:24.040472 15376 leader_election.cc:304] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:24.041457 15527 raft_consensus.cc:740] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:24.041489 15538 raft_consensus.cc:2804] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:24.042275 15538 raft_consensus.cc:697] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:24.042842 15554 raft_consensus.cc:493] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.042409 15527 consensus_queue.cc:260] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.043397 15486 raft_consensus.cc:2468] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:24.043527 15538 consensus_queue.cc:237] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.045064 15527 ts_tablet_manager.cc:1434] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260501 14:02:24.043383 15554 raft_consensus.cc:515] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.049998 15554 leader_election.cc:290] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701)
I20260501 14:02:24.038543 15232 catalog_manager.cc:5671] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:24.051149 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f096d988b64be3bb923f38a5945642" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:24.052125 15413 raft_consensus.cc:2393] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c41dc0c9feeb455892cb36be03a44dfc in current term 1: Already voted for candidate bedc021636444be1990fbe2fe8023d78 in this term.
I20260501 14:02:24.052237 15529 raft_consensus.cc:359] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.053012 15529 raft_consensus.cc:385] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:24.053156 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f096d988b64be3bb923f38a5945642" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:24.054637 15450 leader_election.cc:304] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:24.055370 15554 raft_consensus.cc:3060] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.056134 15529 raft_consensus.cc:740] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:24.057058 15529 consensus_queue.cc:260] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.060519 15529 ts_tablet_manager.cc:1434] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260501 14:02:24.060508 15538 raft_consensus.cc:493] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.061287 15538 raft_consensus.cc:515] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.062105 15529 tablet_bootstrap.cc:492] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:24.062580 15537 raft_consensus.cc:493] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.063117 15537 raft_consensus.cc:515] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.064704 15538 leader_election.cc:290] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.065308 15537 leader_election.cc:290] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:24.066576 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:24.066941 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:24.067324 15413 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:24.067634 15337 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:24.068470 15451 leader_election.cc:304] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:24.069832 15537 raft_consensus.cc:2804] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:24.070209 15537 raft_consensus.cc:493] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:24.070542 15537 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.072600 15232 catalog_manager.cc:5671] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:24.071269 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:24.076632 15554 raft_consensus.cc:2749] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:24.076716 15338 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:24.077186 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:24.078420 15376 leader_election.cc:304] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:24.079270 15538 raft_consensus.cc:2804] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:24.079608 15538 raft_consensus.cc:493] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:24.079936 15538 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.086082 15537 raft_consensus.cc:515] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.086807 15538 raft_consensus.cc:515] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.087328 15486 raft_consensus.cc:2393] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c790e8630214fafaaea14dd4823621e in current term 1: Already voted for candidate c41dc0c9feeb455892cb36be03a44dfc in this term.
I20260501 14:02:24.089128 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:24.089814 15338 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.089902 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:24.090444 15538 leader_election.cc:290] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.090718 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:24.091575 15487 raft_consensus.cc:2393] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c790e8630214fafaaea14dd4823621e in current term 1: Already voted for candidate c41dc0c9feeb455892cb36be03a44dfc in this term.
I20260501 14:02:24.092680 15378 leader_election.cc:304] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:24.093502 15538 raft_consensus.cc:2749] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:02:24.095528 15529 tablet_bootstrap.cc:654] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:24.096446 15537 leader_election.cc:290] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:24.097699 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:24.098582 15413 raft_consensus.cc:2393] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c41dc0c9feeb455892cb36be03a44dfc in current term 1: Already voted for candidate 0c790e8630214fafaaea14dd4823621e in this term.
I20260501 14:02:24.098641 15338 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 1.
I20260501 14:02:24.100096 15450 leader_election.cc:304] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:24.100914 15537 raft_consensus.cc:2804] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:24.101394 15537 raft_consensus.cc:697] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:24.102203 15529 tablet_bootstrap.cc:492] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:24.102906 15529 ts_tablet_manager.cc:1403] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260501 14:02:24.102265 15537 consensus_queue.cc:237] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.105985 15529 raft_consensus.cc:359] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.106807 15529 raft_consensus.cc:385] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:24.107089 15529 raft_consensus.cc:740] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:24.107728 15529 consensus_queue.cc:260] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.109827 15529 ts_tablet_manager.cc:1434] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 14:02:24.112007 15232 catalog_manager.cc:5671] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 0 to 1, leader changed from <none> to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 1 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:24.178257 15537 raft_consensus.cc:493] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.179023 15537 raft_consensus.cc:515] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.181097 15537 leader_election.cc:290] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:24.182096 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:24.182356 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:24.182889 15338 raft_consensus.cc:2468] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:24.183053 15413 raft_consensus.cc:2468] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:24.184091 15450 leader_election.cc:304] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:24.184968 15537 raft_consensus.cc:2804] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:24.185366 15537 raft_consensus.cc:493] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:24.185662 15537 raft_consensus.cc:3060] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.192243 15537 raft_consensus.cc:515] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.194700 15537 leader_election.cc:290] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:24.195528 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:24.196342 15338 raft_consensus.cc:3060] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.196431 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:24.197149 15413 raft_consensus.cc:3060] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.202857 15338 raft_consensus.cc:2468] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 1.
I20260501 14:02:24.203186 15413 raft_consensus.cc:2468] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 1.
I20260501 14:02:24.204458 15450 leader_election.cc:304] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:24.205382 15537 raft_consensus.cc:2804] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:24.205873 15537 raft_consensus.cc:697] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:24.206622 15537 consensus_queue.cc:237] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.213927 15538 raft_consensus.cc:493] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.214624 15538 raft_consensus.cc:515] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.216491 15538 leader_election.cc:290] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.215993 15232 catalog_manager.cc:5671] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 0 to 1, leader changed from <none> to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 1 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:24.217559 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4ab70badb46419deb6510bcbff523" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:24.217720 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4ab70badb46419deb6510bcbff523" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:24.218116 15338 raft_consensus.cc:2468] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:24.218464 15487 raft_consensus.cc:2468] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:24.219419 15376 leader_election.cc:304] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:24.220412 15538 raft_consensus.cc:2804] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:24.220755 15538 raft_consensus.cc:493] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:24.221037 15538 raft_consensus.cc:3060] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.228600 15538 raft_consensus.cc:515] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.230533 15538 leader_election.cc:290] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.231709 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4ab70badb46419deb6510bcbff523" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:24.231715 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4ab70badb46419deb6510bcbff523" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:24.232839 15487 raft_consensus.cc:3060] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.232843 15338 raft_consensus.cc:3060] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.242795 15338 raft_consensus.cc:2468] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:24.242795 15487 raft_consensus.cc:2468] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:24.244585 15376 leader_election.cc:304] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:24.245695 15538 raft_consensus.cc:2804] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:24.246198 15538 raft_consensus.cc:697] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:24.247135 15538 consensus_queue.cc:237] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.253887 15538 raft_consensus.cc:493] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.254495 15538 raft_consensus.cc:515] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.257349 15538 leader_election.cc:290] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.256588 15232 catalog_manager.cc:5671] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:24.257982 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:24.257982 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:24.258860 15487 raft_consensus.cc:2393] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c790e8630214fafaaea14dd4823621e in current term 1: Already voted for candidate bedc021636444be1990fbe2fe8023d78 in this term.
I20260501 14:02:24.260223 15378 leader_election.cc:304] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:24.261158 15538 raft_consensus.cc:3060] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.270612 15538 raft_consensus.cc:2749] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:24.313731 15536 consensus_queue.cc:1048] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.314890 15562 consensus_queue.cc:1048] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.331912 15562 consensus_queue.cc:1048] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.332953 15559 consensus_queue.cc:1048] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.372252 15559 consensus_queue.cc:1048] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:24.378806 15559 consensus_queue.cc:1048] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.396286 15536 consensus_queue.cc:1048] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:24.411765 15562 consensus_queue.cc:1048] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.437851 15538 consensus_queue.cc:1048] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:24.450525 15538 consensus_queue.cc:1048] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.493050 15486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
mode: GRACEFUL
new_leader_uuid: "bedc021636444be1990fbe2fe8023d78"
 from {username='slave'} at 127.0.0.1:59130
I20260501 14:02:24.493848 15486 raft_consensus.cc:606] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Received request to transfer leadership to TS bedc021636444be1990fbe2fe8023d78
I20260501 14:02:24.503135 15486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
mode: GRACEFUL
new_leader_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:59130
I20260501 14:02:24.503796 15486 raft_consensus.cc:606] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Received request to transfer leadership to TS 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:24.520596 15562 raft_consensus.cc:493] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:24.521353 15562 raft_consensus.cc:515] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.523371 15562 leader_election.cc:290] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.524755 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:24.524749 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634b7213f4b849d99a127b1ae6c25af5" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:24.525951 15486 raft_consensus.cc:2393] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bedc021636444be1990fbe2fe8023d78 in current term 1: Already voted for candidate 0c790e8630214fafaaea14dd4823621e in this term.
I20260501 14:02:24.527463 15303 leader_election.cc:304] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bedc021636444be1990fbe2fe8023d78; no voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:24.527500 15338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
mode: GRACEFUL
new_leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:52706
I20260501 14:02:24.528306 15338 raft_consensus.cc:606] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Received request to transfer leadership to TS c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:24.528378 15562 raft_consensus.cc:3060] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:24.529405 15537 consensus_queue.cc:1048] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.537545 15562 raft_consensus.cc:2749] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:24.538573 15554 raft_consensus.cc:993] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: : Instructing follower bedc021636444be1990fbe2fe8023d78 to start an election
I20260501 14:02:24.539404 15537 raft_consensus.cc:1081] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Signalling peer bedc021636444be1990fbe2fe8023d78 to start an election
I20260501 14:02:24.540859 15580 consensus_queue.cc:1048] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.542366 15337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
 from {username='slave'} at 127.0.0.1:52704
I20260501 14:02:24.543109 15337 raft_consensus.cc:493] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:24.543519 15337 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:24.547326 15537 consensus_queue.cc:1048] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.553920 15337 raft_consensus.cc:515] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.562788 15337 leader_election.cc:290] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 2 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.564255 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:24.565021 15487 raft_consensus.cc:3055] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:24.565383 15487 raft_consensus.cc:740] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:24.566259 15487 consensus_queue.cc:260] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.566083 15580 consensus_queue.cc:1048] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.567188 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:24.567858 15412 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:24.568037 15487 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:24.577972 15487 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 2.
I20260501 14:02:24.579180 15303 leader_election.cc:304] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:24.580847 15562 raft_consensus.cc:2804] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:24.581379 15562 raft_consensus.cc:697] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:24.582245 15562 consensus_queue.cc:237] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.583250 15412 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 2.
I20260501 14:02:24.598632 15232 catalog_manager.cc:5671] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 1 to 2, leader changed from c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131) to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:24.622155 15537 consensus_queue.cc:1048] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:24.630005 15554 raft_consensus.cc:993] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: : Instructing follower 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:24.630621 15606 raft_consensus.cc:1081] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Signalling peer 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:24.633250 15413 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:53364
I20260501 14:02:24.634191 15413 raft_consensus.cc:493] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:24.634639 15413 raft_consensus.cc:3060] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:24.638284 15554 consensus_queue.cc:1048] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.643153 15413 raft_consensus.cc:515] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.646504 15413 leader_election.cc:290] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:24.646735 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:24.647475 15337 raft_consensus.cc:3060] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:24.649253 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77df37953a147ca95ff18f00e7ae1c3" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:24.650022 15487 raft_consensus.cc:3055] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:24.650367 15487 raft_consensus.cc:740] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:24.651264 15487 consensus_queue.cc:260] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.652642 15487 raft_consensus.cc:3060] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:24.656152 15337 raft_consensus.cc:2468] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:24.660056 15376 leader_election.cc:304] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:24.661185 15580 raft_consensus.cc:2804] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:24.661743 15580 raft_consensus.cc:697] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:24.661831 15487 raft_consensus.cc:2468] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:24.662779 15580 consensus_queue.cc:237] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:24.670692 15232 catalog_manager.cc:5671] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 1 to 2, leader changed from c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131) to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:24.789342 15580 consensus_queue.cc:1048] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:24.802273 15600 consensus_queue.cc:1048] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:24.993439 15536 raft_consensus.cc:993] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: : Instructing follower c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:24.994552 15536 raft_consensus.cc:1081] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Signalling peer c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:25.000787 15487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:59126
I20260501 14:02:25.001505 15487 raft_consensus.cc:493] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:25.001853 15487 raft_consensus.cc:3060] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:25.009038 15487 raft_consensus.cc:515] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:25.011576 15487 leader_election.cc:290] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:25.012055 15486 raft_consensus.cc:1275] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Refusing update from remote peer bedc021636444be1990fbe2fe8023d78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:25.012517 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:25.013267 15337 raft_consensus.cc:3055] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:25.013300 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266bc93eb4e4b52935a762d48ecc6f9" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:25.013696 15536 consensus_queue.cc:1048] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:25.013743 15337 raft_consensus.cc:740] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:25.014107 15413 raft_consensus.cc:3060] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:25.015106 15337 consensus_queue.cc:260] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:25.016618 15337 raft_consensus.cc:3060] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:25.023327 15413 raft_consensus.cc:2468] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:25.025157 15451 leader_election.cc:304] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:25.026095 15554 raft_consensus.cc:2804] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:25.026700 15554 raft_consensus.cc:697] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:25.027485 15554 consensus_queue.cc:237] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:25.032414 15413 raft_consensus.cc:1275] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Refusing update from remote peer bedc021636444be1990fbe2fe8023d78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:25.035380 15614 consensus_queue.cc:1048] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:25.039340 15337 raft_consensus.cc:2468] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:25.038635 15232 catalog_manager.cc:5671] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 1 to 2, leader changed from bedc021636444be1990fbe2fe8023d78 (127.6.77.129) to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 2 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:25.136351 15486 raft_consensus.cc:1275] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:25.137997 15538 consensus_queue.cc:1048] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:25.147542 15337 raft_consensus.cc:1275] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:25.149688 15532 consensus_queue.cc:1048] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:25.487942 15413 raft_consensus.cc:1275] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:25.489533 15554 consensus_queue.cc:1048] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:25.504551 15337 raft_consensus.cc:1275] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:25.506192 15554 consensus_queue.cc:1048] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:27.562587 15232 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56998:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 14:02:27.566015 15232 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260501 14:02:27.622578 15323 tablet_service.cc:1511] Processing CreateTablet for tablet 40816aa05f3041e4abdba6f3b66aa265 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:27.624529 15323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40816aa05f3041e4abdba6f3b66aa265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.624866 15403 tablet_service.cc:1511] Processing CreateTablet for tablet 40816aa05f3041e4abdba6f3b66aa265 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:27.627876 15324 tablet_service.cc:1511] Processing CreateTablet for tablet 5150e0db689349a4bbfae120cc1587bf (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:27.629456 15324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5150e0db689349a4bbfae120cc1587bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.632133 15325 tablet_service.cc:1511] Processing CreateTablet for tablet ad2f80541aad4cedb10b5d182b5a7fbb (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:27.633180 15477 tablet_service.cc:1511] Processing CreateTablet for tablet 40816aa05f3041e4abdba6f3b66aa265 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:27.633751 15325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2f80541aad4cedb10b5d182b5a7fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.634811 15477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40816aa05f3041e4abdba6f3b66aa265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.636834 15476 tablet_service.cc:1511] Processing CreateTablet for tablet ad2f80541aad4cedb10b5d182b5a7fbb (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:27.637176 15400 tablet_service.cc:1511] Processing CreateTablet for tablet ad2f80541aad4cedb10b5d182b5a7fbb (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:27.637951 15322 tablet_service.cc:1511] Processing CreateTablet for tablet 485c6172c22c4593a5f3fb0c65ebcc16 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:27.638454 15476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2f80541aad4cedb10b5d182b5a7fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.639395 15322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485c6172c22c4593a5f3fb0c65ebcc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.642748 15396 tablet_service.cc:1511] Processing CreateTablet for tablet 5150e0db689349a4bbfae120cc1587bf (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:27.645306 15472 tablet_service.cc:1511] Processing CreateTablet for tablet 5150e0db689349a4bbfae120cc1587bf (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:27.646888 15472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5150e0db689349a4bbfae120cc1587bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.649140 15474 tablet_service.cc:1511] Processing CreateTablet for tablet 485c6172c22c4593a5f3fb0c65ebcc16 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:27.653021 15399 tablet_service.cc:1511] Processing CreateTablet for tablet 485c6172c22c4593a5f3fb0c65ebcc16 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:27.657191 15397 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe16bfdcc45451ab595f5f94bd2da6f (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:27.658061 15401 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc53951ef3f4a8aa7f238f8ea0bcb5c (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:27.659438 15471 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe16bfdcc45451ab595f5f94bd2da6f (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:27.660218 15469 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc53951ef3f4a8aa7f238f8ea0bcb5c (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:27.662482 15402 tablet_service.cc:1511] Processing CreateTablet for tablet 6a709c55fc6b42259ee7295bf61c100e (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:27.665243 15469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc53951ef3f4a8aa7f238f8ea0bcb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.666507 15473 tablet_service.cc:1511] Processing CreateTablet for tablet 6a709c55fc6b42259ee7295bf61c100e (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:27.668012 15473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a709c55fc6b42259ee7295bf61c100e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.670812 15395 tablet_service.cc:1511] Processing CreateTablet for tablet a18b4cb871ab4e7a9dfdff80d9df897a (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:27.670967 15470 tablet_service.cc:1511] Processing CreateTablet for tablet a18b4cb871ab4e7a9dfdff80d9df897a (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:27.672415 15470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b4cb871ab4e7a9dfdff80d9df897a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.672667 15398 tablet_service.cc:1511] Processing CreateTablet for tablet 15f6de6c6d15404fb0e1317cc567ab80 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:27.626463 15403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40816aa05f3041e4abdba6f3b66aa265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.655334 15475 tablet_service.cc:1511] Processing CreateTablet for tablet 15f6de6c6d15404fb0e1317cc567ab80 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:27.678682 15400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2f80541aad4cedb10b5d182b5a7fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.683446 15321 tablet_service.cc:1511] Processing CreateTablet for tablet 15f6de6c6d15404fb0e1317cc567ab80 (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:27.685230 15321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f6de6c6d15404fb0e1317cc567ab80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.689335 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe16bfdcc45451ab595f5f94bd2da6f (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:27.691028 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe16bfdcc45451ab595f5f94bd2da6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.693863 15320 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc53951ef3f4a8aa7f238f8ea0bcb5c (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:27.696532 15320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc53951ef3f4a8aa7f238f8ea0bcb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.700768 15471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe16bfdcc45451ab595f5f94bd2da6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.701790 15474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485c6172c22c4593a5f3fb0c65ebcc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.702185 15396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5150e0db689349a4bbfae120cc1587bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.706439 15475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f6de6c6d15404fb0e1317cc567ab80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.715621 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 6a709c55fc6b42259ee7295bf61c100e (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:27.717667 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a709c55fc6b42259ee7295bf61c100e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.719539 15326 tablet_service.cc:1511] Processing CreateTablet for tablet a18b4cb871ab4e7a9dfdff80d9df897a (DEFAULT_TABLE table=soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:27.723367 15401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc53951ef3f4a8aa7f238f8ea0bcb5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:02:27.742137 15378 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:40901, user_credentials={real_user=slave}} blocked reactor thread for 47356.6us
I20260501 14:02:27.763351 15402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a709c55fc6b42259ee7295bf61c100e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.770752 15397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe16bfdcc45451ab595f5f94bd2da6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.773284 15395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b4cb871ab4e7a9dfdff80d9df897a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.775277 15399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485c6172c22c4593a5f3fb0c65ebcc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.827193 15326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18b4cb871ab4e7a9dfdff80d9df897a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:27.836404 15631 tablet_bootstrap.cc:492] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:27.839908 15398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f6de6c6d15404fb0e1317cc567ab80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:02:27.817202 15303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:40901, user_credentials={real_user=slave}} blocked reactor thread for 89436.7us
I20260501 14:02:27.891387 15631 tablet_bootstrap.cc:654] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:27.916982 15633 tablet_bootstrap.cc:492] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:27.936097 15633 tablet_bootstrap.cc:654] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:27.940294 15631 tablet_bootstrap.cc:492] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:27.941145 15631 ts_tablet_manager.cc:1403] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.005s
I20260501 14:02:27.941792 15634 tablet_bootstrap.cc:492] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:27.944943 15631 raft_consensus.cc:359] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:27.945909 15631 raft_consensus.cc:385] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:27.946295 15631 raft_consensus.cc:740] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:27.946705 15633 tablet_bootstrap.cc:492] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:27.947260 15631 consensus_queue.cc:260] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:27.948386 15633 ts_tablet_manager.cc:1403] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.004s
I20260501 14:02:27.949792 15634 tablet_bootstrap.cc:654] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:27.955397 15633 raft_consensus.cc:359] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:27.956451 15633 raft_consensus.cc:385] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:27.956779 15633 raft_consensus.cc:740] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:27.950413 15631 ts_tablet_manager.cc:1434] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:02:27.957751 15633 consensus_queue.cc:260] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:27.959283 15631 tablet_bootstrap.cc:492] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:27.960706 15633 ts_tablet_manager.cc:1434] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260501 14:02:27.962042 15633 tablet_bootstrap.cc:492] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:27.969110 15631 tablet_bootstrap.cc:654] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:27.969919 15633 tablet_bootstrap.cc:654] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:27.986763 15633 tablet_bootstrap.cc:492] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:27.987430 15633 ts_tablet_manager.cc:1403] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260501 14:02:27.990839 15633 raft_consensus.cc:359] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:27.991683 15633 raft_consensus.cc:385] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:27.992033 15633 raft_consensus.cc:740] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:27.992767 15633 consensus_queue.cc:260] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:27.995348 15633 ts_tablet_manager.cc:1434] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:02:27.996671 15633 tablet_bootstrap.cc:492] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:28.004146 15633 tablet_bootstrap.cc:654] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.051224 15631 tablet_bootstrap.cc:492] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.052161 15631 ts_tablet_manager.cc:1403] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.049s
I20260501 14:02:28.052534 15634 tablet_bootstrap.cc:492] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.053246 15634 ts_tablet_manager.cc:1403] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.112s	user 0.036s	sys 0.064s
I20260501 14:02:28.055716 15633 tablet_bootstrap.cc:492] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.056787 15633 ts_tablet_manager.cc:1403] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.060s	user 0.028s	sys 0.029s
I20260501 14:02:28.058655 15634 raft_consensus.cc:359] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.059990 15634 raft_consensus.cc:385] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.060451 15634 raft_consensus.cc:740] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.061645 15633 raft_consensus.cc:359] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.061865 15634 consensus_queue.cc:260] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.062879 15633 raft_consensus.cc:385] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.064055 15633 raft_consensus.cc:740] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.066663 15631 raft_consensus.cc:359] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.067792 15631 raft_consensus.cc:385] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.068212 15634 ts_tablet_manager.cc:1434] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260501 14:02:28.068243 15631 raft_consensus.cc:740] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.069972 15634 tablet_bootstrap.cc:492] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.070704 15631 consensus_queue.cc:260] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.074955 15631 ts_tablet_manager.cc:1434] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.005s
I20260501 14:02:28.065275 15633 consensus_queue.cc:260] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.078380 15633 ts_tablet_manager.cc:1434] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260501 14:02:28.079713 15633 tablet_bootstrap.cc:492] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:28.076305 15631 tablet_bootstrap.cc:492] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.087353 15633 tablet_bootstrap.cc:654] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.088217 15619 raft_consensus.cc:493] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.088980 15619 raft_consensus.cc:515] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.090691 15634 tablet_bootstrap.cc:654] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.092680 15619 leader_election.cc:290] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.093003 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.093422 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
W20260501 14:02:28.094789 15451 leader_election.cc:343] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:02:28.095315 15450 leader_election.cc:343] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.095752 15450 leader_election.cc:304] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:28.098186 15619 raft_consensus.cc:2749] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.106468 15631 tablet_bootstrap.cc:654] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.110206 15634 tablet_bootstrap.cc:492] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.111037 15634 ts_tablet_manager.cc:1403] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.003s
I20260501 14:02:28.113580 15633 tablet_bootstrap.cc:492] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.113580 15631 tablet_bootstrap.cc:492] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.114085 15634 raft_consensus.cc:359] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.114593 15633 ts_tablet_manager.cc:1403] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.016s
I20260501 14:02:28.115001 15634 raft_consensus.cc:385] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.114593 15631 ts_tablet_manager.cc:1403] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.006s
I20260501 14:02:28.115399 15634 raft_consensus.cc:740] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.116444 15634 consensus_queue.cc:260] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.118882 15633 raft_consensus.cc:359] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.120251 15633 raft_consensus.cc:385] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.120697 15633 raft_consensus.cc:740] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.135681 15633 consensus_queue.cc:260] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.137434 15631 raft_consensus.cc:359] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.138429 15631 raft_consensus.cc:385] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.138758 15633 ts_tablet_manager.cc:1434] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.015s
I20260501 14:02:28.138782 15631 raft_consensus.cc:740] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.139969 15634 ts_tablet_manager.cc:1434] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.018s
I20260501 14:02:28.141243 15634 tablet_bootstrap.cc:492] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.141781 15633 tablet_bootstrap.cc:492] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:28.148267 15634 tablet_bootstrap.cc:654] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.148407 15631 consensus_queue.cc:260] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.150666 15633 tablet_bootstrap.cc:654] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.156728 15631 ts_tablet_manager.cc:1434] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.000s
I20260501 14:02:28.158684 15631 tablet_bootstrap.cc:492] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.165088 15630 raft_consensus.cc:493] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.165784 15630 raft_consensus.cc:515] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.173295 15630 leader_election.cc:290] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.175459 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
W20260501 14:02:28.178514 15376 leader_election.cc:343] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.180855 15631 tablet_bootstrap.cc:654] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.182806 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
W20260501 14:02:28.185837 15378 leader_election.cc:343] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.186444 15378 leader_election.cc:304] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.188825 15630 raft_consensus.cc:2749] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.194901 15632 raft_consensus.cc:493] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.195616 15632 raft_consensus.cc:515] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.196609 15634 tablet_bootstrap.cc:492] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.197315 15634 ts_tablet_manager.cc:1403] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.015s
I20260501 14:02:28.198607 15632 leader_election.cc:290] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.194832 15633 tablet_bootstrap.cc:492] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.199414 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.199765 15633 ts_tablet_manager.cc:1403] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.040s
I20260501 14:02:28.199928 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
W20260501 14:02:28.201205 15302 leader_election.cc:343] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.201802 15634 raft_consensus.cc:359] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.202595 15634 raft_consensus.cc:385] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.203176 15634 raft_consensus.cc:740] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.204094 15634 consensus_queue.cc:260] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
W20260501 14:02:28.204846 15303 leader_election.cc:343] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.204516 15633 raft_consensus.cc:359] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.205534 15633 raft_consensus.cc:385] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.205778 15631 tablet_bootstrap.cc:492] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.205433 15303 leader_election.cc:304] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bedc021636444be1990fbe2fe8023d78; no voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.206048 15633 raft_consensus.cc:740] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.206459 15631 ts_tablet_manager.cc:1403] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.010s
I20260501 14:02:28.207276 15632 raft_consensus.cc:2749] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.207237 15633 consensus_queue.cc:260] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.209493 15634 ts_tablet_manager.cc:1434] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260501 14:02:28.210177 15633 ts_tablet_manager.cc:1434] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260501 14:02:28.210774 15634 tablet_bootstrap.cc:492] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.210301 15631 raft_consensus.cc:359] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.211252 15631 raft_consensus.cc:385] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.211613 15631 raft_consensus.cc:740] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.212874 15633 tablet_bootstrap.cc:492] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:28.212544 15631 consensus_queue.cc:260] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.214988 15619 raft_consensus.cc:493] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.216043 15614 raft_consensus.cc:493] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.216778 15614 raft_consensus.cc:515] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.220780 15634 tablet_bootstrap.cc:654] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.225298 15631 ts_tablet_manager.cc:1434] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.006s
I20260501 14:02:28.226660 15631 tablet_bootstrap.cc:492] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.215773 15619 raft_consensus.cc:515] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.234731 15631 tablet_bootstrap.cc:654] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.238045 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
W20260501 14:02:28.241333 15451 leader_election.cc:343] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.243112 15634 tablet_bootstrap.cc:492] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.221016 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40816aa05f3041e4abdba6f3b66aa265" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.244031 15634 ts_tablet_manager.cc:1403] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.006s
I20260501 14:02:28.244381 15413 raft_consensus.cc:2468] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.246232 15302 leader_election.cc:304] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:28.247206 15647 raft_consensus.cc:2804] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.247627 15647 raft_consensus.cc:493] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.248103 15647 raft_consensus.cc:3060] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.247731 15634 raft_consensus.cc:359] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.248697 15634 raft_consensus.cc:385] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.249025 15634 raft_consensus.cc:740] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.249807 15634 consensus_queue.cc:260] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.253522 15634 ts_tablet_manager.cc:1434] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260501 14:02:28.256768 15631 tablet_bootstrap.cc:492] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.257043 15633 tablet_bootstrap.cc:654] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.258860 15634 tablet_bootstrap.cc:492] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.261372 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40816aa05f3041e4abdba6f3b66aa265" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.257467 15631 ts_tablet_manager.cc:1403] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.011s
I20260501 14:02:28.262243 15487 raft_consensus.cc:2468] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.257057 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.264778 15338 raft_consensus.cc:2468] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:28.266680 15631 raft_consensus.cc:359] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.267701 15631 raft_consensus.cc:385] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.268095 15631 raft_consensus.cc:740] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.269657 15634 tablet_bootstrap.cc:654] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.268998 15631 consensus_queue.cc:260] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.259968 15647 raft_consensus.cc:515] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.274524 15647 leader_election.cc:290] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.275187 15647 raft_consensus.cc:493] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.275534 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40816aa05f3041e4abdba6f3b66aa265" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.276314 15413 raft_consensus.cc:3060] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.275684 15647 raft_consensus.cc:515] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.242938 15614 leader_election.cc:290] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.282086 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.282927 15412 raft_consensus.cc:2468] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.285794 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.286175 15450 leader_election.cc:304] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.289368 15619 leader_election.cc:290] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.290668 15619 raft_consensus.cc:2804] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.291080 15619 raft_consensus.cc:493] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.291469 15619 raft_consensus.cc:3060] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.291507 15302 leader_election.cc:304] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:28.299723 15632 raft_consensus.cc:2804] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.300199 15632 raft_consensus.cc:493] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.300587 15632 raft_consensus.cc:3060] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.295863 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40816aa05f3041e4abdba6f3b66aa265" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.279592 15647 leader_election.cc:290] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.304229 15486 raft_consensus.cc:3060] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:02:28.311466 15303 leader_election.cc:343] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.316247 15631 ts_tablet_manager.cc:1434] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.010s
I20260501 14:02:28.317701 15631 tablet_bootstrap.cc:492] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.318578 15633 tablet_bootstrap.cc:492] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.319316 15633 ts_tablet_manager.cc:1403] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.010s
I20260501 14:02:28.324090 15653 raft_consensus.cc:493] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.324820 15653 raft_consensus.cc:515] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.327308 15634 tablet_bootstrap.cc:492] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.328500 15634 ts_tablet_manager.cc:1403] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.016s
I20260501 14:02:28.328346 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.328867 15619 raft_consensus.cc:515] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.329273 15412 raft_consensus.cc:2468] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.331128 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.323297 15633 raft_consensus.cc:359] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.332593 15633 raft_consensus.cc:385] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.332989 15633 raft_consensus.cc:740] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.333586 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:28.333921 15633 consensus_queue.cc:260] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.334388 15338 raft_consensus.cc:3060] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.334372 15634 raft_consensus.cc:359] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.335427 15619 leader_election.cc:290] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.335883 15634 raft_consensus.cc:385] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.336254 15634 raft_consensus.cc:740] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.327404 15653 leader_election.cc:290] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.334894 15302 leader_election.cc:304] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:28.337601 15653 raft_consensus.cc:493] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.338122 15653 raft_consensus.cc:515] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.338495 15633 ts_tablet_manager.cc:1434] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260501 14:02:28.339891 15633 tablet_bootstrap.cc:492] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:28.342481 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.345649 15338 raft_consensus.cc:2468] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 1.
W20260501 14:02:28.347453 15451 leader_election.cc:343] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.340334 15653 leader_election.cc:290] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.349548 15631 tablet_bootstrap.cc:654] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.349723 15450 leader_election.cc:304] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.350776 15619 raft_consensus.cc:2804] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.348374 15614 raft_consensus.cc:2804] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.351359 15619 raft_consensus.cc:697] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:28.351450 15614 raft_consensus.cc:493] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.352029 15614 raft_consensus.cc:3060] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.352536 15619 consensus_queue.cc:237] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.355406 15631 tablet_bootstrap.cc:492] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.350253 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2f80541aad4cedb10b5d182b5a7fbb" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.356155 15631 ts_tablet_manager.cc:1403] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260501 14:02:28.348838 15633 tablet_bootstrap.cc:654] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.348368 15634 consensus_queue.cc:260] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.359598 15634 ts_tablet_manager.cc:1434] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260501 14:02:28.359799 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2f80541aad4cedb10b5d182b5a7fbb" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.359791 15631 raft_consensus.cc:359] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.360817 15634 tablet_bootstrap.cc:492] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.360929 15631 raft_consensus.cc:385] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260501 14:02:28.361107 15303 leader_election.cc:343] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.360843 15487 raft_consensus.cc:2468] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.361723 15631 raft_consensus.cc:740] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.361358 15412 raft_consensus.cc:2468] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.362643 15631 consensus_queue.cc:260] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.363059 15303 leader_election.cc:304] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:28.365337 15631 ts_tablet_manager.cc:1434] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260501 14:02:28.366405 15631 tablet_bootstrap.cc:492] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.371127 15619 raft_consensus.cc:493] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.371867 15619 raft_consensus.cc:515] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.373355 15634 tablet_bootstrap.cc:654] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.374246 15631 tablet_bootstrap.cc:654] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.374709 15619 leader_election.cc:290] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.376216 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
W20260501 14:02:28.378110 15451 leader_election.cc:343] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.378981 15413 raft_consensus.cc:2468] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.383155 15653 raft_consensus.cc:2804] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.383636 15653 raft_consensus.cc:493] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.384038 15653 raft_consensus.cc:3060] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.384333 15631 tablet_bootstrap.cc:492] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.384894 15631 ts_tablet_manager.cc:1403] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260501 14:02:28.389297 15632 raft_consensus.cc:515] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.389576 15631 raft_consensus.cc:359] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.390410 15631 raft_consensus.cc:385] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.390729 15631 raft_consensus.cc:740] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.391532 15631 consensus_queue.cc:260] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.392869 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
W20260501 14:02:28.394601 15303 leader_election.cc:343] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.394464 15653 raft_consensus.cc:515] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.396651 15653 leader_election.cc:290] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.396962 15633 tablet_bootstrap.cc:492] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.397640 15633 ts_tablet_manager.cc:1403] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.006s
I20260501 14:02:28.397995 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2f80541aad4cedb10b5d182b5a7fbb" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.398662 15487 raft_consensus.cc:3060] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.398942 15634 tablet_bootstrap.cc:492] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.399501 15634 ts_tablet_manager.cc:1403] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
I20260501 14:02:28.401297 15633 raft_consensus.cc:359] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.402122 15633 raft_consensus.cc:385] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.402436 15633 raft_consensus.cc:740] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.402551 15302 leader_election.cc:304] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:28.404853 15631 ts_tablet_manager.cc:1434] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260501 14:02:28.405200 15619 raft_consensus.cc:493] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.409495 15619 raft_consensus.cc:515] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.411234 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.411845 15619 leader_election.cc:290] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.411959 15412 raft_consensus.cc:3060] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.403271 15633 consensus_queue.cc:260] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.413158 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2f80541aad4cedb10b5d182b5a7fbb" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.391387 15234 catalog_manager.cc:5671] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 0 to 1, leader changed from <none> to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 1 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:28.413843 15411 raft_consensus.cc:3060] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.414474 15633 ts_tablet_manager.cc:1434] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260501 14:02:28.413537 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.415684 15633 tablet_bootstrap.cc:492] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
W20260501 14:02:28.416152 15451 leader_election.cc:343] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.406140 15631 tablet_bootstrap.cc:492] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.418102 15630 raft_consensus.cc:493] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.418632 15630 raft_consensus.cc:515] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.422587 15630 leader_election.cc:290] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.433750 15336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.422521 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe16bfdcc45451ab595f5f94bd2da6f" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.435751 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe16bfdcc45451ab595f5f94bd2da6f" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.428674 15632 leader_election.cc:290] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.436599 15337 raft_consensus.cc:2468] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:28.407337 15487 raft_consensus.cc:2468] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.407585 15653 raft_consensus.cc:2804] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.402763 15634 raft_consensus.cc:359] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.408599 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.439123 15634 raft_consensus.cc:385] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.439366 15338 raft_consensus.cc:2468] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 0.
I20260501 14:02:28.439520 15634 raft_consensus.cc:740] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
W20260501 14:02:28.435927 15450 leader_election.cc:343] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.440451 15450 leader_election.cc:304] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:28.440541 15634 consensus_queue.cc:260] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
W20260501 14:02:28.441970 15378 leader_election.cc:343] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.442001 15619 raft_consensus.cc:2749] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.442659 15653 raft_consensus.cc:697] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.443682 15653 consensus_queue.cc:237] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.444118 15376 leader_election.cc:304] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.445465 15630 raft_consensus.cc:2804] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.445835 15630 raft_consensus.cc:493] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.446410 15630 raft_consensus.cc:3060] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.424889 15486 raft_consensus.cc:2468] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.447868 15633 tablet_bootstrap.cc:654] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.448940 15634 ts_tablet_manager.cc:1434] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260501 14:02:28.449381 15450 leader_election.cc:304] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.450227 15634 tablet_bootstrap.cc:492] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.450724 15619 raft_consensus.cc:2804] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.451170 15619 raft_consensus.cc:493] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.451511 15619 raft_consensus.cc:3060] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.450362 15631 tablet_bootstrap.cc:654] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.453586 15412 raft_consensus.cc:2468] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.459897 15633 tablet_bootstrap.cc:492] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.460808 15633 ts_tablet_manager.cc:1403] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.010s
I20260501 14:02:28.461174 15302 leader_election.cc:304] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.462271 15647 raft_consensus.cc:2804] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.462750 15647 raft_consensus.cc:697] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.463682 15647 consensus_queue.cc:237] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.464390 15303 leader_election.cc:304] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:28.464659 15633 raft_consensus.cc:359] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.465423 15649 raft_consensus.cc:2804] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.465479 15633 raft_consensus.cc:385] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.466017 15649 raft_consensus.cc:697] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.466053 15633 raft_consensus.cc:740] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.467193 15649 consensus_queue.cc:237] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.467242 15633 consensus_queue.cc:260] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.425148 15411 raft_consensus.cc:2468] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.470682 15633 ts_tablet_manager.cc:1434] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:02:28.472103 15633 tablet_bootstrap.cc:492] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: Bootstrap starting.
I20260501 14:02:28.472985 15619 raft_consensus.cc:515] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.406736 15614 raft_consensus.cc:515] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.478852 15614 leader_election.cc:290] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.481166 15633 tablet_bootstrap.cc:654] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.481067 15487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.481958 15487 raft_consensus.cc:3060] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.483336 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.484102 15411 raft_consensus.cc:3060] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.487277 15580 raft_consensus.cc:493] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.487881 15580 raft_consensus.cc:515] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.488349 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:28.489003 15338 raft_consensus.cc:3060] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.490222 15580 leader_election.cc:290] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.492523 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.493269 15486 raft_consensus.cc:2468] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 0.
I20260501 14:02:28.494518 15378 leader_election.cc:304] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:28.495486 15580 raft_consensus.cc:2804] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.495920 15580 raft_consensus.cc:493] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.496280 15580 raft_consensus.cc:3060] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.497236 15633 tablet_bootstrap.cc:492] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: No bootstrap required, opened a new log
I20260501 14:02:28.498046 15633 ts_tablet_manager.cc:1403] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260501 14:02:28.498643 15338 raft_consensus.cc:2468] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 1.
I20260501 14:02:28.500026 15619 leader_election.cc:290] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.502115 15633 raft_consensus.cc:359] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.503767 15450 leader_election.cc:304] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:28.504884 15619 raft_consensus.cc:2804] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.505429 15619 raft_consensus.cc:697] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:28.506319 15619 consensus_queue.cc:237] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.508387 15412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.502810 15633 raft_consensus.cc:385] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.509171 15633 raft_consensus.cc:740] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Initialized, Role: FOLLOWER
W20260501 14:02:28.510001 15451 leader_election.cc:343] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.509927 15633 consensus_queue.cc:260] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.512964 15633 ts_tablet_manager.cc:1434] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260501 14:02:28.518232 15630 raft_consensus.cc:515] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.530079 15630 leader_election.cc:290] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.530920 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe16bfdcc45451ab595f5f94bd2da6f" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:28.525044 15233 catalog_manager.cc:5671] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.531638 15337 raft_consensus.cc:3060] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.532341 15631 tablet_bootstrap.cc:492] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.533118 15631 ts_tablet_manager.cc:1403] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.039s
I20260501 14:02:28.514961 15580 raft_consensus.cc:515] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.533593 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe16bfdcc45451ab595f5f94bd2da6f" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.534441 15486 raft_consensus.cc:3060] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.535548 15580 leader_election.cc:290] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.536599 15336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:28.537344 15631 raft_consensus.cc:359] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
W20260501 14:02:28.538305 15376 leader_election.cc:343] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.538970 15631 raft_consensus.cc:385] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.539465 15631 raft_consensus.cc:740] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.540412 15631 consensus_queue.cc:260] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.541525 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.543964 15485 raft_consensus.cc:3060] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.516321 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.524293 15411 raft_consensus.cc:2468] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.545802 15486 raft_consensus.cc:2468] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
W20260501 14:02:28.545815 15376 leader_election.cc:343] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.525591 15487 raft_consensus.cc:2468] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.546701 15302 leader_election.cc:304] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:28.548255 15653 raft_consensus.cc:2804] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.548943 15653 raft_consensus.cc:697] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.549005 15631 ts_tablet_manager.cc:1434] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260501 14:02:28.550402 15631 tablet_bootstrap.cc:492] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: Bootstrap starting.
I20260501 14:02:28.549963 15653 consensus_queue.cc:237] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.551955 15378 leader_election.cc:304] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
W20260501 14:02:28.553488 15284 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:02:28.553661 15485 raft_consensus.cc:2468] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:28.527057 15634 tablet_bootstrap.cc:654] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.556429 15630 raft_consensus.cc:2804] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.556986 15630 raft_consensus.cc:697] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:28.557895 15630 consensus_queue.cc:237] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.554755 15337 raft_consensus.cc:2468] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 1.
I20260501 14:02:28.560222 15378 leader_election.cc:304] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: bedc021636444be1990fbe2fe8023d78
I20260501 14:02:28.561597 15580 raft_consensus.cc:2804] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.562570 15580 raft_consensus.cc:697] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:28.563529 15649 raft_consensus.cc:493] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.564117 15649 raft_consensus.cc:515] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.566234 15649 leader_election.cc:290] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.565992 15580 consensus_queue.cc:237] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.566855 15631 tablet_bootstrap.cc:654] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.569397 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.576644 15634 tablet_bootstrap.cc:492] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.575438 15233 catalog_manager.cc:5671] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.577308 15634 ts_tablet_manager.cc:1403] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.001s
I20260501 14:02:28.581820 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
W20260501 14:02:28.573079 15302 leader_election.cc:343] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.582628 15485 raft_consensus.cc:2468] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 0.
I20260501 14:02:28.584527 15634 raft_consensus.cc:359] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.585378 15634 raft_consensus.cc:385] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.585659 15634 raft_consensus.cc:740] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.586793 15634 consensus_queue.cc:260] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.589020 15303 leader_election.cc:304] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.590444 15653 raft_consensus.cc:2804] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:28.590860 15653 raft_consensus.cc:493] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:28.591202 15653 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.595510 15235 catalog_manager.cc:5671] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 0 to 1, leader changed from <none> to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 1 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:28.598759 15631 tablet_bootstrap.cc:492] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: No bootstrap required, opened a new log
I20260501 14:02:28.599498 15634 ts_tablet_manager.cc:1434] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260501 14:02:28.599514 15631 ts_tablet_manager.cc:1403] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.019s
I20260501 14:02:28.600916 15634 tablet_bootstrap.cc:492] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.604440 15631 raft_consensus.cc:359] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.605307 15631 raft_consensus.cc:385] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.605659 15631 raft_consensus.cc:740] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.606485 15631 consensus_queue.cc:260] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.598754 15653 raft_consensus.cc:515] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.609097 15631 ts_tablet_manager.cc:1434] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260501 14:02:28.611416 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.612295 15634 tablet_bootstrap.cc:654] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.610944 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.612390 15485 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.615420 15234 catalog_manager.cc:5671] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.617533 15234 catalog_manager.cc:5671] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
W20260501 14:02:28.618608 15302 leader_election.cc:343] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:28.619534 15234 catalog_manager.cc:5671] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.626793 15485 raft_consensus.cc:2468] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 1.
I20260501 14:02:28.609745 15653 leader_election.cc:290] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.630697 15303 leader_election.cc:304] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.631691 15653 raft_consensus.cc:2804] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:28.632267 15653 raft_consensus.cc:697] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.632992 15634 tablet_bootstrap.cc:492] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.633738 15634 ts_tablet_manager.cc:1403] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.019s
I20260501 14:02:28.633148 15653 consensus_queue.cc:237] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.637486 15634 raft_consensus.cc:359] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.637367 15235 catalog_manager.cc:5671] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 1 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.638731 15634 raft_consensus.cc:385] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.639173 15634 raft_consensus.cc:740] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.640199 15634 consensus_queue.cc:260] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.642599 15634 ts_tablet_manager.cc:1434] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260501 14:02:28.643370 15634 tablet_bootstrap.cc:492] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: Bootstrap starting.
I20260501 14:02:28.647796 15653 raft_consensus.cc:493] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.648483 15653 raft_consensus.cc:515] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.649889 15634 tablet_bootstrap.cc:654] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:28.652314 15653 leader_election.cc:290] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.652207 15234 catalog_manager.cc:5671] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 0 to 1, leader changed from <none> to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.653604 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.654479 15485 raft_consensus.cc:2393] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bedc021636444be1990fbe2fe8023d78 in current term 1: Already voted for candidate 0c790e8630214fafaaea14dd4823621e in this term.
I20260501 14:02:28.655452 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.657121 15302 leader_election.cc:304] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bedc021636444be1990fbe2fe8023d78; no voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.660241 15653 raft_consensus.cc:3060] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.663193 15634 tablet_bootstrap.cc:492] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: No bootstrap required, opened a new log
I20260501 14:02:28.663885 15634 ts_tablet_manager.cc:1403] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260501 14:02:28.667222 15634 raft_consensus.cc:359] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.667958 15634 raft_consensus.cc:385] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:28.668244 15634 raft_consensus.cc:740] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Initialized, Role: FOLLOWER
I20260501 14:02:28.668939 15634 consensus_queue.cc:260] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.669454 15653 raft_consensus.cc:2749] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.671451 15634 ts_tablet_manager.cc:1434] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260501 14:02:28.722844 15580 raft_consensus.cc:493] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.723507 15580 raft_consensus.cc:515] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.725636 15580 leader_election.cc:290] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.726657 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.726876 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.727558 15337 raft_consensus.cc:2393] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c790e8630214fafaaea14dd4823621e in current term 1: Already voted for candidate c41dc0c9feeb455892cb36be03a44dfc in this term.
I20260501 14:02:28.728754 15376 leader_election.cc:304] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.729491 15580 raft_consensus.cc:3060] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.735603 15580 raft_consensus.cc:2749] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.815569 15485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
mode: GRACEFUL
new_leader_uuid: "bedc021636444be1990fbe2fe8023d78"
 from {username='slave'} at 127.0.0.1:59130
I20260501 14:02:28.816274 15485 raft_consensus.cc:606] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Received request to transfer leadership to TS bedc021636444be1990fbe2fe8023d78
I20260501 14:02:28.822692 15485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
mode: GRACEFUL
new_leader_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:59130
I20260501 14:02:28.823299 15485 raft_consensus.cc:606] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Received request to transfer leadership to TS 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.831864 15337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
mode: GRACEFUL
new_leader_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:52706
I20260501 14:02:28.832473 15337 raft_consensus.cc:606] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Received request to transfer leadership to TS 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.838065 15338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
mode: GRACEFUL
new_leader_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:52706
I20260501 14:02:28.838657 15338 raft_consensus.cc:606] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Received request to transfer leadership to TS 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.858530 15411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
mode: GRACEFUL
new_leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:53376
I20260501 14:02:28.859195 15411 raft_consensus.cc:606] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Received request to transfer leadership to TS c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.860603 15580 raft_consensus.cc:493] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.861172 15580 raft_consensus.cc:515] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.863255 15580 leader_election.cc:290] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.864125 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.864521 15653 consensus_queue.cc:1048] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:28.865056 15338 raft_consensus.cc:2393] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c790e8630214fafaaea14dd4823621e in current term 1: Already voted for candidate c41dc0c9feeb455892cb36be03a44dfc in this term.
I20260501 14:02:28.865273 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.867535 15378 leader_election.cc:304] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.868328 15580 raft_consensus.cc:3060] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.878744 15580 raft_consensus.cc:2749] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.884961 15653 consensus_queue.cc:1048] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:28.895879 15619 consensus_queue.cc:1048] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:28.908218 15648 raft_consensus.cc:993] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: : Instructing follower bedc021636444be1990fbe2fe8023d78 to start an election
I20260501 14:02:28.909008 15648 raft_consensus.cc:1081] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Signalling peer bedc021636444be1990fbe2fe8023d78 to start an election
I20260501 14:02:28.910434 15648 raft_consensus.cc:493] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.910902 15648 raft_consensus.cc:515] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.914223 15653 consensus_queue.cc:1048] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:28.920552 15648 leader_election.cc:290] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:28.922082 15337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
 from {username='slave'} at 127.0.0.1:52704
I20260501 14:02:28.922850 15337 raft_consensus.cc:493] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:28.923388 15337 raft_consensus.cc:3060] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:28.924044 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c790e8630214fafaaea14dd4823621e" is_pre_election: true
I20260501 14:02:28.928673 15648 consensus_queue.cc:1048] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:28.929471 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.933704 15450 leader_election.cc:304] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78
I20260501 14:02:28.935179 15648 raft_consensus.cc:2749] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.935185 15337 raft_consensus.cc:515] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.938807 15337 leader_election.cc:290] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 2 election: Requested vote from peers 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.939656 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.940023 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485c6172c22c4593a5f3fb0c65ebcc16" candidate_uuid: "bedc021636444be1990fbe2fe8023d78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:28.940618 15485 raft_consensus.cc:3055] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:28.941045 15485 raft_consensus.cc:740] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:28.941934 15485 consensus_queue.cc:260] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.942557 15614 raft_consensus.cc:993] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: : Instructing follower 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:28.943050 15485 raft_consensus.cc:3060] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:28.943140 15614 raft_consensus.cc:1081] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Signalling peer 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:28.947180 15411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:53358
I20260501 14:02:28.948951 15411 raft_consensus.cc:493] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:28.949261 15487 raft_consensus.cc:3060] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.950424 15411 raft_consensus.cc:3060] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:28.949856 15580 raft_consensus.cc:493] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:28.953330 15580 raft_consensus.cc:515] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.954977 15485 raft_consensus.cc:2468] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedc021636444be1990fbe2fe8023d78 in term 2.
I20260501 14:02:28.957041 15580 leader_election.cc:290] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.957597 15303 leader_election.cc:304] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 0c790e8630214fafaaea14dd4823621e
I20260501 14:02:28.958442 15486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc" is_pre_election: true
I20260501 14:02:28.958935 15649 raft_consensus.cc:2804] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:28.959368 15486 raft_consensus.cc:2393] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c790e8630214fafaaea14dd4823621e in current term 1: Already voted for candidate bedc021636444be1990fbe2fe8023d78 in this term.
I20260501 14:02:28.959506 15649 raft_consensus.cc:697] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Becoming Leader. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.961416 15649 consensus_queue.cc:237] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.967531 15411 raft_consensus.cc:515] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.968915 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedc021636444be1990fbe2fe8023d78" is_pre_election: true
I20260501 14:02:28.971230 15376 leader_election.cc:304] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e; no voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:28.967862 15649 consensus_queue.cc:1048] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:28.973213 15580 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:28.972734 15235 catalog_manager.cc:5671] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 reported cstate change: term changed from 1 to 2, leader changed from c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131) to bedc021636444be1990fbe2fe8023d78 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "bedc021636444be1990fbe2fe8023d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:28.979168 15411 leader_election.cc:290] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:28.980732 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:28.981549 15338 raft_consensus.cc:3055] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:28.981894 15338 raft_consensus.cc:740] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:28.983050 15338 consensus_queue.cc:260] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:28.984458 15338 raft_consensus.cc:3060] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:28.987522 15485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc53951ef3f4a8aa7f238f8ea0bcb5c" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:28.988132 15648 consensus_queue.cc:1048] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:28.991443 15580 raft_consensus.cc:2749] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:28.998772 15338 raft_consensus.cc:2468] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:29.000828 15376 leader_election.cc:304] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:29.002439 15580 raft_consensus.cc:2804] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:29.002635 15632 consensus_queue.cc:1048] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.002992 15580 raft_consensus.cc:697] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:29.004696 15580 consensus_queue.cc:237] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.011569 15619 consensus_queue.cc:1048] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.018466 15235 catalog_manager.cc:5671] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 1 to 2, leader changed from bedc021636444be1990fbe2fe8023d78 (127.6.77.129) to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:29.016517 15580 consensus_queue.cc:1048] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260501 14:02:29.036581 15614 consensus_queue.cc:1048] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.040580 15689 raft_consensus.cc:993] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: : Instructing follower 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:29.041142 15689 raft_consensus.cc:1081] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Signalling peer 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:29.043057 15411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:53364
I20260501 14:02:29.043635 15614 consensus_queue.cc:1048] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.045426 15411 raft_consensus.cc:493] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:29.045905 15411 raft_consensus.cc:3060] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.071179 15649 consensus_queue.cc:1048] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.073078 15649 consensus_queue.cc:1048] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:29.078171 15411 raft_consensus.cc:515] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.078768 15630 consensus_queue.cc:1048] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.082783 15484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:29.083525 15484 raft_consensus.cc:3055] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:29.084118 15484 raft_consensus.cc:740] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:29.085752 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f6de6c6d15404fb0e1317cc567ab80" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:29.086591 15338 raft_consensus.cc:3060] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.085232 15484 consensus_queue.cc:260] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.086453 15411 leader_election.cc:290] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:29.087914 15484 raft_consensus.cc:3060] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.094938 15614 consensus_queue.cc:1048] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:29.105324 15653 raft_consensus.cc:993] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: : Instructing follower 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:29.105912 15653 raft_consensus.cc:1081] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Signalling peer 0c790e8630214fafaaea14dd4823621e to start an election
I20260501 14:02:29.108510 15484 raft_consensus.cc:2468] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:29.117755 15338 raft_consensus.cc:2468] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:29.120065 15378 leader_election.cc:304] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:29.121201 15580 raft_consensus.cc:2804] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:29.121959 15580 raft_consensus.cc:697] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:29.123179 15580 consensus_queue.cc:237] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.113740 15411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
 from {username='slave'} at 127.0.0.1:53358
I20260501 14:02:29.125905 15411 raft_consensus.cc:493] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:29.126317 15411 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.130951 15580 consensus_queue.cc:1048] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260501 14:02:29.167150 15411 raft_consensus.cc:515] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.168440 15580 consensus_queue.cc:1048] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:29.168784 15671 raft_consensus.cc:993] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: : Instructing follower c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:29.169581 15671 raft_consensus.cc:1081] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Signalling peer c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:29.170976 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:29.171949 15338 raft_consensus.cc:3055] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:29.173076 15338 raft_consensus.cc:740] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:29.172073 15485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:59124
I20260501 14:02:29.174388 15485 raft_consensus.cc:493] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:29.174491 15338 consensus_queue.cc:260] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.176589 15338 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.175060 15485 raft_consensus.cc:3060] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.183087 15411 leader_election.cc:290] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131:40901)
I20260501 14:02:29.184404 15484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "0c790e8630214fafaaea14dd4823621e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
I20260501 14:02:29.185070 15484 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.189915 15338 raft_consensus.cc:2468] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:29.191519 15376 leader_election.cc:304] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, bedc021636444be1990fbe2fe8023d78; no voters: 
I20260501 14:02:29.192481 15705 raft_consensus.cc:2804] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:29.192950 15705 raft_consensus.cc:697] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Becoming Leader. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:29.193410 15484 raft_consensus.cc:2468] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c790e8630214fafaaea14dd4823621e in term 2.
I20260501 14:02:29.194726 15705 consensus_queue.cc:237] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.196422 15485 raft_consensus.cc:515] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.197584 15486 raft_consensus.cc:1240] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Rejecting Update request from peer 0c790e8630214fafaaea14dd4823621e for earlier term 1. Current term is 2. Ops: []
I20260501 14:02:29.199424 15485 leader_election.cc:290] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:29.199846 15411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:29.191636 15233 catalog_manager.cc:5671] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 1 to 2, leader changed from c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131) to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:29.200476 15705 consensus_queue.cc:1059] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:29.199478 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18b4cb871ab4e7a9dfdff80d9df897a" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:29.204977 15338 raft_consensus.cc:3060] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.206183 15411 raft_consensus.cc:3055] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:29.206678 15411 raft_consensus.cc:740] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:29.207566 15411 consensus_queue.cc:260] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.209555 15411 raft_consensus.cc:3060] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
W20260501 14:02:29.212198 15580 consensus_queue.cc:1175] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bedc021636444be1990fbe2fe8023d78" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260501 14:02:29.214229 15338 raft_consensus.cc:2468] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:29.217464 15450 leader_election.cc:304] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:29.217406 15411 raft_consensus.cc:2468] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:29.218576 15648 raft_consensus.cc:2804] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:29.219075 15648 raft_consensus.cc:697] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
W20260501 14:02:29.219372 15705 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260501 14:02:29.220048 15648 consensus_queue.cc:237] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:29.229460 15233 catalog_manager.cc:5671] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e reported cstate change: term changed from 1 to 2, leader changed from bedc021636444be1990fbe2fe8023d78 (127.6.77.129) to 0c790e8630214fafaaea14dd4823621e (127.6.77.130). New cstate: current_term: 2 leader_uuid: "0c790e8630214fafaaea14dd4823621e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:29.238559 15235 catalog_manager.cc:5671] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 1 to 2, leader changed from 0c790e8630214fafaaea14dd4823621e (127.6.77.130) to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 2 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:29.377733 15411 raft_consensus.cc:3060] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.384698 15411 raft_consensus.cc:1275] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Refusing update from remote peer bedc021636444be1990fbe2fe8023d78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.386269 15653 consensus_queue.cc:1048] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.395972 15485 raft_consensus.cc:1275] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Refusing update from remote peer bedc021636444be1990fbe2fe8023d78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.404393 15653 consensus_queue.cc:1048] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:29.440469 15485 raft_consensus.cc:3060] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:29.447135 15485 raft_consensus.cc:1275] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.449065 15705 consensus_queue.cc:1048] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:29.458940 15338 raft_consensus.cc:1275] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.460798 15705 consensus_queue.cc:1048] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.533951 15485 raft_consensus.cc:1275] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.535718 15580 consensus_queue.cc:1048] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.544906 15338 raft_consensus.cc:1275] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.547307 15580 consensus_queue.cc:1048] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.620723 15338 raft_consensus.cc:1275] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.622382 15619 consensus_queue.cc:1048] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.633392 15411 raft_consensus.cc:1275] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.634882 15648 consensus_queue.cc:1048] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.641247 15338 raft_consensus.cc:1275] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.642679 15705 consensus_queue.cc:1048] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:29.651271 15486 raft_consensus.cc:1275] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Refusing update from remote peer 0c790e8630214fafaaea14dd4823621e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:29.653237 15580 consensus_queue.cc:1048] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:31.863289 15234 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56998:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260501 14:02:31.886119 15234 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56998:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260501 14:02:31.926170  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:32.208822 15760 tablet.cc:1724] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:32.242756 15439 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:15f6de6c6d15404fb0e1317cc567ab80)
W20260501 14:02:32.277197 15439 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:15f6de6c6d15404fb0e1317cc567ab80)
W20260501 14:02:32.278371 15439 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:15f6de6c6d15404fb0e1317cc567ab80)
I20260501 14:02:32.286947 15775 tablet.cc:1724] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.287628 15773 tablet.cc:1724] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.290377 15777 tablet.cc:1724] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.294057 15769 tablet.cc:1724] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.297845 15770 tablet.cc:1724] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.331290 15772 tablet.cc:1724] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.334059 15778 tablet.cc:1724] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.335924 15779 tablet.cc:1724] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:32.313016 15761 log.cc:927] Time spent T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: Append to log took a long time: real 0.114s	user 0.000s	sys 0.009s
I20260501 14:02:32.309331 15764 tablet.cc:1724] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:32.368314 15303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:40901, user_credentials={real_user=slave}} blocked reactor thread for 161219us
I20260501 14:02:32.377436 15760 tablet.cc:1724] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.381548 15779 tablet.cc:1724] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.393244 15778 tablet.cc:1724] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.402221 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
mode: GRACEFUL
new_leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:38246
I20260501 14:02:32.402981 15334 raft_consensus.cc:606] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Received request to transfer leadership to TS c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:32.418591 15773 tablet.cc:1724] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.444979 15781 tablet.cc:1724] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.416471 15772 tablet.cc:1724] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.425721 15764 tablet.cc:1724] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.467211 15777 tablet.cc:1724] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.435086 15775 tablet.cc:1724] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.479272 15779 tablet.cc:1724] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.480599 15770 tablet.cc:1724] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.485677 15769 tablet.cc:1724] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.498024 15781 tablet.cc:1724] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.504465 15778 tablet.cc:1724] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.510293 15772 tablet.cc:1724] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.517539 15782 tablet.cc:1724] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.519572 15775 tablet.cc:1724] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:32.566726 15413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
mode: GRACEFUL
new_leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:60194
I20260501 14:02:32.567389 15413 raft_consensus.cc:606] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Received request to transfer leadership to TS c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:32.569048  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260501 14:02:32.569788  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:32.579162 15413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b"
dest_uuid: "0c790e8630214fafaaea14dd4823621e"
mode: GRACEFUL
new_leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:60194
I20260501 14:02:32.579732 15413 raft_consensus.cc:606] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Received request to transfer leadership to TS c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:32.582088 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64"
dest_uuid: "bedc021636444be1990fbe2fe8023d78"
mode: GRACEFUL
new_leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:38246
I20260501 14:02:32.582653 15334 raft_consensus.cc:606] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Received request to transfer leadership to TS c41dc0c9feeb455892cb36be03a44dfc
I20260501 14:02:32.584111  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260501 14:02:32.584607  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:32.585489 15235 catalog_manager.cc:6216] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc: soft_deleted_table [id=3d62dc7e883a4444b4fa9fb6f31fc2c1] alter complete (version 1)
I20260501 14:02:32.608959 15730 raft_consensus.cc:993] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: : Instructing follower c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.609609 15731 raft_consensus.cc:1081] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Signalling peer c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.611053 15484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:59126
I20260501 14:02:32.611512 15484 raft_consensus.cc:493] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:32.611774 15484 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:32.618278 15484 raft_consensus.cc:515] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.620062 15484 leader_election.cc:290] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 3 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:32.621011 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:32.621147 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb1f0e3ad04e3ca4215673e98b1b64" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:32.621850 15334 raft_consensus.cc:3055] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:32.622195 15334 raft_consensus.cc:740] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:32.622251 15413 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:32.622962 15334 consensus_queue.cc:260] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.624161 15334 raft_consensus.cc:3060] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:32.629777 15334 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 3.
I20260501 14:02:32.630214 15413 raft_consensus.cc:2468] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 3.
I20260501 14:02:32.630913 15450 leader_election.cc:304] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:32.631975 15752 raft_consensus.cc:2804] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:32.632449 15752 raft_consensus.cc:697] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 3 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:32.633181 15752 consensus_queue.cc:237] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.641328 15235 catalog_manager.cc:5671] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 2 to 3, leader changed from bedc021636444be1990fbe2fe8023d78 (127.6.77.129) to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 3 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:32.808607 15712 raft_consensus.cc:993] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: : Instructing follower c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.809172 15710 raft_consensus.cc:1081] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Signalling peer c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.810602 15484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:59124
I20260501 14:02:32.811093 15484 raft_consensus.cc:493] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:32.811364 15484 raft_consensus.cc:3060] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:32.818105 15484 raft_consensus.cc:515] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.820181 15484 leader_election.cc:290] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:32.820536 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:32.820883 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b06bcf7645241b3b16e7a80baaf825b" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:32.821339 15334 raft_consensus.cc:3060] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:32.821480 15413 raft_consensus.cc:3055] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:32.821898 15413 raft_consensus.cc:740] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:32.822695 15413 consensus_queue.cc:260] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.824034 15413 raft_consensus.cc:3060] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:32.829316 15334 raft_consensus.cc:2468] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:32.830744 15450 leader_election.cc:304] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:32.831523 15752 raft_consensus.cc:2804] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:32.831921 15413 raft_consensus.cc:2468] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:32.832093 15752 raft_consensus.cc:697] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:32.833086 15752 consensus_queue.cc:237] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.841432 15235 catalog_manager.cc:5671] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 1 to 2, leader changed from 0c790e8630214fafaaea14dd4823621e (127.6.77.130) to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 2 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:32.917317 15731 raft_consensus.cc:993] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: : Instructing follower c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.917850 15730 raft_consensus.cc:1081] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Signalling peer c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.919416 15484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:59126
I20260501 14:02:32.920063 15484 raft_consensus.cc:493] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:32.920435 15484 raft_consensus.cc:3060] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:32.927526 15484 raft_consensus.cc:515] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.930063 15484 leader_election.cc:290] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:32.931003 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:32.931912 15334 raft_consensus.cc:3055] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:32.932435 15334 raft_consensus.cc:740] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bedc021636444be1990fbe2fe8023d78, State: Running, Role: LEADER
I20260501 14:02:32.931783 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150e0db689349a4bbfae120cc1587bf" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:32.933255 15413 raft_consensus.cc:3060] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:32.933364 15334 consensus_queue.cc:260] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.935276 15334 raft_consensus.cc:3060] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:32.941395 15413 raft_consensus.cc:2468] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:32.942701 15451 leader_election.cc:304] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c790e8630214fafaaea14dd4823621e, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:32.942895 15334 raft_consensus.cc:2468] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 2.
I20260501 14:02:32.943599 15752 raft_consensus.cc:2804] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:32.944532 15752 raft_consensus.cc:697] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:32.945389 15752 consensus_queue.cc:237] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.946916 15712 raft_consensus.cc:993] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: : Instructing follower c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.947436 15710 raft_consensus.cc:1081] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Signalling peer c41dc0c9feeb455892cb36be03a44dfc to start an election
I20260501 14:02:32.949306 15482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e"
dest_uuid: "c41dc0c9feeb455892cb36be03a44dfc"
 from {username='slave'} at 127.0.0.1:59124
I20260501 14:02:32.949828 15482 raft_consensus.cc:493] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:32.950162 15482 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:32.953966 15235 catalog_manager.cc:5671] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 1 to 2, leader changed from bedc021636444be1990fbe2fe8023d78 (127.6.77.129) to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 2 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:32.957615 15482 raft_consensus.cc:515] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.960932 15482 leader_election.cc:290] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 3 election: Requested vote from peers bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701), 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319)
I20260501 14:02:32.961578 15413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0c790e8630214fafaaea14dd4823621e"
I20260501 14:02:32.964603 15413 raft_consensus.cc:3055] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:32.964500 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a709c55fc6b42259ee7295bf61c100e" candidate_uuid: "c41dc0c9feeb455892cb36be03a44dfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "bedc021636444be1990fbe2fe8023d78"
I20260501 14:02:32.965157 15413 raft_consensus.cc:740] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c790e8630214fafaaea14dd4823621e, State: Running, Role: LEADER
I20260501 14:02:32.965488 15334 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:32.966058 15413 consensus_queue.cc:260] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.968784 15413 raft_consensus.cc:3060] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:32.972695 15334 raft_consensus.cc:2468] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 3.
I20260501 14:02:32.973747 15450 leader_election.cc:304] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bedc021636444be1990fbe2fe8023d78, c41dc0c9feeb455892cb36be03a44dfc; no voters: 
I20260501 14:02:32.974491 15413 raft_consensus.cc:2468] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41dc0c9feeb455892cb36be03a44dfc in term 3.
I20260501 14:02:32.974565 15752 raft_consensus.cc:2804] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:32.975248 15752 raft_consensus.cc:697] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 3 LEADER]: Becoming Leader. State: Replica: c41dc0c9feeb455892cb36be03a44dfc, State: Running, Role: LEADER
I20260501 14:02:32.976233 15752 consensus_queue.cc:237] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } }
I20260501 14:02:32.987071 15235 catalog_manager.cc:5671] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc reported cstate change: term changed from 2 to 3, leader changed from 0c790e8630214fafaaea14dd4823621e (127.6.77.130) to c41dc0c9feeb455892cb36be03a44dfc (127.6.77.131). New cstate: current_term: 3 leader_uuid: "c41dc0c9feeb455892cb36be03a44dfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41dc0c9feeb455892cb36be03a44dfc" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 40901 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:33.085801 15413 raft_consensus.cc:1275] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:33.087050 15752 consensus_queue.cc:1048] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:33.102283 15334 raft_consensus.cc:1275] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260501 14:02:33.103989 15709 consensus_queue.cc:1048] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:33.232466 15334 raft_consensus.cc:1275] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:33.233711 15709 consensus_queue.cc:1048] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:33.242998 15413 raft_consensus.cc:1275] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:33.245224 15709 consensus_queue.cc:1048] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:33.360293 15334 raft_consensus.cc:1275] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 14:02:33.361667 15709 consensus_queue.cc:1048] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:33.370357 15413 raft_consensus.cc:1275] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260501 14:02:33.372037 15709 consensus_queue.cc:1048] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260501 14:02:33.479745 15334 raft_consensus.cc:1275] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260501 14:02:33.483628 15709 consensus_queue.cc:1048] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedc021636444be1990fbe2fe8023d78" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 14:02:33.501237 15413 raft_consensus.cc:1275] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Refusing update from remote peer c41dc0c9feeb455892cb36be03a44dfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260501 14:02:33.503672 15752 consensus_queue.cc:1048] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c790e8630214fafaaea14dd4823621e" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260501 14:02:33.586035  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:33.594452  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:33.595048  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:33.602387  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:33.602849  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:34.604143  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:34.610301  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:34.610800  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:34.616003  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:34.616442  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:35.617666  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:35.622936  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:35.623391  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:35.628309  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:35.628697  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:36.629788  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:36.635406  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:36.635991  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:36.640826  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:36.641304  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:37.642438  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:37.647745  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:37.648268  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:37.653198  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:37.653729  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:38.654836  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:38.660228  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:38.660773  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:38.666483  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:38.667095  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:39.668373  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:39.673910  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:39.674646  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:39.680899  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:39.681457  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:40.682536  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:40.689101  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:40.689769  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:40.696955  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:40.697431  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:41.698678  6454 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260501 14:02:41.704264  6454 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260501 14:02:41.704777  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:41.709537  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:41.710023  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:42.770116  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
W20260501 14:02:42.815349 15376 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 130 similar messages]
W20260501 14:02:42.820179 15376 consensus_peers.cc:597] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:42.822290  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:42.823299  6454 tablet_replica.cc:333] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.824481  6454 raft_consensus.cc:2243] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.825230  6454 raft_consensus.cc:2272] T a18b4cb871ab4e7a9dfdff80d9df897a P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.828464  6454 tablet_replica.cc:333] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.829136  6454 raft_consensus.cc:2243] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.829792  6454 raft_consensus.cc:2272] T 6a709c55fc6b42259ee7295bf61c100e P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.832907  6454 tablet_replica.cc:333] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.833792  6454 raft_consensus.cc:2243] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.834512  6454 raft_consensus.cc:2272] T 5fe16bfdcc45451ab595f5f94bd2da6f P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.837486  6454 tablet_replica.cc:333] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.838251  6454 raft_consensus.cc:2243] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.838833  6454 raft_consensus.cc:2272] T 5150e0db689349a4bbfae120cc1587bf P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.842662  6454 tablet_replica.cc:333] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.843540  6454 raft_consensus.cc:2243] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260501 14:02:42.843883 15376 consensus_peers.cc:597] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:42.844499  6454 raft_consensus.cc:2272] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.847499  6454 tablet_replica.cc:333] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.848409  6454 raft_consensus.cc:2243] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:42.849673  6454 raft_consensus.cc:2272] T ad2f80541aad4cedb10b5d182b5a7fbb P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:42.851615 15376 consensus_peers.cc:597] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:42.853005  6454 tablet_replica.cc:333] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.853732  6454 raft_consensus.cc:2243] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:42.854640  6454 raft_consensus.cc:2272] T 40816aa05f3041e4abdba6f3b66aa265 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.857620  6454 tablet_replica.cc:333] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.858495  6454 raft_consensus.cc:2243] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:42.859596  6454 raft_consensus.cc:2272] T 485c6172c22c4593a5f3fb0c65ebcc16 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.862416  6454 tablet_replica.cc:333] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.863075  6454 raft_consensus.cc:2243] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.863659  6454 raft_consensus.cc:2272] T 4266bc93eb4e4b52935a762d48ecc6f9 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.866510  6454 tablet_replica.cc:333] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.867146  6454 raft_consensus.cc:2243] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.867672  6454 raft_consensus.cc:2272] T 4b06bcf7645241b3b16e7a80baaf825b P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.870641  6454 tablet_replica.cc:333] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.871292  6454 raft_consensus.cc:2243] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.871873  6454 raft_consensus.cc:2272] T a77df37953a147ca95ff18f00e7ae1c3 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.874661  6454 tablet_replica.cc:333] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.875370  6454 raft_consensus.cc:2243] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.875970  6454 raft_consensus.cc:2272] T cbc4ab70badb46419deb6510bcbff523 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.878497  6454 tablet_replica.cc:333] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.879217  6454 raft_consensus.cc:2243] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.879746  6454 raft_consensus.cc:2272] T 634b7213f4b849d99a127b1ae6c25af5 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.883359  6454 tablet_replica.cc:333] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.884451  6454 raft_consensus.cc:2243] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.885207  6454 raft_consensus.cc:2272] T 15f6de6c6d15404fb0e1317cc567ab80 P bedc021636444be1990fbe2fe8023d78 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:42.886400 15450 consensus_peers.cc:597] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:42.888439  6454 tablet_replica.cc:333] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.889147  6454 raft_consensus.cc:2243] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:42.889654  6454 raft_consensus.cc:2272] T 4beb1f0e3ad04e3ca4215673e98b1b64 P bedc021636444be1990fbe2fe8023d78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.892189  6454 tablet_replica.cc:333] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.892699  6454 raft_consensus.cc:2243] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:42.893802  6454 raft_consensus.cc:2272] T 6414c162a72646f3baa93e3bd88618c2 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.896759  6454 tablet_replica.cc:333] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.897253  6454 raft_consensus.cc:2243] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:42.898201  6454 raft_consensus.cc:2272] T 3ebe8edc59ef4f19802210e6702a9c82 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.900796  6454 tablet_replica.cc:333] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78: stopping tablet replica
I20260501 14:02:42.901302  6454 raft_consensus.cc:2243] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:42.902259  6454 raft_consensus.cc:2272] T 41f096d988b64be3bb923f38a5945642 P bedc021636444be1990fbe2fe8023d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:42.953891  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
W20260501 14:02:42.957437 15450 consensus_peers.cc:597] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:42.986644 15450 consensus_peers.cc:597] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:43.010205  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
W20260501 14:02:43.018162 15451 consensus_peers.cc:597] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc -> Peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Couldn't send request to peer 0c790e8630214fafaaea14dd4823621e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:43.026187 15450 consensus_peers.cc:597] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:43.052973  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:43.053952  6454 tablet_replica.cc:333] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.054896  6454 raft_consensus.cc:2243] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.055578  6454 raft_consensus.cc:2272] T 6a709c55fc6b42259ee7295bf61c100e P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.058481  6454 tablet_replica.cc:333] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.059108  6454 raft_consensus.cc:2243] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.059633  6454 raft_consensus.cc:2272] T a18b4cb871ab4e7a9dfdff80d9df897a P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.062207  6454 tablet_replica.cc:333] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.062839  6454 raft_consensus.cc:2243] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.063319  6454 raft_consensus.cc:2272] T ad2f80541aad4cedb10b5d182b5a7fbb P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.065809  6454 tablet_replica.cc:333] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.066435  6454 raft_consensus.cc:2243] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.067387  6454 raft_consensus.cc:2272] T 5fe16bfdcc45451ab595f5f94bd2da6f P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.070019  6454 tablet_replica.cc:333] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.070742  6454 raft_consensus.cc:2243] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.071244  6454 raft_consensus.cc:2272] T 485c6172c22c4593a5f3fb0c65ebcc16 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.073559  6454 tablet_replica.cc:333] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.074260  6454 raft_consensus.cc:2243] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.074769  6454 raft_consensus.cc:2272] T 40816aa05f3041e4abdba6f3b66aa265 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.077416  6454 tablet_replica.cc:333] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.078018  6454 raft_consensus.cc:2243] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.078599  6454 raft_consensus.cc:2272] T 4b06bcf7645241b3b16e7a80baaf825b P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.081056  6454 tablet_replica.cc:333] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.081578  6454 raft_consensus.cc:2243] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.082038  6454 raft_consensus.cc:2272] T 4266bc93eb4e4b52935a762d48ecc6f9 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.084451  6454 tablet_replica.cc:333] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.084956  6454 raft_consensus.cc:2243] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.085856  6454 raft_consensus.cc:2272] T 634b7213f4b849d99a127b1ae6c25af5 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.088299  6454 tablet_replica.cc:333] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.088806  6454 raft_consensus.cc:2243] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.089691  6454 raft_consensus.cc:2272] T 15f6de6c6d15404fb0e1317cc567ab80 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.092092  6454 tablet_replica.cc:333] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.092770  6454 raft_consensus.cc:2243] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.093240  6454 raft_consensus.cc:2272] T 4beb1f0e3ad04e3ca4215673e98b1b64 P 0c790e8630214fafaaea14dd4823621e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.095770  6454 tablet_replica.cc:333] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.096542  6454 raft_consensus.cc:2243] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.097414  6454 raft_consensus.cc:2272] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.099953  6454 tablet_replica.cc:333] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.100479  6454 raft_consensus.cc:2243] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.100936  6454 raft_consensus.cc:2272] T 5150e0db689349a4bbfae120cc1587bf P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.103225  6454 tablet_replica.cc:333] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.103711  6454 raft_consensus.cc:2243] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.104697  6454 raft_consensus.cc:2272] T cbc4ab70badb46419deb6510bcbff523 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.106949  6454 tablet_replica.cc:333] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.107456  6454 raft_consensus.cc:2243] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.108459  6454 raft_consensus.cc:2272] T a77df37953a147ca95ff18f00e7ae1c3 P 0c790e8630214fafaaea14dd4823621e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.110620  6454 tablet_replica.cc:333] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.111090  6454 raft_consensus.cc:2243] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.111488  6454 raft_consensus.cc:2272] T 6414c162a72646f3baa93e3bd88618c2 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.113806  6454 tablet_replica.cc:333] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.114275  6454 raft_consensus.cc:2243] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.114701  6454 raft_consensus.cc:2272] T 3ebe8edc59ef4f19802210e6702a9c82 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.116950  6454 tablet_replica.cc:333] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e: stopping tablet replica
I20260501 14:02:43.117460  6454 raft_consensus.cc:2243] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.117871  6454 raft_consensus.cc:2272] T 41f096d988b64be3bb923f38a5945642 P 0c790e8630214fafaaea14dd4823621e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260501 14:02:43.146384 15450 consensus_peers.cc:597] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:43.166173  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
I20260501 14:02:43.211946  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
W20260501 14:02:43.243022 15451 consensus_peers.cc:597] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc -> Peer 0c790e8630214fafaaea14dd4823621e (127.6.77.130:37319): Couldn't send request to peer 0c790e8630214fafaaea14dd4823621e. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:37319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:02:43.243322 15450 consensus_peers.cc:597] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc -> Peer bedc021636444be1990fbe2fe8023d78 (127.6.77.129:37701): Couldn't send request to peer bedc021636444be1990fbe2fe8023d78. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:37701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:02:43.256510  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:02:43.257402  6454 tablet_replica.cc:333] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.258255  6454 raft_consensus.cc:2243] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.258908  6454 raft_consensus.cc:2272] T 5fe16bfdcc45451ab595f5f94bd2da6f P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.261546  6454 tablet_replica.cc:333] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.262281  6454 raft_consensus.cc:2243] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.262781  6454 raft_consensus.cc:2272] T 8dc53951ef3f4a8aa7f238f8ea0bcb5c P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.265125  6454 tablet_replica.cc:333] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.265684  6454 raft_consensus.cc:2243] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.266561  6454 raft_consensus.cc:2272] T 5150e0db689349a4bbfae120cc1587bf P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.268957  6454 tablet_replica.cc:333] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.269579  6454 raft_consensus.cc:2243] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.270042  6454 raft_consensus.cc:2272] T ad2f80541aad4cedb10b5d182b5a7fbb P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.272316  6454 tablet_replica.cc:333] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.272852  6454 raft_consensus.cc:2243] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.273315  6454 raft_consensus.cc:2272] T 485c6172c22c4593a5f3fb0c65ebcc16 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.275648  6454 tablet_replica.cc:333] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.276250  6454 raft_consensus.cc:2243] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.276710  6454 raft_consensus.cc:2272] T 40816aa05f3041e4abdba6f3b66aa265 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.278801  6454 tablet_replica.cc:333] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.279318  6454 raft_consensus.cc:2243] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.280362  6454 raft_consensus.cc:2272] T a18b4cb871ab4e7a9dfdff80d9df897a P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.282657  6454 tablet_replica.cc:333] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.283185  6454 raft_consensus.cc:2243] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.283613  6454 raft_consensus.cc:2272] T 41f096d988b64be3bb923f38a5945642 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.285996  6454 tablet_replica.cc:333] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.286474  6454 raft_consensus.cc:2243] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.287307  6454 raft_consensus.cc:2272] T 4266bc93eb4e4b52935a762d48ecc6f9 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.289819  6454 tablet_replica.cc:333] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.290391  6454 raft_consensus.cc:2243] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.291254  6454 raft_consensus.cc:2272] T 4b06bcf7645241b3b16e7a80baaf825b P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.294109  6454 tablet_replica.cc:333] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.295120  6454 raft_consensus.cc:2243] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.295921  6454 raft_consensus.cc:2272] T 6a709c55fc6b42259ee7295bf61c100e P c41dc0c9feeb455892cb36be03a44dfc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.298192  6454 tablet_replica.cc:333] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.298820  6454 raft_consensus.cc:2243] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.299291  6454 raft_consensus.cc:2272] T 3ebe8edc59ef4f19802210e6702a9c82 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.301688  6454 tablet_replica.cc:333] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.302331  6454 raft_consensus.cc:2243] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.302803  6454 raft_consensus.cc:2272] T 6414c162a72646f3baa93e3bd88618c2 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.305130  6454 tablet_replica.cc:333] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.305668  6454 raft_consensus.cc:2243] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.306186  6454 raft_consensus.cc:2272] T a77df37953a147ca95ff18f00e7ae1c3 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.308415  6454 tablet_replica.cc:333] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.308941  6454 raft_consensus.cc:2243] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.309398  6454 raft_consensus.cc:2272] T cbc4ab70badb46419deb6510bcbff523 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.311585  6454 tablet_replica.cc:333] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.312208  6454 raft_consensus.cc:2243] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.312760  6454 raft_consensus.cc:2272] T 15f6de6c6d15404fb0e1317cc567ab80 P c41dc0c9feeb455892cb36be03a44dfc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.314862  6454 tablet_replica.cc:333] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.315351  6454 raft_consensus.cc:2243] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.316293  6454 raft_consensus.cc:2272] T 4beb1f0e3ad04e3ca4215673e98b1b64 P c41dc0c9feeb455892cb36be03a44dfc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.318583  6454 tablet_replica.cc:333] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc: stopping tablet replica
I20260501 14:02:43.319278  6454 raft_consensus.cc:2243] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:02:43.320101  6454 raft_consensus.cc:2272] T 634b7213f4b849d99a127b1ae6c25af5 P c41dc0c9feeb455892cb36be03a44dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.365898  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 14:02:43.410681  6454 master.cc:562] Master@127.6.77.190:35697 shutting down...
I20260501 14:02:43.437491  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:02:43.438235  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:02:43.438606  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P bacfc0b980524390afbebf16f2a2c3bc: stopping tablet replica
I20260501 14:02:43.471540  6454 master.cc:584] Master@127.6.77.190:35697 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21224 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260501 14:02:43.552728  6454 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.77.190:45679
I20260501 14:02:43.554196  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:43.561121 15824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:43.561381 15825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:43.562453  6454 server_base.cc:1061] running on GCE node
W20260501 14:02:43.562496 15827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:43.563627  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:43.564319  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:43.564492  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644163564470 us; error 0 us; skew 500 ppm
I20260501 14:02:43.565058  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:43.567894  6454 webserver.cc:492] Webserver started at http://127.6.77.190:37839/ using document root <none> and password file <none>
I20260501 14:02:43.568403  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:43.568608  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:43.568889  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:43.570263  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/master-0-root/instance:
uuid: "ff98535708514e6eb92baf205ae7015c"
format_stamp: "Formatted at 2026-05-01 14:02:43 on dist-test-slave-1sft"
I20260501 14:02:43.575047  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260501 14:02:43.578965 15832 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:43.579968  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260501 14:02:43.580232  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/master-0-root
uuid: "ff98535708514e6eb92baf205ae7015c"
format_stamp: "Formatted at 2026-05-01 14:02:43 on dist-test-slave-1sft"
I20260501 14:02:43.580483  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:43.593488  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:43.594856  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:43.640100  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.190:45679
I20260501 14:02:43.640237 15883 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.190:45679 every 8 connection(s)
I20260501 14:02:43.644970 15884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:43.661039 15884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c: Bootstrap starting.
I20260501 14:02:43.666756 15884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:43.671694 15884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c: No bootstrap required, opened a new log
I20260501 14:02:43.674342 15884 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff98535708514e6eb92baf205ae7015c" member_type: VOTER }
I20260501 14:02:43.674849 15884 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:43.675026 15884 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff98535708514e6eb92baf205ae7015c, State: Initialized, Role: FOLLOWER
I20260501 14:02:43.675689 15884 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff98535708514e6eb92baf205ae7015c" member_type: VOTER }
I20260501 14:02:43.676187 15884 raft_consensus.cc:399] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260501 14:02:43.676381 15884 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260501 14:02:43.676602 15884 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:43.682498 15884 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff98535708514e6eb92baf205ae7015c" member_type: VOTER }
I20260501 14:02:43.683001 15884 leader_election.cc:304] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff98535708514e6eb92baf205ae7015c; no voters: 
I20260501 14:02:43.684294 15884 leader_election.cc:290] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260501 14:02:43.684790 15887 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:43.686328 15887 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 1 LEADER]: Becoming Leader. State: Replica: ff98535708514e6eb92baf205ae7015c, State: Running, Role: LEADER
I20260501 14:02:43.687085 15887 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff98535708514e6eb92baf205ae7015c" member_type: VOTER }
I20260501 14:02:43.687515 15884 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [sys.catalog]: configured and running, proceeding with master startup.
I20260501 14:02:43.694175 15889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff98535708514e6eb92baf205ae7015c. Latest consensus state: current_term: 1 leader_uuid: "ff98535708514e6eb92baf205ae7015c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff98535708514e6eb92baf205ae7015c" member_type: VOTER } }
I20260501 14:02:43.694175 15888 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff98535708514e6eb92baf205ae7015c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff98535708514e6eb92baf205ae7015c" member_type: VOTER } }
I20260501 14:02:43.695122 15889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [sys.catalog]: This master's current role is: LEADER
I20260501 14:02:43.695374 15888 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [sys.catalog]: This master's current role is: LEADER
I20260501 14:02:43.702710 15895 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260501 14:02:43.711058 15895 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260501 14:02:43.712329  6454 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260501 14:02:43.721516 15895 catalog_manager.cc:1357] Generated new cluster ID: 129baa03ccda4009a2e23d1353c8ebdb
I20260501 14:02:43.721880 15895 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260501 14:02:43.746603 15895 catalog_manager.cc:1380] Generated new certificate authority record
I20260501 14:02:43.748237 15895 catalog_manager.cc:1514] Loading token signing keys...
I20260501 14:02:43.765851 15895 catalog_manager.cc:6044] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c: Generated new TSK 0
I20260501 14:02:43.766599 15895 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260501 14:02:43.779382  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:43.787142 15905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:43.788524 15906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:43.791000  6454 server_base.cc:1061] running on GCE node
W20260501 14:02:43.791051 15908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:43.792383  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:43.792590  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:43.792807  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644163792769 us; error 0 us; skew 500 ppm
I20260501 14:02:43.793442  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:43.796275  6454 webserver.cc:492] Webserver started at http://127.6.77.129:36807/ using document root <none> and password file <none>
I20260501 14:02:43.796829  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:43.797029  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:43.797382  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:43.798894  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-0-root/instance:
uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
format_stamp: "Formatted at 2026-05-01 14:02:43 on dist-test-slave-1sft"
I20260501 14:02:43.804248  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.007s
I20260501 14:02:43.808046 15913 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:43.808864  6454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260501 14:02:43.809197  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-0-root
uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
format_stamp: "Formatted at 2026-05-01 14:02:43 on dist-test-slave-1sft"
I20260501 14:02:43.809518  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:43.825243  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:43.826756  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:43.828543  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:43.831207  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:02:43.831459  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:43.831717  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:02:43.831983  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260501 14:02:43.880128  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.129:32975
I20260501 14:02:43.880242 15975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.129:32975 every 8 connection(s)
I20260501 14:02:43.886399  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:43.895093 15980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:43.897418 15981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:43.898633 15983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:43.899670  6454 server_base.cc:1061] running on GCE node
I20260501 14:02:43.900986  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:43.901304  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:43.901547  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644163901526 us; error 0 us; skew 500 ppm
I20260501 14:02:43.902400  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:43.904878 15976 heartbeater.cc:344] Connected to a master server at 127.6.77.190:45679
I20260501 14:02:43.905391 15976 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:43.905634  6454 webserver.cc:492] Webserver started at http://127.6.77.130:38157/ using document root <none> and password file <none>
I20260501 14:02:43.906458  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:43.906484 15976 heartbeater.cc:507] Master 127.6.77.190:45679 requested a full tablet report, sending...
I20260501 14:02:43.906796  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:43.907215  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:43.909065  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-1-root/instance:
uuid: "f24495935b14436a8723aba380b53867"
format_stamp: "Formatted at 2026-05-01 14:02:43 on dist-test-slave-1sft"
I20260501 14:02:43.909446 15849 ts_manager.cc:194] Registered new tserver with Master: ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975)
I20260501 14:02:43.912493 15849 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50080
I20260501 14:02:43.916021  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260501 14:02:43.920499 15988 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:43.921568  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260501 14:02:43.921891  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-1-root
uuid: "f24495935b14436a8723aba380b53867"
format_stamp: "Formatted at 2026-05-01 14:02:43 on dist-test-slave-1sft"
I20260501 14:02:43.922179  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:43.955159  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:43.956615  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:43.958231  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:43.960680  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:02:43.960898  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:43.961172  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:02:43.961310  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:44.012320  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.130:35671
I20260501 14:02:44.012454 16050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.130:35671 every 8 connection(s)
I20260501 14:02:44.017994  6454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260501 14:02:44.028955 16054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260501 14:02:44.030341 16055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:44.033804 16051 heartbeater.cc:344] Connected to a master server at 127.6.77.190:45679
I20260501 14:02:44.034610 16051 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:44.036103 16051 heartbeater.cc:507] Master 127.6.77.190:45679 requested a full tablet report, sending...
W20260501 14:02:44.037655 16057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260501 14:02:44.038434  6454 server_base.cc:1061] running on GCE node
I20260501 14:02:44.039021 15849 ts_manager.cc:194] Registered new tserver with Master: f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:44.039609  6454 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260501 14:02:44.039947  6454 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260501 14:02:44.040144  6454 hybrid_clock.cc:648] HybridClock initialized: now 1777644164040120 us; error 0 us; skew 500 ppm
I20260501 14:02:44.040838  6454 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260501 14:02:44.040863 15849 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50084
I20260501 14:02:44.044250  6454 webserver.cc:492] Webserver started at http://127.6.77.131:46193/ using document root <none> and password file <none>
I20260501 14:02:44.044902  6454 fs_manager.cc:362] Metadata directory not provided
I20260501 14:02:44.045128  6454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260501 14:02:44.045418  6454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260501 14:02:44.046873  6454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-2-root/instance:
uuid: "32b967e5364e4b218958697890d199d9"
format_stamp: "Formatted at 2026-05-01 14:02:44 on dist-test-slave-1sft"
I20260501 14:02:44.052114  6454 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260501 14:02:44.056197 16062 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:44.057178  6454 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260501 14:02:44.057554  6454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-2-root
uuid: "32b967e5364e4b218958697890d199d9"
format_stamp: "Formatted at 2026-05-01 14:02:44 on dist-test-slave-1sft"
I20260501 14:02:44.057933  6454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWWnjmf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1777643835062054-6454-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260501 14:02:44.073372  6454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260501 14:02:44.074764  6454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260501 14:02:44.076570  6454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260501 14:02:44.079227  6454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260501 14:02:44.079470  6454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260501 14:02:44.079725  6454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260501 14:02:44.079964  6454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260501 14:02:44.129177  6454 rpc_server.cc:307] RPC server started. Bound to: 127.6.77.131:35255
I20260501 14:02:44.129297 16124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.77.131:35255 every 8 connection(s)
I20260501 14:02:44.145910 16125 heartbeater.cc:344] Connected to a master server at 127.6.77.190:45679
I20260501 14:02:44.146492 16125 heartbeater.cc:461] Registering TS with master...
I20260501 14:02:44.147485 16125 heartbeater.cc:507] Master 127.6.77.190:45679 requested a full tablet report, sending...
I20260501 14:02:44.149737 15849 ts_manager.cc:194] Registered new tserver with Master: 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.150414  6454 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017549884s
I20260501 14:02:44.151765 15849 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50092
I20260501 14:02:44.182168 15849 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50098:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 14:02:44.185405 15849 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260501 14:02:44.277335 16090 tablet_service.cc:1511] Processing CreateTablet for tablet c4e892eac359422db5beea872f9f3823 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:44.278566 16088 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0fbc22f9264d4e9cc3daa8e5d5fdcf (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:44.279193 16090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e892eac359422db5beea872f9f3823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.280253 16088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0fbc22f9264d4e9cc3daa8e5d5fdcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.281658 16089 tablet_service.cc:1511] Processing CreateTablet for tablet 768a1078f82544009cd31d473dd93dd3 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:44.283233 16089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768a1078f82544009cd31d473dd93dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.288789 16087 tablet_service.cc:1511] Processing CreateTablet for tablet 34e803d8e72440a3ae5abe977157ea3d (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:44.290606 16087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e803d8e72440a3ae5abe977157ea3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.299721 16013 tablet_service.cc:1511] Processing CreateTablet for tablet 34e803d8e72440a3ae5abe977157ea3d (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:44.301383 16013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e803d8e72440a3ae5abe977157ea3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.303592 16009 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5e625e7d764028a83aa151a0e6ad1b (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:44.292255 16016 tablet_service.cc:1511] Processing CreateTablet for tablet c4e892eac359422db5beea872f9f3823 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:44.305135 16009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5e625e7d764028a83aa151a0e6ad1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.305836 16016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e892eac359422db5beea872f9f3823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.292644 16012 tablet_service.cc:1511] Processing CreateTablet for tablet a3e51dd7499d46568dcd081266ea72ca (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:44.294391 16015 tablet_service.cc:1511] Processing CreateTablet for tablet 768a1078f82544009cd31d473dd93dd3 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:44.294797 16011 tablet_service.cc:1511] Processing CreateTablet for tablet 97c45da8661b45918be6cc5782a29636 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:44.296532 16014 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0fbc22f9264d4e9cc3daa8e5d5fdcf (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:44.297821 16010 tablet_service.cc:1511] Processing CreateTablet for tablet 63c3b3ddeded4aaaa0ae6ab6092e969b (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:44.308326 16012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e51dd7499d46568dcd081266ea72ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.309957 16008 tablet_service.cc:1511] Processing CreateTablet for tablet c9ad56305ce44a4e9bcab985d3ab6b20 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:44.311753 16015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768a1078f82544009cd31d473dd93dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.315101 16011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c45da8661b45918be6cc5782a29636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.320194 16014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0fbc22f9264d4e9cc3daa8e5d5fdcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.321504 16010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c3b3ddeded4aaaa0ae6ab6092e969b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.322837 16008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ad56305ce44a4e9bcab985d3ab6b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.328033 16086 tablet_service.cc:1511] Processing CreateTablet for tablet a3e51dd7499d46568dcd081266ea72ca (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:44.329778 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e51dd7499d46568dcd081266ea72ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.341529 16085 tablet_service.cc:1511] Processing CreateTablet for tablet 97c45da8661b45918be6cc5782a29636 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:44.343804 16085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c45da8661b45918be6cc5782a29636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.345505 16084 tablet_service.cc:1511] Processing CreateTablet for tablet 63c3b3ddeded4aaaa0ae6ab6092e969b (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:44.350128 16084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c3b3ddeded4aaaa0ae6ab6092e969b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.352635 16082 tablet_service.cc:1511] Processing CreateTablet for tablet c9ad56305ce44a4e9bcab985d3ab6b20 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:44.354624 16082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ad56305ce44a4e9bcab985d3ab6b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.347114 16083 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5e625e7d764028a83aa151a0e6ad1b (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:44.357918 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5e625e7d764028a83aa151a0e6ad1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.379681 15937 tablet_service.cc:1511] Processing CreateTablet for tablet a3e51dd7499d46568dcd081266ea72ca (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:44.390683 15937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e51dd7499d46568dcd081266ea72ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.381155 15936 tablet_service.cc:1511] Processing CreateTablet for tablet 97c45da8661b45918be6cc5782a29636 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:44.394042 15936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c45da8661b45918be6cc5782a29636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.382464 15935 tablet_service.cc:1511] Processing CreateTablet for tablet 63c3b3ddeded4aaaa0ae6ab6092e969b (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:44.397097 15935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c3b3ddeded4aaaa0ae6ab6092e969b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.382464 15940 tablet_service.cc:1511] Processing CreateTablet for tablet 768a1078f82544009cd31d473dd93dd3 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:44.399938 15940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768a1078f82544009cd31d473dd93dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.383716 15934 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5e625e7d764028a83aa151a0e6ad1b (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:44.403017 15934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5e625e7d764028a83aa151a0e6ad1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.383720 15939 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0fbc22f9264d4e9cc3daa8e5d5fdcf (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:44.405637 15939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0fbc22f9264d4e9cc3daa8e5d5fdcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.384987 15938 tablet_service.cc:1511] Processing CreateTablet for tablet 34e803d8e72440a3ae5abe977157ea3d (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:44.408480 15938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e803d8e72440a3ae5abe977157ea3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.386761 15933 tablet_service.cc:1511] Processing CreateTablet for tablet c9ad56305ce44a4e9bcab985d3ab6b20 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:44.411415 15933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ad56305ce44a4e9bcab985d3ab6b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.381156 15941 tablet_service.cc:1511] Processing CreateTablet for tablet c4e892eac359422db5beea872f9f3823 (DEFAULT_TABLE table=test-workload [id=a38b0b608d1248a080fe1c16c315ca8a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:44.414121 15941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e892eac359422db5beea872f9f3823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:44.509131 16140 tablet_bootstrap.cc:492] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.512866 16141 tablet_bootstrap.cc:492] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.526031 16141 tablet_bootstrap.cc:654] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.544451 16142 tablet_bootstrap.cc:492] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.562150 16140 tablet_bootstrap.cc:654] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.568040 16141 tablet_bootstrap.cc:492] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:44.568693 16141 ts_tablet_manager.cc:1403] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.019s
I20260501 14:02:44.571867 16142 tablet_bootstrap.cc:654] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.572274 16141 raft_consensus.cc:359] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.573264 16141 raft_consensus.cc:385] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.573372 16140 tablet_bootstrap.cc:492] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:44.573652 16141 raft_consensus.cc:740] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.574045 16140 ts_tablet_manager.cc:1403] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.005s
I20260501 14:02:44.574594 16141 consensus_queue.cc:260] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.577086 16140 raft_consensus.cc:359] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.577690 16140 raft_consensus.cc:385] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.577945 16140 raft_consensus.cc:740] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.578591 16142 tablet_bootstrap.cc:492] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.578605 16140 consensus_queue.cc:260] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.579416 16142 ts_tablet_manager.cc:1403] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.005s
I20260501 14:02:44.581099 16125 heartbeater.cc:499] Master 127.6.77.190:45679 was elected leader, sending a full tablet report...
I20260501 14:02:44.582914 16142 raft_consensus.cc:359] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.583714 16142 raft_consensus.cc:385] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.584054 16142 raft_consensus.cc:740] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.584826 16142 consensus_queue.cc:260] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.586403 16141 ts_tablet_manager.cc:1434] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260501 14:02:44.587749 16051 heartbeater.cc:499] Master 127.6.77.190:45679 was elected leader, sending a full tablet report...
I20260501 14:02:44.588901 16140 ts_tablet_manager.cc:1434] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.006s
I20260501 14:02:44.590158 16140 tablet_bootstrap.cc:492] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.593744 16141 tablet_bootstrap.cc:492] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.593946 15976 heartbeater.cc:499] Master 127.6.77.190:45679 was elected leader, sending a full tablet report...
I20260501 14:02:44.594702 16142 ts_tablet_manager.cc:1434] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.005s
I20260501 14:02:44.595917 16142 tablet_bootstrap.cc:492] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.597939 16140 tablet_bootstrap.cc:654] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.602260 16141 tablet_bootstrap.cc:654] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.604429 16142 tablet_bootstrap.cc:654] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.610559 16140 tablet_bootstrap.cc:492] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:44.611135 16140 ts_tablet_manager.cc:1403] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260501 14:02:44.615355 16141 tablet_bootstrap.cc:492] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:44.615047 16140 raft_consensus.cc:359] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.615931 16140 raft_consensus.cc:385] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.615989 16141 ts_tablet_manager.cc:1403] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.009s
I20260501 14:02:44.616389 16140 raft_consensus.cc:740] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.617288 16142 tablet_bootstrap.cc:492] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.617871 16142 ts_tablet_manager.cc:1403] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260501 14:02:44.617411 16140 consensus_queue.cc:260] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.619738 16141 raft_consensus.cc:359] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.620368 16140 ts_tablet_manager.cc:1434] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260501 14:02:44.620599 16141 raft_consensus.cc:385] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.621004 16141 raft_consensus.cc:740] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.621592 16140 tablet_bootstrap.cc:492] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.621227 16142 raft_consensus.cc:359] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.622154 16142 raft_consensus.cc:385] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.622524 16142 raft_consensus.cc:740] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.622009 16141 consensus_queue.cc:260] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.623725 16147 raft_consensus.cc:493] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:44.623421 16142 consensus_queue.cc:260] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.624703 16141 ts_tablet_manager.cc:1434] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:02:44.624351 16147 raft_consensus.cc:515] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.625887 16141 tablet_bootstrap.cc:492] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.626639 16142 ts_tablet_manager.cc:1434] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260501 14:02:44.627758 16142 tablet_bootstrap.cc:492] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.630477 16147 leader_election.cc:290] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.634560 16141 tablet_bootstrap.cc:654] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.634974 16142 tablet_bootstrap.cc:654] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.650920 16141 tablet_bootstrap.cc:492] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:44.650923 16142 tablet_bootstrap.cc:492] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.651698 16142 ts_tablet_manager.cc:1403] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260501 14:02:44.651719 16141 ts_tablet_manager.cc:1403] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260501 14:02:44.653884 16140 tablet_bootstrap.cc:654] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.655614 16141 raft_consensus.cc:359] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.655752 16142 raft_consensus.cc:359] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.656618 16141 raft_consensus.cc:385] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.656667 16142 raft_consensus.cc:385] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.657068 16141 raft_consensus.cc:740] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.657100 16142 raft_consensus.cc:740] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.658166 16142 consensus_queue.cc:260] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.658166 16141 consensus_queue.cc:260] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.660878 16141 ts_tablet_manager.cc:1434] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 14:02:44.661057 16142 ts_tablet_manager.cc:1434] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:02:44.661986 16141 tablet_bootstrap.cc:492] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.662115 16142 tablet_bootstrap.cc:492] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.670426 16141 tablet_bootstrap.cc:654] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.670905 16142 tablet_bootstrap.cc:654] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.678560 16148 raft_consensus.cc:493] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:44.679188 16148 raft_consensus.cc:515] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.688232 16140 tablet_bootstrap.cc:492] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:44.688663 16148 leader_election.cc:290] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.691265 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:44.692361 15951 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:44.694231 15989 leader_election.cc:304] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:44.695326 16147 raft_consensus.cc:2804] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:44.695776 16147 raft_consensus.cc:493] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:44.696215 16147 raft_consensus.cc:3060] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.701633 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
W20260501 14:02:44.702297 15897 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:02:44.707554 16141 tablet_bootstrap.cc:492] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:44.708267 16141 ts_tablet_manager.cc:1403] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.013s
I20260501 14:02:44.689050 16140 ts_tablet_manager.cc:1403] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.007s
I20260501 14:02:44.711686 16141 raft_consensus.cc:359] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.712564 16141 raft_consensus.cc:385] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.712292 16147 raft_consensus.cc:515] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.713024 16141 raft_consensus.cc:740] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.713903 16026 raft_consensus.cc:2393] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee89b6b958a44ebdbd9f0dd77ab70428 in current term 1: Already voted for candidate f24495935b14436a8723aba380b53867 in this term.
I20260501 14:02:44.713877 16141 consensus_queue.cc:260] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.715281 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:44.715724 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:44.716188 16100 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:44.716471 15951 raft_consensus.cc:3060] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.717489 15914 leader_election.cc:304] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:44.719259 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:44.719941 16100 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:44.721717 16140 raft_consensus.cc:359] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.722514 16140 raft_consensus.cc:385] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.722824 16140 raft_consensus.cc:740] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.722894 16142 tablet_bootstrap.cc:492] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.723423 16146 raft_consensus.cc:493] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:44.724089 16142 ts_tablet_manager.cc:1403] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.015s
I20260501 14:02:44.723806 16140 consensus_queue.cc:260] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.724246 16146 raft_consensus.cc:515] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.716627 16141 ts_tablet_manager.cc:1434] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260501 14:02:44.726032 15951 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:44.726487 16141 tablet_bootstrap.cc:492] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.727151 16146 leader_election.cc:290] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975)
I20260501 14:02:44.727916 16142 raft_consensus.cc:359] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.728706 16142 raft_consensus.cc:385] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.729001 16142 raft_consensus.cc:740] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.729894 16142 consensus_queue.cc:260] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.730962 16148 raft_consensus.cc:2764] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260501 14:02:44.732743 16147 leader_election.cc:290] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.739624 16141 tablet_bootstrap.cc:654] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.745265 16142 ts_tablet_manager.cc:1434] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260501 14:02:44.746665 16142 tablet_bootstrap.cc:492] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.744928 15989 leader_election.cc:304] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:44.748899 16147 raft_consensus.cc:2804] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:44.749600 16147 raft_consensus.cc:697] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:44.750864 16147 consensus_queue.cc:237] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.753245 16140 ts_tablet_manager.cc:1434] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.007s
I20260501 14:02:44.754616 16140 tablet_bootstrap.cc:492] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.755057 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:44.755889 16100 raft_consensus.cc:3060] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.780818 16140 tablet_bootstrap.cc:654] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.784511 16141 tablet_bootstrap.cc:492] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:44.785274 16141 ts_tablet_manager.cc:1403] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.004s
I20260501 14:02:44.785363 16142 tablet_bootstrap.cc:654] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.793494 16141 raft_consensus.cc:359] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.794833 16141 raft_consensus.cc:385] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.795326 16141 raft_consensus.cc:740] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.796208 15847 catalog_manager.cc:5671] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:44.796778 16141 consensus_queue.cc:260] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.808377 16100 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:44.812937 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:44.813761 16026 raft_consensus.cc:2468] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:44.814006 16141 ts_tablet_manager.cc:1434] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260501 14:02:44.815469 16066 leader_election.cc:304] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:44.816526 16146 raft_consensus.cc:2804] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:44.816890 16146 raft_consensus.cc:493] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:44.817235 16146 raft_consensus.cc:3060] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.819597 16141 tablet_bootstrap.cc:492] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.826558 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:44.828269 16142 tablet_bootstrap.cc:492] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.829020 16142 ts_tablet_manager.cc:1403] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.006s
W20260501 14:02:44.829047 16063 leader_election.cc:343] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.830068 16140 tablet_bootstrap.cc:492] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:44.829223 16147 raft_consensus.cc:493] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:44.830710 16147 raft_consensus.cc:515] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.832994 16147 leader_election.cc:290] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.834239 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e51dd7499d46568dcd081266ea72ca" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:44.834236 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e51dd7499d46568dcd081266ea72ca" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:44.835595 16140 ts_tablet_manager.cc:1403] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.027s
I20260501 14:02:44.835747 15951 raft_consensus.cc:2468] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
W20260501 14:02:44.836066 15989 leader_election.cc:343] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.836959 16142 raft_consensus.cc:359] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.837327 15989 leader_election.cc:304] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9
I20260501 14:02:44.837760 16142 raft_consensus.cc:385] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.838092 16142 raft_consensus.cc:740] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.838744 16147 raft_consensus.cc:2804] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:44.839274 16147 raft_consensus.cc:493] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:44.838934 16142 consensus_queue.cc:260] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.839699 16147 raft_consensus.cc:3060] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.839412 16140 raft_consensus.cc:359] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.840611 16140 raft_consensus.cc:385] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.841034 16140 raft_consensus.cc:740] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.834800 16146 raft_consensus.cc:515] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.842198 16140 consensus_queue.cc:260] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.845090 16140 ts_tablet_manager.cc:1434] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260501 14:02:44.844982 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:44.845732 16026 raft_consensus.cc:3060] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.846401 16140 tablet_bootstrap.cc:492] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.847404 16141 tablet_bootstrap.cc:654] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.852626 16164 raft_consensus.cc:493] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:44.853322 16164 raft_consensus.cc:515] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.856285 16164 leader_election.cc:290] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.857517 16142 ts_tablet_manager.cc:1434] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260501 14:02:44.857542 16140 tablet_bootstrap.cc:654] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.858466 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:44.859244 16100 raft_consensus.cc:2468] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:44.859748 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:44.860787 15914 leader_election.cc:304] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:44.861763 16164 raft_consensus.cc:2804] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260501 14:02:44.861639 15917 leader_election.cc:343] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.862284 16164 raft_consensus.cc:493] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:44.862720 16164 raft_consensus.cc:3060] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.868954 16146 leader_election.cc:290] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975)
I20260501 14:02:44.870055 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:44.855563 16026 raft_consensus.cc:2468] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:44.870513 16142 tablet_bootstrap.cc:492] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.871954 16066 leader_election.cc:304] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
W20260501 14:02:44.873004 16063 leader_election.cc:343] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.867332 16147 raft_consensus.cc:515] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.877128 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e51dd7499d46568dcd081266ea72ca" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:44.877736 15951 raft_consensus.cc:3060] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.878769 16164 raft_consensus.cc:515] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.874011 16146 raft_consensus.cc:2804] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:44.881572 16162 raft_consensus.cc:493] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:44.882380 16162 raft_consensus.cc:515] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.886667 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:44.887415 15950 raft_consensus.cc:2468] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:44.887521 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:44.888497 16142 tablet_bootstrap.cc:654] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
W20260501 14:02:44.889271 15989 leader_election.cc:343] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.889986 16162 leader_election.cc:290] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.891539 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:44.892210 15989 leader_election.cc:304] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9
W20260501 14:02:44.892906 15917 leader_election.cc:343] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.893663 16146 raft_consensus.cc:697] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:44.892500 16140 tablet_bootstrap.cc:492] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:44.893585 16162 raft_consensus.cc:2804] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:44.894675 16140 ts_tablet_manager.cc:1403] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.024s
I20260501 14:02:44.895175 16162 raft_consensus.cc:493] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:44.895605 16162 raft_consensus.cc:3060] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.896723 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:44.897393 16100 raft_consensus.cc:3060] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.899533 16140 raft_consensus.cc:359] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.900593 16140 raft_consensus.cc:385] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.901082 16140 raft_consensus.cc:740] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.902302 16140 consensus_queue.cc:260] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.906273 16100 raft_consensus.cc:2468] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:44.907708 15914 leader_election.cc:304] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: f24495935b14436a8723aba380b53867
I20260501 14:02:44.908731 16148 raft_consensus.cc:2804] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:44.913683 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e51dd7499d46568dcd081266ea72ca" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:44.894765 16146 consensus_queue.cc:237] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:44.915506 16147 leader_election.cc:290] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.915658 16141 tablet_bootstrap.cc:492] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
W20260501 14:02:44.915532 15989 leader_election.cc:343] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.919662 16162 raft_consensus.cc:515] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.920698 16141 ts_tablet_manager.cc:1403] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.011s
I20260501 14:02:44.919849 16164 leader_election.cc:290] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.921518 15951 raft_consensus.cc:2468] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:44.917527 16140 ts_tablet_manager.cc:1434] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.005s
I20260501 14:02:44.923357 15989 leader_election.cc:304] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9
I20260501 14:02:44.924432 16140 tablet_bootstrap.cc:492] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.924468 16141 raft_consensus.cc:359] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.925467 16141 raft_consensus.cc:385] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.925567 16147 raft_consensus.cc:2804] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:44.925828 16141 raft_consensus.cc:740] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.926414 16147 raft_consensus.cc:697] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:44.926774 16141 consensus_queue.cc:260] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.927583 16147 consensus_queue.cc:237] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.930083 16141 ts_tablet_manager.cc:1434] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260501 14:02:44.928931 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:44.930696 16142 tablet_bootstrap.cc:492] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.931334 16141 tablet_bootstrap.cc:492] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.930763 15951 raft_consensus.cc:3060] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:44.936571 16140 tablet_bootstrap.cc:654] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.937685 16148 raft_consensus.cc:697] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:44.938591 16162 leader_election.cc:290] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:44.938772 16148 consensus_queue.cc:237] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.940291 16141 tablet_bootstrap.cc:654] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.931362 16142 ts_tablet_manager.cc:1403] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.008s
I20260501 14:02:44.940989 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
W20260501 14:02:44.942463 15989 leader_election.cc:343] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:44.944670 16142 raft_consensus.cc:359] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.945813 16142 raft_consensus.cc:385] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.946192 16142 raft_consensus.cc:740] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.947342 16142 consensus_queue.cc:260] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.950683 16142 ts_tablet_manager.cc:1434] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260501 14:02:44.952188 16142 tablet_bootstrap.cc:492] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:44.954751 15951 raft_consensus.cc:2468] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:44.955214 15846 catalog_manager.cc:5671] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:44.956579 15989 leader_election.cc:304] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9
I20260501 14:02:44.958092 16147 raft_consensus.cc:2804] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:44.957297 15847 catalog_manager.cc:5671] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:44.958681 16147 raft_consensus.cc:697] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:44.959667 16147 consensus_queue.cc:237] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.961915 16140 tablet_bootstrap.cc:492] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:44.962554 16140 ts_tablet_manager.cc:1403] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.005s
I20260501 14:02:44.966040 16140 raft_consensus.cc:359] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.966835 16140 raft_consensus.cc:385] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.967146 16140 raft_consensus.cc:740] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.967867 16140 consensus_queue.cc:260] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.971278 16141 tablet_bootstrap.cc:492] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:44.972266 16141 ts_tablet_manager.cc:1403] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.012s
I20260501 14:02:44.972985 16142 tablet_bootstrap.cc:654] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.977010 16140 ts_tablet_manager.cc:1434] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260501 14:02:44.976888 16141 raft_consensus.cc:359] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.978137 16141 raft_consensus.cc:385] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.978400 16140 tablet_bootstrap.cc:492] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:44.978482 16141 raft_consensus.cc:740] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.982587 16141 consensus_queue.cc:260] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.988708 16141 ts_tablet_manager.cc:1434] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260501 14:02:44.990144 16141 tablet_bootstrap.cc:492] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:44.990588 16140 tablet_bootstrap.cc:654] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.991110 16142 tablet_bootstrap.cc:492] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:44.991736 16142 ts_tablet_manager.cc:1403] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260501 14:02:44.991439 15848 catalog_manager.cc:5671] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:44.995951 16142 raft_consensus.cc:359] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:44.997099 16142 raft_consensus.cc:385] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:44.997495 16142 raft_consensus.cc:740] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:44.998381 16141 tablet_bootstrap.cc:654] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:44.998556 16142 consensus_queue.cc:260] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.002063 16142 ts_tablet_manager.cc:1434] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260501 14:02:45.003211 16142 tablet_bootstrap.cc:492] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:45.003371 16140 tablet_bootstrap.cc:492] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:45.004014 16140 ts_tablet_manager.cc:1403] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260501 14:02:45.007993 16140 raft_consensus.cc:359] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.008805 16140 raft_consensus.cc:385] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.009150 16140 raft_consensus.cc:740] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.010082 16140 consensus_queue.cc:260] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.013447 16140 ts_tablet_manager.cc:1434] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260501 14:02:45.014132 16142 tablet_bootstrap.cc:654] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:45.014678 16140 tablet_bootstrap.cc:492] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:45.015969 16146 raft_consensus.cc:493] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.016539 16146 raft_consensus.cc:515] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.018863 16146 leader_election.cc:290] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.019867 15846 catalog_manager.cc:5671] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:45.028015 16142 tablet_bootstrap.cc:492] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:45.028668 16142 ts_tablet_manager.cc:1403] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260501 14:02:45.023440 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.031525 16141 tablet_bootstrap.cc:492] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:45.024703 16140 tablet_bootstrap.cc:654] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:45.024996 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:45.032207 16141 ts_tablet_manager.cc:1403] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.003s
I20260501 14:02:45.032842 15951 raft_consensus.cc:2393] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b967e5364e4b218958697890d199d9 in current term 1: Already voted for candidate f24495935b14436a8723aba380b53867 in this term.
I20260501 14:02:45.034272 16142 raft_consensus.cc:359] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:45.035120 16142 raft_consensus.cc:385] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.035424 16142 raft_consensus.cc:740] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.035292 16141 raft_consensus.cc:359] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.036154 16141 raft_consensus.cc:385] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.036456 16141 raft_consensus.cc:740] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.037230 16141 consensus_queue.cc:260] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.039892 16141 ts_tablet_manager.cc:1434] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260501 14:02:45.040992 16141 tablet_bootstrap.cc:492] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:45.036464 16142 consensus_queue.cc:260] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:45.043210 16142 ts_tablet_manager.cc:1434] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260501 14:02:45.044380 16142 tablet_bootstrap.cc:492] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:45.048764 16141 tablet_bootstrap.cc:654] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:45.051214 16142 tablet_bootstrap.cc:654] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:45.037580 16066 leader_election.cc:304] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b967e5364e4b218958697890d199d9; no voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867
I20260501 14:02:45.057683 16146 raft_consensus.cc:3060] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.071599 16141 tablet_bootstrap.cc:492] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:45.072336 16141 ts_tablet_manager.cc:1403] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.015s
I20260501 14:02:45.072395 16142 tablet_bootstrap.cc:492] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:45.073002 16142 ts_tablet_manager.cc:1403] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260501 14:02:45.075604 16141 raft_consensus.cc:359] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.075795 16142 raft_consensus.cc:359] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.076509 16141 raft_consensus.cc:385] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.076565 16142 raft_consensus.cc:385] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.076901 16141 raft_consensus.cc:740] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.076985 16142 raft_consensus.cc:740] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.077875 16142 consensus_queue.cc:260] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.077875 16141 consensus_queue.cc:260] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.080641 16141 ts_tablet_manager.cc:1434] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:02:45.082785 16142 ts_tablet_manager.cc:1434] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:02:45.088457 16146 raft_consensus.cc:2749] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:45.092365 16140 tablet_bootstrap.cc:492] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:45.093016 16140 ts_tablet_manager.cc:1403] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.079s	user 0.033s	sys 0.020s
I20260501 14:02:45.094048 16146 raft_consensus.cc:493] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.094657 16146 raft_consensus.cc:515] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.095530 16140 raft_consensus.cc:359] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.096189 16140 raft_consensus.cc:385] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.096436 16140 raft_consensus.cc:740] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.097239 16146 leader_election.cc:290] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.097718 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ad56305ce44a4e9bcab985d3ab6b20" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:45.097276 16140 consensus_queue.cc:260] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.098272 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ad56305ce44a4e9bcab985d3ab6b20" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.098429 15951 raft_consensus.cc:2468] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:45.098973 16026 raft_consensus.cc:2468] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:45.099771 16063 leader_election.cc:304] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:45.100776 16146 raft_consensus.cc:2804] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:45.101202 16146 raft_consensus.cc:493] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:45.101364 16140 ts_tablet_manager.cc:1434] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260501 14:02:45.101573 16146 raft_consensus.cc:3060] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.102378 16140 tablet_bootstrap.cc:492] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:45.107457 16147 raft_consensus.cc:493] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.108076 16140 tablet_bootstrap.cc:654] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:45.108122 16147 raft_consensus.cc:515] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.110431 16147 leader_election.cc:290] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.112304 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:45.112172 16146 raft_consensus.cc:515] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.113229 16100 raft_consensus.cc:2393] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f24495935b14436a8723aba380b53867 in current term 1: Already voted for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in this term.
I20260501 14:02:45.114243 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:45.114374 16146 leader_election.cc:290] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.115671 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ad56305ce44a4e9bcab985d3ab6b20" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:45.116344 16026 raft_consensus.cc:3060] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.116621 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ad56305ce44a4e9bcab985d3ab6b20" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:45.116556 15989 leader_election.cc:304] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:45.117465 15951 raft_consensus.cc:3060] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.118088 16147 raft_consensus.cc:3060] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.118148 16140 tablet_bootstrap.cc:492] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:45.119122 16140 ts_tablet_manager.cc:1403] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.008s
I20260501 14:02:45.122347 16140 raft_consensus.cc:359] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.123121 16140 raft_consensus.cc:385] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:45.123397 16140 raft_consensus.cc:740] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:45.124279 16140 consensus_queue.cc:260] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.125025 16026 raft_consensus.cc:2468] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:45.126574 16140 ts_tablet_manager.cc:1434] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260501 14:02:45.126452 16066 leader_election.cc:304] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:45.126822 16147 raft_consensus.cc:2749] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:45.127490 16146 raft_consensus.cc:2804] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:45.128322 16146 raft_consensus.cc:697] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:45.129073 16146 consensus_queue.cc:237] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.129159 15951 raft_consensus.cc:2468] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:45.130826 16148 raft_consensus.cc:493] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.131408 16148 raft_consensus.cc:515] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.133348 16175 raft_consensus.cc:493] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.133994 16175 raft_consensus.cc:515] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.135113 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:45.135901 16100 raft_consensus.cc:2468] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:45.136272 16175 leader_election.cc:290] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.137444 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.137670 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:45.138290 16026 raft_consensus.cc:2468] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:45.138417 15951 raft_consensus.cc:2468] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:45.137671 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.139897 16025 raft_consensus.cc:2468] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:45.140854 16066 leader_election.cc:304] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:45.141661 16146 raft_consensus.cc:2804] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:45.141999 16146 raft_consensus.cc:493] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:45.142283 16146 raft_consensus.cc:3060] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.147106 15847 catalog_manager.cc:5671] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:45.148242 15914 leader_election.cc:304] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:45.133638 16148 leader_election.cc:290] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.148046 16146 raft_consensus.cc:515] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.149428 16178 raft_consensus.cc:2804] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:45.149871 16178 raft_consensus.cc:493] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:45.150207 16178 raft_consensus.cc:3060] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.152200 16146 leader_election.cc:290] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.154400 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:45.155130 16025 raft_consensus.cc:3060] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.155579 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:45.156351 15951 raft_consensus.cc:3060] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.158383 16178 raft_consensus.cc:515] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.159036 16146 raft_consensus.cc:493] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.159560 16146 raft_consensus.cc:515] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.161795 16178 leader_election.cc:290] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.162523 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:45.162847 16146 leader_election.cc:290] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.163194 16100 raft_consensus.cc:3060] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.164147 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e51dd7499d46568dcd081266ea72ca" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.165874 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:45.166471 16026 raft_consensus.cc:3060] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.168367 15951 raft_consensus.cc:2468] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:45.168241 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e51dd7499d46568dcd081266ea72ca" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:45.169744 16063 leader_election.cc:304] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:45.170183 15950 raft_consensus.cc:2393] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b967e5364e4b218958697890d199d9 in current term 1: Already voted for candidate f24495935b14436a8723aba380b53867 in this term.
I20260501 14:02:45.170846 16146 raft_consensus.cc:2804] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:45.171490 16063 leader_election.cc:304] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b967e5364e4b218958697890d199d9; no voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867
I20260501 14:02:45.172412 16175 raft_consensus.cc:3060] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.172428 16146 raft_consensus.cc:697] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:45.173252 16100 raft_consensus.cc:2468] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:45.173751 16026 raft_consensus.cc:2468] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:45.173828 16146 consensus_queue.cc:237] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.177117 15914 leader_election.cc:304] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:45.178625 16025 raft_consensus.cc:2468] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:45.178671 16178 raft_consensus.cc:2804] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:45.179548 16178 raft_consensus.cc:697] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:45.180697 16175 raft_consensus.cc:2749] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:45.180473 16178 consensus_queue.cc:237] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.187203 15847 catalog_manager.cc:5671] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:45.189996 15846 catalog_manager.cc:5671] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:45.194233 16178 raft_consensus.cc:493] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.194892 16178 raft_consensus.cc:515] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:45.197930 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:45.199327 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.200130 16178 leader_election.cc:290] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.200330 16025 raft_consensus.cc:2393] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee89b6b958a44ebdbd9f0dd77ab70428 in current term 1: Already voted for candidate 32b967e5364e4b218958697890d199d9 in this term.
I20260501 14:02:45.201501 15917 leader_election.cc:304] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867
I20260501 14:02:45.202242 16178 raft_consensus.cc:3060] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.209376 16178 raft_consensus.cc:2749] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:45.222576 16178 raft_consensus.cc:493] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:45.223137 16178 raft_consensus.cc:515] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.225245 16178 leader_election.cc:290] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.226153 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0fbc22f9264d4e9cc3daa8e5d5fdcf" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:45.226413 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0fbc22f9264d4e9cc3daa8e5d5fdcf" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:45.227005 16025 raft_consensus.cc:2468] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:45.227005 16100 raft_consensus.cc:2468] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:45.228253 15917 leader_election.cc:304] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:45.228956 16178 raft_consensus.cc:2804] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:45.229288 16178 raft_consensus.cc:493] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:45.229547 16178 raft_consensus.cc:3060] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.235337 16178 raft_consensus.cc:515] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.237210 16178 leader_election.cc:290] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.238272 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0fbc22f9264d4e9cc3daa8e5d5fdcf" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:45.238288 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0fbc22f9264d4e9cc3daa8e5d5fdcf" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:45.238968 16025 raft_consensus.cc:3060] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.239017 16100 raft_consensus.cc:3060] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:45.245178 16100 raft_consensus.cc:2468] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:45.245189 16025 raft_consensus.cc:2468] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:45.246452 15914 leader_election.cc:304] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:45.247376 16178 raft_consensus.cc:2804] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:45.247200 16147 consensus_queue.cc:1048] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:45.248006 16178 raft_consensus.cc:697] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:45.248950 16178 consensus_queue.cc:237] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.259061 15847 catalog_manager.cc:5671] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:45.274499 16147 consensus_queue.cc:1048] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.354209 16146 consensus_queue.cc:1048] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.367412 16175 consensus_queue.cc:1048] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.409606 16178 consensus_queue.cc:1048] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.415426 16100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e892eac359422db5beea872f9f3823"
dest_uuid: "32b967e5364e4b218958697890d199d9"
mode: GRACEFUL
new_leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:38974
I20260501 14:02:45.416296 16100 raft_consensus.cc:606] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Received request to transfer leadership to TS ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:45.427242 16148 consensus_queue.cc:1048] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.449950 16025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d"
dest_uuid: "f24495935b14436a8723aba380b53867"
mode: GRACEFUL
new_leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:48364
I20260501 14:02:45.450699 16025 raft_consensus.cc:606] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Received request to transfer leadership to TS ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:45.452690 16162 consensus_queue.cc:1048] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.466270 16177 consensus_queue.cc:1048] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:45.481436 15950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
mode: GRACEFUL
new_leader_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:46830
I20260501 14:02:45.482174 15950 raft_consensus.cc:606] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Received request to transfer leadership to TS f24495935b14436a8723aba380b53867
I20260501 14:02:45.488010 16099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b"
dest_uuid: "32b967e5364e4b218958697890d199d9"
mode: GRACEFUL
new_leader_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:38974
I20260501 14:02:45.488574 16099 raft_consensus.cc:606] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Received request to transfer leadership to TS f24495935b14436a8723aba380b53867
I20260501 14:02:45.493674 16213 consensus_queue.cc:1048] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.506692 16147 consensus_queue.cc:1048] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.573696 16175 consensus_queue.cc:1048] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.586164 16204 consensus_queue.cc:1048] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:45.596431 16146 raft_consensus.cc:993] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: : Instructing follower f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:45.597021 16146 raft_consensus.cc:1081] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Signalling peer f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:45.597317 16148 consensus_queue.cc:1048] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.598853 16026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b"
dest_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:48350
I20260501 14:02:45.599705 16026 raft_consensus.cc:493] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:45.600143 16026 raft_consensus.cc:3060] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.605383 16178 raft_consensus.cc:993] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: : Instructing follower f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:45.606025 16178 raft_consensus.cc:1081] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Signalling peer f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:45.608414 16024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b"
dest_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:48348
I20260501 14:02:45.610698 16209 consensus_queue.cc:1048] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:45.611467 16024 raft_consensus.cc:493] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:45.612458 16024 raft_consensus.cc:3060] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.612073 16026 raft_consensus.cc:515] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.619776 16026 leader_election.cc:290] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.620496 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:45.621368 16099 raft_consensus.cc:3055] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:45.621697 16099 raft_consensus.cc:740] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:45.622594 16099 consensus_queue.cc:260] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.623090 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5e625e7d764028a83aa151a0e6ad1b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:45.624060 15950 raft_consensus.cc:3060] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.624116 16099 raft_consensus.cc:3060] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.632246 16024 raft_consensus.cc:515] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.633216 16099 raft_consensus.cc:2468] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:45.633708 15950 raft_consensus.cc:2468] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:45.634575 15989 leader_election.cc:304] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:45.635617 16147 raft_consensus.cc:2804] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:45.636345 16147 raft_consensus.cc:697] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:45.637389 16147 consensus_queue.cc:237] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.641546 16024 leader_election.cc:290] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.641489 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:45.642071 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c3b3ddeded4aaaa0ae6ab6092e969b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:45.642297 15950 raft_consensus.cc:3055] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:45.642714 15950 raft_consensus.cc:740] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:45.642764 16099 raft_consensus.cc:3060] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.643595 15950 consensus_queue.cc:260] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.645076 15950 raft_consensus.cc:3060] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.647181 16178 consensus_queue.cc:1048] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.653250 15950 raft_consensus.cc:2468] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:45.653411 16099 raft_consensus.cc:2468] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:45.654458 15989 leader_election.cc:304] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:45.655526 16147 raft_consensus.cc:2804] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:45.656106 16147 raft_consensus.cc:697] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:45.656980 16147 consensus_queue.cc:237] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.659679 15848 catalog_manager.cc:5671] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 1 to 2, leader changed from 32b967e5364e4b218958697890d199d9 (127.6.77.131) to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:45.663123 16146 consensus_queue.cc:1048] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:45.673214 16209 consensus_queue.cc:1048] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:45.685092 16175 consensus_queue.cc:1048] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:45.692508 15846 catalog_manager.cc:5671] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 1 to 2, leader changed from ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129) to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:45.796149 16213 raft_consensus.cc:993] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: : Instructing follower ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:45.796738 16213 raft_consensus.cc:1081] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Signalling peer ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:45.798446 15950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:46806
I20260501 14:02:45.799021 15950 raft_consensus.cc:493] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:45.799423 15950 raft_consensus.cc:3060] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.805455 15950 raft_consensus.cc:515] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.807108 15950 leader_election.cc:290] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:45.808283 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:45.808378 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e803d8e72440a3ae5abe977157ea3d" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:45.808997 16026 raft_consensus.cc:3055] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:45.809077 16100 raft_consensus.cc:3060] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.809326 16026 raft_consensus.cc:740] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:45.810187 16026 consensus_queue.cc:260] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.811249 16026 raft_consensus.cc:3060] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.815168 16100 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:45.816478 15914 leader_election.cc:304] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:45.816581 16026 raft_consensus.cc:2468] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:45.817265 16209 raft_consensus.cc:2804] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:45.817786 16209 raft_consensus.cc:697] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:45.818600 16209 consensus_queue.cc:237] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:45.825804 15846 catalog_manager.cc:5671] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 1 to 2, leader changed from f24495935b14436a8723aba380b53867 (127.6.77.130) to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:45.843676 16204 raft_consensus.cc:993] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: : Instructing follower ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:45.844291 16204 raft_consensus.cc:1081] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Signalling peer ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:45.845759 15950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4e892eac359422db5beea872f9f3823"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:46816
I20260501 14:02:45.846294 15950 raft_consensus.cc:493] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:45.846602 15950 raft_consensus.cc:3060] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.852804 15950 raft_consensus.cc:515] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:45.854730 15950 leader_election.cc:290] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:45.855921 16100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:45.856184 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e892eac359422db5beea872f9f3823" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:45.856774 16100 raft_consensus.cc:3055] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:45.856814 16026 raft_consensus.cc:3060] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.857273 16100 raft_consensus.cc:740] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:45.858134 16100 consensus_queue.cc:260] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:45.859339 16100 raft_consensus.cc:3060] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:45.863349 16026 raft_consensus.cc:2468] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:45.864465 15917 leader_election.cc:304] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:45.865233 16209 raft_consensus.cc:2804] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:45.865536 16100 raft_consensus.cc:2468] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:45.865661 16209 raft_consensus.cc:697] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:45.866845 16209 consensus_queue.cc:237] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } }
I20260501 14:02:45.873620 15846 catalog_manager.cc:5671] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 1 to 2, leader changed from 32b967e5364e4b218958697890d199d9 (127.6.77.131) to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:46.196280 16099 raft_consensus.cc:1275] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.197042 15950 raft_consensus.cc:1275] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.198836 15951 raft_consensus.cc:1275] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.199132 16162 consensus_queue.cc:1048] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:46.199990 16147 consensus_queue.cc:1048] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:46.200475 16213 consensus_queue.cc:1048] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:46.206089 16026 raft_consensus.cc:1275] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.207746 16148 consensus_queue.cc:1048] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:46.227499 16099 raft_consensus.cc:1275] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.229683 16162 consensus_queue.cc:1048] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:46.255806 16099 raft_consensus.cc:1275] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.260509 16148 consensus_queue.cc:1048] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:46.318332 16099 raft_consensus.cc:1275] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.319689 16164 consensus_queue.cc:1048] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:46.327657 16026 raft_consensus.cc:1275] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:46.329517 16148 consensus_queue.cc:1048] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260501 14:02:47.040867 15880 debug-util.cc:398] Leaking SignalData structure 0x7b0800192d60 after lost signal to thread 6457
W20260501 14:02:47.042301 15880 debug-util.cc:398] Leaking SignalData structure 0x7b0800237300 after lost signal to thread 15883
W20260501 14:02:47.043776 15880 debug-util.cc:398] Leaking SignalData structure 0x7b08002c57c0 after lost signal to thread 15975
W20260501 14:02:47.045138 15880 debug-util.cc:398] Leaking SignalData structure 0x7b08001beae0 after lost signal to thread 16050
W20260501 14:02:47.046378 15880 debug-util.cc:398] Leaking SignalData structure 0x7b080004f7a0 after lost signal to thread 16124
I20260501 14:02:48.771520 15848 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50108:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260501 14:02:48.774507 15848 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260501 14:02:48.841145 15939 tablet_service.cc:1511] Processing CreateTablet for tablet feb4427c37d247eebea4c5dcf23807ee (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:48.841866 16009 tablet_service.cc:1511] Processing CreateTablet for tablet feb4427c37d247eebea4c5dcf23807ee (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:48.842705 15939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb4427c37d247eebea4c5dcf23807ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.843323 16009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb4427c37d247eebea4c5dcf23807ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.843091 16086 tablet_service.cc:1511] Processing CreateTablet for tablet feb4427c37d247eebea4c5dcf23807ee (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260501 14:02:48.844516 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb4427c37d247eebea4c5dcf23807ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.858172 15933 tablet_service.cc:1511] Processing CreateTablet for tablet 97d19fa53eaa41c1a438da0868001cf6 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:48.859933 15933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d19fa53eaa41c1a438da0868001cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.871564 16010 tablet_service.cc:1511] Processing CreateTablet for tablet 97d19fa53eaa41c1a438da0868001cf6 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:48.873665 16010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d19fa53eaa41c1a438da0868001cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.873994 16084 tablet_service.cc:1511] Processing CreateTablet for tablet 97d19fa53eaa41c1a438da0868001cf6 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260501 14:02:48.876005 16084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d19fa53eaa41c1a438da0868001cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.896893 16255 tablet_bootstrap.cc:492] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:48.901866 15939 tablet_service.cc:1511] Processing CreateTablet for tablet 95b06b8986a14221a8a02e790f179079 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:48.913659 15939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b06b8986a14221a8a02e790f179079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.919638 16014 tablet_service.cc:1511] Processing CreateTablet for tablet 95b06b8986a14221a8a02e790f179079 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:48.921402 16014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b06b8986a14221a8a02e790f179079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.922211 16082 tablet_service.cc:1511] Processing CreateTablet for tablet 95b06b8986a14221a8a02e790f179079 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260501 14:02:48.923748 16082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b06b8986a14221a8a02e790f179079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.924907 16255 tablet_bootstrap.cc:654] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:48.940047 15941 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc9fa58ea554ffda67f03e0567e44ea (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:48.941987 15941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc9fa58ea554ffda67f03e0567e44ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260501 14:02:48.943624 15897 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260501 14:02:48.944164 15972 debug-util.cc:398] Leaking SignalData structure 0x7b0800398b40 after lost signal to thread 6457
W20260501 14:02:48.945693 15972 debug-util.cc:398] Leaking SignalData structure 0x7b0800050ae0 after lost signal to thread 15883
W20260501 14:02:48.947404 15972 debug-util.cc:398] Leaking SignalData structure 0x7b0800224e40 after lost signal to thread 15975
W20260501 14:02:48.949895 15972 debug-util.cc:398] Leaking SignalData structure 0x7b0800100520 after lost signal to thread 16050
W20260501 14:02:48.951546 15972 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6ae0 after lost signal to thread 16124
W20260501 14:02:48.952167 15972 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1880 after lost signal to thread 16213
I20260501 14:02:48.954488 16255 tablet_bootstrap.cc:492] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:48.955266 16255 ts_tablet_manager.cc:1403] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.000s
I20260501 14:02:48.965724 16255 raft_consensus.cc:359] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:48.966740 16255 raft_consensus.cc:385] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:48.967075 16255 raft_consensus.cc:740] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:48.968039 16255 consensus_queue.cc:260] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:48.971053 16255 ts_tablet_manager.cc:1434] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260501 14:02:48.972325 16255 tablet_bootstrap.cc:492] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:48.977185 16254 tablet_bootstrap.cc:492] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:48.984906 16009 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc9fa58ea554ffda67f03e0567e44ea (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:48.985584 16254 tablet_bootstrap.cc:654] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:48.987007 15939 tablet_service.cc:1511] Processing CreateTablet for tablet b6aa88a147f34775a4189804844fa9b6 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:48.988531 15939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6aa88a147f34775a4189804844fa9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.001001 16009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc9fa58ea554ffda67f03e0567e44ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:48.985728 16083 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc9fa58ea554ffda67f03e0567e44ea (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260501 14:02:49.006790 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc9fa58ea554ffda67f03e0567e44ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.012617 16258 tablet_bootstrap.cc:492] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.022595 16014 tablet_service.cc:1511] Processing CreateTablet for tablet b6aa88a147f34775a4189804844fa9b6 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:49.026374 15933 tablet_service.cc:1511] Processing CreateTablet for tablet 16ecb3450f444c34a071008a424a82c9 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:49.027165 16014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6aa88a147f34775a4189804844fa9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.034624 16255 tablet_bootstrap.cc:654] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.034935 15933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ecb3450f444c34a071008a424a82c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.028391 16086 tablet_service.cc:1511] Processing CreateTablet for tablet b6aa88a147f34775a4189804844fa9b6 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260501 14:02:49.039682 16010 tablet_service.cc:1511] Processing CreateTablet for tablet 16ecb3450f444c34a071008a424a82c9 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:49.044970 16010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ecb3450f444c34a071008a424a82c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.047405 16084 tablet_service.cc:1511] Processing CreateTablet for tablet 16ecb3450f444c34a071008a424a82c9 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260501 14:02:49.050926 16084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ecb3450f444c34a071008a424a82c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.059968 15934 tablet_service.cc:1511] Processing CreateTablet for tablet 4b7cf3d6aa2e4eabbb159023e26e558b (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:49.061599 15934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7cf3d6aa2e4eabbb159023e26e558b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.068027 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6aa88a147f34775a4189804844fa9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.090063 16258 tablet_bootstrap.cc:654] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.095738 16008 tablet_service.cc:1511] Processing CreateTablet for tablet 4b7cf3d6aa2e4eabbb159023e26e558b (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:49.096570 16082 tablet_service.cc:1511] Processing CreateTablet for tablet 4b7cf3d6aa2e4eabbb159023e26e558b (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260501 14:02:49.103978 16008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7cf3d6aa2e4eabbb159023e26e558b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.108207 16082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7cf3d6aa2e4eabbb159023e26e558b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.107237 15941 tablet_service.cc:1511] Processing CreateTablet for tablet db5e73e6a0f5463c96570ba58eab30f4 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:49.118229 15941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5e73e6a0f5463c96570ba58eab30f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.118872 16254 tablet_bootstrap.cc:492] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.119572 16254 ts_tablet_manager.cc:1403] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.143s	user 0.027s	sys 0.036s
I20260501 14:02:49.123767 16083 tablet_service.cc:1511] Processing CreateTablet for tablet db5e73e6a0f5463c96570ba58eab30f4 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:49.124200 16015 tablet_service.cc:1511] Processing CreateTablet for tablet db5e73e6a0f5463c96570ba58eab30f4 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260501 14:02:49.125761 16015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5e73e6a0f5463c96570ba58eab30f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.125577 15934 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3bec5bf3824e79a198c92137852e55 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:49.127099 15934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3bec5bf3824e79a198c92137852e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.127535 16255 tablet_bootstrap.cc:492] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.125597 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5e73e6a0f5463c96570ba58eab30f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.128228 16255 ts_tablet_manager.cc:1403] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.156s	user 0.023s	sys 0.005s
I20260501 14:02:49.132064 16255 raft_consensus.cc:359] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.133009 16255 raft_consensus.cc:385] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.133364 16255 raft_consensus.cc:740] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.134577 16255 consensus_queue.cc:260] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.137024 16011 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3bec5bf3824e79a198c92137852e55 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:49.138725 16011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3bec5bf3824e79a198c92137852e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.141283 16254 raft_consensus.cc:359] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.142223 16254 raft_consensus.cc:385] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.137475 16255 ts_tablet_manager.cc:1434] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260501 14:02:49.152227 16255 tablet_bootstrap.cc:492] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:49.142529 16254 raft_consensus.cc:740] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.162055 16085 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3bec5bf3824e79a198c92137852e55 (DEFAULT_TABLE table=soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260501 14:02:49.168851 16085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3bec5bf3824e79a198c92137852e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260501 14:02:49.180406 16254 consensus_queue.cc:260] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.194146 16254 ts_tablet_manager.cc:1434] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260501 14:02:49.184598 16255 tablet_bootstrap.cc:654] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.198366 16258 tablet_bootstrap.cc:492] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.199280 16258 ts_tablet_manager.cc:1403] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.005s
I20260501 14:02:49.195611 16254 tablet_bootstrap.cc:492] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:49.219385 16255 tablet_bootstrap.cc:492] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.220252 16255 ts_tablet_manager.cc:1403] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.004s
I20260501 14:02:49.203140 16258 raft_consensus.cc:359] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.223912 16255 raft_consensus.cc:359] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.225153 16255 raft_consensus.cc:385] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.225564 16255 raft_consensus.cc:740] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.224352 16258 raft_consensus.cc:385] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.228052 16258 raft_consensus.cc:740] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.229116 16258 consensus_queue.cc:260] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.232496 16258 ts_tablet_manager.cc:1434] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260501 14:02:49.233799 16258 tablet_bootstrap.cc:492] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.226509 16255 consensus_queue.cc:260] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.245362 16235 raft_consensus.cc:493] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.245965 16235 raft_consensus.cc:515] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.252012 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
W20260501 14:02:49.254549 15917 leader_election.cc:343] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.255133 16258 tablet_bootstrap.cc:654] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.258225 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
W20260501 14:02:49.260347 15914 leader_election.cc:343] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.260921 15914 leader_election.cc:304] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867
I20260501 14:02:49.261929 16235 leader_election.cc:290] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.269557 16254 tablet_bootstrap.cc:654] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.276636 16235 raft_consensus.cc:2749] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:49.286918 16255 ts_tablet_manager.cc:1434] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.066s	user 0.017s	sys 0.005s
I20260501 14:02:49.288697 16258 tablet_bootstrap.cc:492] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.289721 16258 ts_tablet_manager.cc:1403] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.015s
I20260501 14:02:49.293653 16258 raft_consensus.cc:359] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.294574 16258 raft_consensus.cc:385] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.295810 16258 raft_consensus.cc:740] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.296469 16255 tablet_bootstrap.cc:492] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:49.296850 16258 consensus_queue.cc:260] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.302670 16242 raft_consensus.cc:493] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.302949 16254 tablet_bootstrap.cc:492] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.303761 16254 ts_tablet_manager.cc:1403] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.002s
I20260501 14:02:49.303504 16242 raft_consensus.cc:515] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.300201 16258 ts_tablet_manager.cc:1434] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260501 14:02:49.309638 16242 leader_election.cc:290] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.307596 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:49.320122 15950 raft_consensus.cc:2468] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:49.317974 16254 raft_consensus.cc:359] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.322669 16254 raft_consensus.cc:385] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.323038 16254 raft_consensus.cc:740] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.323874 16254 consensus_queue.cc:260] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.314114 16258 tablet_bootstrap.cc:492] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.316751 16255 tablet_bootstrap.cc:654] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.313633 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:49.326865 16099 raft_consensus.cc:2468] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:49.329273 15989 leader_election.cc:304] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.333967 16242 raft_consensus.cc:2804] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.344942 16258 tablet_bootstrap.cc:654] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.343974 16242 raft_consensus.cc:493] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.346943 16242 raft_consensus.cc:3060] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.347559 16254 ts_tablet_manager.cc:1434] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.003s
I20260501 14:02:49.348897 16254 tablet_bootstrap.cc:492] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:49.356540 16242 raft_consensus.cc:515] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.361539 16255 tablet_bootstrap.cc:492] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.362267 16255 ts_tablet_manager.cc:1403] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.009s
I20260501 14:02:49.363035 16242 leader_election.cc:290] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.365835 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:49.366560 15950 raft_consensus.cc:3060] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.367415 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:49.368202 16099 raft_consensus.cc:3060] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.367146 16255 raft_consensus.cc:359] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.369745 16255 raft_consensus.cc:385] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.380031 16255 raft_consensus.cc:740] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.375614 15950 raft_consensus.cc:2468] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:49.377978 16099 raft_consensus.cc:2468] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:49.379429 16264 raft_consensus.cc:493] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.370411 16258 tablet_bootstrap.cc:492] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.382376 16258 ts_tablet_manager.cc:1403] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.002s
I20260501 14:02:49.382087 16264 raft_consensus.cc:515] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.383184 16254 tablet_bootstrap.cc:654] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.382881 15989 leader_election.cc:304] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.385619 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:49.386092 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
W20260501 14:02:49.387328 15917 leader_election.cc:343] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
W20260501 14:02:49.388011 15914 leader_election.cc:343] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.388340 16266 raft_consensus.cc:2804] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:49.388509 15914 leader_election.cc:304] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867
I20260501 14:02:49.389637 16235 raft_consensus.cc:2749] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:49.390257 16266 raft_consensus.cc:697] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:49.390419 16264 leader_election.cc:290] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.391521 16266 consensus_queue.cc:237] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.395421 16258 raft_consensus.cc:359] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.397116 16258 raft_consensus.cc:385] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.397543 16258 raft_consensus.cc:740] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.398514 16258 consensus_queue.cc:260] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.381172 16255 consensus_queue.cc:260] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.400715 16254 tablet_bootstrap.cc:492] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.401468 16254 ts_tablet_manager.cc:1403] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.008s
I20260501 14:02:49.401839 16255 ts_tablet_manager.cc:1434] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260501 14:02:49.406759 16258 ts_tablet_manager.cc:1434] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260501 14:02:49.407316 16255 tablet_bootstrap.cc:492] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:49.412976 16254 raft_consensus.cc:359] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.414034 16254 raft_consensus.cc:385] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.414415 16254 raft_consensus.cc:740] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.415340 16254 consensus_queue.cc:260] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.421167 16254 ts_tablet_manager.cc:1434] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260501 14:02:49.422487 16254 tablet_bootstrap.cc:492] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:49.434346 16255 tablet_bootstrap.cc:654] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.428579 16258 tablet_bootstrap.cc:492] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.440115 16254 tablet_bootstrap.cc:654] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.436269 15848 catalog_manager.cc:5671] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:49.446323 16258 tablet_bootstrap.cc:654] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.461700 16258 tablet_bootstrap.cc:492] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.462143 16255 tablet_bootstrap.cc:492] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.462508 16258 ts_tablet_manager.cc:1403] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.003s
I20260501 14:02:49.466449 16254 tablet_bootstrap.cc:492] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.467150 16254 ts_tablet_manager.cc:1403] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.011s
I20260501 14:02:49.468286 16258 raft_consensus.cc:359] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.462895 16255 ts_tablet_manager.cc:1403] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.006s
I20260501 14:02:49.470958 16243 raft_consensus.cc:493] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.471597 16243 raft_consensus.cc:515] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.473856 16255 raft_consensus.cc:359] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.474754 16255 raft_consensus.cc:385] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.475062 16255 raft_consensus.cc:740] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.475900 16255 consensus_queue.cc:260] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.476310 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:49.477100 16258 raft_consensus.cc:385] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.477166 16026 raft_consensus.cc:2468] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:49.477571 16258 raft_consensus.cc:740] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.478966 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:49.479341 16066 leader_election.cc:304] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.479776 15950 raft_consensus.cc:2468] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:49.480719 16243 leader_election.cc:290] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:49.481149 16258 consensus_queue.cc:260] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.482342 16243 raft_consensus.cc:2804] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.482813 16243 raft_consensus.cc:493] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.483218 16243 raft_consensus.cc:3060] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.484191 16258 ts_tablet_manager.cc:1434] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260501 14:02:49.485961 16254 raft_consensus.cc:359] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.489940 16255 ts_tablet_manager.cc:1434] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260501 14:02:49.504042 16254 raft_consensus.cc:385] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.504416 16254 raft_consensus.cc:740] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.505280 16254 consensus_queue.cc:260] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.509645 16255 tablet_bootstrap.cc:492] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:49.492223 16258 tablet_bootstrap.cc:492] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.526914 16254 ts_tablet_manager.cc:1434] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260501 14:02:49.527410 16255 tablet_bootstrap.cc:654] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.533382 16276 raft_consensus.cc:493] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.534063 16276 raft_consensus.cc:515] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.530926 16254 tablet_bootstrap.cc:492] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:49.538020 16276 leader_election.cc:290] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:49.539053 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:49.539834 15950 raft_consensus.cc:2468] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:49.541011 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:49.541249 16063 leader_election.cc:304] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:49.541858 16026 raft_consensus.cc:2468] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:49.542462 16276 raft_consensus.cc:2804] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.542930 16276 raft_consensus.cc:493] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.543284 16276 raft_consensus.cc:3060] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.533385 16258 tablet_bootstrap.cc:654] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.553555 16276 raft_consensus.cc:515] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.503283 16243 raft_consensus.cc:515] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.563040 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:49.564152 15950 raft_consensus.cc:3060] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.574007 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:49.574893 16026 raft_consensus.cc:3060] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.590121 15950 raft_consensus.cc:2468] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:49.591713 16243 leader_election.cc:290] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:49.593834 16063 leader_election.cc:304] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:49.594578 16276 leader_election.cc:290] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:49.595247 16276 raft_consensus.cc:2804] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:49.596007 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:49.596940 16024 raft_consensus.cc:3060] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.598162 16276 raft_consensus.cc:697] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:49.599218 16276 consensus_queue.cc:237] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.600334 16026 raft_consensus.cc:2468] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:49.601258 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:49.608189 16255 tablet_bootstrap.cc:492] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.609176 16255 ts_tablet_manager.cc:1403] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.019s
I20260501 14:02:49.610395 16024 raft_consensus.cc:2468] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:49.613257 16255 raft_consensus.cc:359] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.613575 16258 tablet_bootstrap.cc:492] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.610138 16254 tablet_bootstrap.cc:654] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.624122 16258 ts_tablet_manager.cc:1403] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.132s	user 0.004s	sys 0.029s
I20260501 14:02:49.614428 16255 raft_consensus.cc:385] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.614764 15950 raft_consensus.cc:3060] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.630123 16258 raft_consensus.cc:359] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.621838 16243 raft_consensus.cc:493] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.632841 16243 raft_consensus.cc:515] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.635185 16243 leader_election.cc:290] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:49.635468 16255 raft_consensus.cc:740] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.636518 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:49.637408 15951 raft_consensus.cc:2468] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:49.637804 15950 raft_consensus.cc:2468] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:49.636396 16255 consensus_queue.cc:260] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.638638 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:49.639308 16258 raft_consensus.cc:385] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.640434 16066 leader_election.cc:304] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.643226 16243 raft_consensus.cc:2804] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:49.641116 16063 leader_election.cc:304] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
W20260501 14:02:49.645493 16066 leader_election.cc:343] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.645403 16258 raft_consensus.cc:740] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.650671 16242 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.667673 16276 raft_consensus.cc:2804] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.668406 16276 raft_consensus.cc:493] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.672935 16258 consensus_queue.cc:260] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.674245 16255 ts_tablet_manager.cc:1434] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260501 14:02:49.659987 16242 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.677454 16254 tablet_bootstrap.cc:492] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.679656 16276 raft_consensus.cc:3060] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.679934 16254 ts_tablet_manager.cc:1403] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.008s
I20260501 14:02:49.679056 16255 tablet_bootstrap.cc:492] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:49.677597 16258 ts_tablet_manager.cc:1434] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260501 14:02:49.684885 16258 tablet_bootstrap.cc:492] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.683648 16264 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.685783 16264 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.688022 16264 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.688231 16242 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.668736 16243 raft_consensus.cc:697] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:49.691001 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:49.690994 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:49.692283 16026 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:49.692283 15950 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:49.683626 16254 raft_consensus.cc:359] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.693527 16254 raft_consensus.cc:385] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.693897 16254 raft_consensus.cc:740] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.694187 15989 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
W20260501 14:02:49.694861 16063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.77.129:32975, user_credentials={real_user=slave}} blocked reactor thread for 53853.7us
I20260501 14:02:49.694698 16254 consensus_queue.cc:260] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.694190 15917 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.696277 16242 raft_consensus.cc:2804] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.698148 16242 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.698575 16242 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.698518 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:49.695305 16243 consensus_queue.cc:237] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.707801 16264 raft_consensus.cc:2804] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.708303 16264 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.708640 16264 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:02:49.705479 15914 leader_election.cc:343] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.711776 16276 raft_consensus.cc:515] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.714035 16276 leader_election.cc:290] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:49.714485 16242 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.716745 16242 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.718020 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:49.719137 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:49.707507 16254 ts_tablet_manager.cc:1434] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260501 14:02:49.717162 16255 tablet_bootstrap.cc:654] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.724987 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:49.720880 15848 catalog_manager.cc:5671] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:49.725803 15951 raft_consensus.cc:3060] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:02:49.727620 15989 leader_election.cc:343] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.728073 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:49.736459 16026 raft_consensus.cc:3060] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.725750 16264 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.729141 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:49.741006 15950 raft_consensus.cc:2393] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f24495935b14436a8723aba380b53867 in current term 1: Already voted for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in this term.
I20260501 14:02:49.741194 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:49.742219 16024 raft_consensus.cc:2393] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee89b6b958a44ebdbd9f0dd77ab70428 in current term 1: Already voted for candidate f24495935b14436a8723aba380b53867 in this term.
I20260501 14:02:49.731362 16254 tablet_bootstrap.cc:492] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: Bootstrap starting.
W20260501 14:02:49.744728 15989 leader_election.cc:343] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.745250 15989 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:49.746496 16235 raft_consensus.cc:493] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.747110 16235 raft_consensus.cc:515] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.748014 16242 raft_consensus.cc:2749] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:02:49.752117 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:49.752995 16099 raft_consensus.cc:2468] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 0.
I20260501 14:02:49.753186 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:49.754558 15914 leader_election.cc:304] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:49.731669 16258 tablet_bootstrap.cc:654] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.755995 16262 raft_consensus.cc:2804] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.756482 16262 raft_consensus.cc:493] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.756860 16262 raft_consensus.cc:3060] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
W20260501 14:02:49.755415 15917 leader_election.cc:343] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.754987 16235 leader_election.cc:290] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.766551 16264 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.767925 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
W20260501 14:02:49.769698 15914 leader_election.cc:343] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.770181 15914 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867
I20260501 14:02:49.772066 16264 raft_consensus.cc:2749] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260501 14:02:49.776197 16026 raft_consensus.cc:2468] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:49.777621 16066 leader_election.cc:304] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.778610 16243 raft_consensus.cc:2804] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:49.779114 16243 raft_consensus.cc:697] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:49.779399 16255 tablet_bootstrap.cc:492] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.780215 16254 tablet_bootstrap.cc:654] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.780056 16243 consensus_queue.cc:237] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.775552 15951 raft_consensus.cc:2468] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:49.780019 16255 ts_tablet_manager.cc:1403] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.004s
I20260501 14:02:49.790572 16258 tablet_bootstrap.cc:492] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.791327 16258 ts_tablet_manager.cc:1403] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.006s
I20260501 14:02:49.791879 16242 consensus_queue.cc:1048] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:49.791584 16262 raft_consensus.cc:515] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.796267 16255 raft_consensus.cc:359] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.799860 16255 raft_consensus.cc:385] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.800231 16255 raft_consensus.cc:740] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.800981 16255 consensus_queue.cc:260] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.802762 16262 leader_election.cc:290] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.804513 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:49.805265 16255 ts_tablet_manager.cc:1434] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260501 14:02:49.806239 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:49.806514 16255 tablet_bootstrap.cc:492] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
W20260501 14:02:49.806439 15917 leader_election.cc:343] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:49.807637 16099 raft_consensus.cc:3060] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.821720 16099 raft_consensus.cc:2468] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:49.802153 16254 tablet_bootstrap.cc:492] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.823222 16254 ts_tablet_manager.cc:1403] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.009s
I20260501 14:02:49.824757 16255 tablet_bootstrap.cc:654] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.821657 16258 raft_consensus.cc:359] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.827097 15914 leader_election.cc:304] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: f24495935b14436a8723aba380b53867
I20260501 14:02:49.827296 16258 raft_consensus.cc:385] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.827852 16258 raft_consensus.cc:740] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.828703 16262 raft_consensus.cc:2804] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:49.829378 16262 raft_consensus.cc:697] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:49.828704 16258 consensus_queue.cc:260] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.830291 16262 consensus_queue.cc:237] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.830638 15848 catalog_manager.cc:5671] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:49.831853 16258 ts_tablet_manager.cc:1434] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260501 14:02:49.833045 15848 catalog_manager.cc:5671] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:49.842698 16258 tablet_bootstrap.cc:492] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.856276 16258 tablet_bootstrap.cc:654] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.856686 16254 raft_consensus.cc:359] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.861341 16254 raft_consensus.cc:385] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.861680 16254 raft_consensus.cc:740] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.862311 16255 tablet_bootstrap.cc:492] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:49.862959 16255 ts_tablet_manager.cc:1403] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.000s
I20260501 14:02:49.862494 16254 consensus_queue.cc:260] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.885636 16242 consensus_queue.cc:1048] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:49.896641 16254 ts_tablet_manager.cc:1434] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260501 14:02:49.895664 15846 catalog_manager.cc:5671] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 1 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:49.898461 16254 tablet_bootstrap.cc:492] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:49.907353 16255 raft_consensus.cc:359] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.910925 16255 raft_consensus.cc:385] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.911387 16255 raft_consensus.cc:740] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.912338 16255 consensus_queue.cc:260] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.914887 16258 tablet_bootstrap.cc:492] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:49.915179 16255 ts_tablet_manager.cc:1434] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260501 14:02:49.915844 16258 ts_tablet_manager.cc:1403] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.012s
I20260501 14:02:49.916563 16255 tablet_bootstrap.cc:492] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: Bootstrap starting.
I20260501 14:02:49.919310 16258 raft_consensus.cc:359] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.920138 16258 raft_consensus.cc:385] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.920468 16258 raft_consensus.cc:740] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.922322 16258 consensus_queue.cc:260] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.925040 16255 tablet_bootstrap.cc:654] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.925395 16258 ts_tablet_manager.cc:1434] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260501 14:02:49.929493 16258 tablet_bootstrap.cc:492] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:49.933199 16254 tablet_bootstrap.cc:654] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:49.945645 16258 tablet_bootstrap.cc:654] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
W20260501 14:02:49.951225 15897 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:02:49.956067 16242 raft_consensus.cc:493] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:49.965826 16242 raft_consensus.cc:515] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.968202 16242 leader_election.cc:290] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:49.970315 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ecb3450f444c34a071008a424a82c9" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:49.971071 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ecb3450f444c34a071008a424a82c9" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:49.971127 15951 raft_consensus.cc:2468] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:49.971951 16099 raft_consensus.cc:2468] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:49.972983 15989 leader_election.cc:304] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:49.976404 16254 tablet_bootstrap.cc:492] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:49.977185 16254 ts_tablet_manager.cc:1403] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.010s
I20260501 14:02:49.978052 16242 raft_consensus.cc:2804] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:49.978606 16242 raft_consensus.cc:493] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:49.979028 16242 raft_consensus.cc:3060] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:49.989010 16254 raft_consensus.cc:359] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.990114 16254 raft_consensus.cc:385] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:49.990448 16254 raft_consensus.cc:740] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:49.993692 16254 consensus_queue.cc:260] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:49.996634 16243 consensus_queue.cc:1048] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:49.997315 16255 tablet_bootstrap.cc:492] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: No bootstrap required, opened a new log
I20260501 14:02:50.009030 16255 ts_tablet_manager.cc:1403] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent bootstrapping tablet: real 0.093s	user 0.036s	sys 0.028s
I20260501 14:02:50.012885 16255 raft_consensus.cc:359] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.013881 16255 raft_consensus.cc:385] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:50.014245 16255 raft_consensus.cc:740] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Initialized, Role: FOLLOWER
I20260501 14:02:50.015066 16255 consensus_queue.cc:260] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.003657 16242 raft_consensus.cc:515] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.019520 16242 leader_election.cc:290] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:50.020419 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ecb3450f444c34a071008a424a82c9" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:50.020768 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ecb3450f444c34a071008a424a82c9" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:50.021270 16099 raft_consensus.cc:3060] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.021535 15950 raft_consensus.cc:3060] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.021952 16255 ts_tablet_manager.cc:1434] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260501 14:02:50.024727 16243 raft_consensus.cc:493] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:50.025835 16254 ts_tablet_manager.cc:1434] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.001s
I20260501 14:02:50.026419 16243 raft_consensus.cc:515] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.028528 16254 tablet_bootstrap.cc:492] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:50.038561 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:50.039472 15949 raft_consensus.cc:2468] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 0.
I20260501 14:02:50.043706 16063 leader_election.cc:304] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:50.045159 16276 raft_consensus.cc:2804] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:50.045571 16276 raft_consensus.cc:493] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:50.045910 16276 raft_consensus.cc:3060] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.047389 15950 raft_consensus.cc:2468] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:50.054219 15989 leader_election.cc:304] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:50.055619 16242 raft_consensus.cc:2804] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:50.056412 16242 raft_consensus.cc:697] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:50.057691 16242 consensus_queue.cc:237] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.058792 16258 tablet_bootstrap.cc:492] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:50.059422 16258 ts_tablet_manager.cc:1403] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.130s	user 0.042s	sys 0.011s
I20260501 14:02:50.063257 16258 raft_consensus.cc:359] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.066061 16258 raft_consensus.cc:385] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:50.066448 16258 raft_consensus.cc:740] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:50.067269 16258 consensus_queue.cc:260] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.069686 16258 ts_tablet_manager.cc:1434] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260501 14:02:50.065405 16099 raft_consensus.cc:2468] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:50.071763 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:50.056331 16254 tablet_bootstrap.cc:654] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
W20260501 14:02:50.073419 16066 leader_election.cc:343] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:50.074807 16283 consensus_queue.cc:1048] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.077225 16258 tablet_bootstrap.cc:492] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: Bootstrap starting.
I20260501 14:02:50.081295 16243 leader_election.cc:290] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:50.085916 16258 tablet_bootstrap.cc:654] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:50.088331 16254 tablet_bootstrap.cc:492] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:50.092415 16254 ts_tablet_manager.cc:1403] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.004s
I20260501 14:02:50.093282 16276 raft_consensus.cc:515] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.095721 16254 raft_consensus.cc:359] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.096897 16254 raft_consensus.cc:385] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:50.097267 16254 raft_consensus.cc:740] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:50.098143 16254 consensus_queue.cc:260] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.100546 16254 ts_tablet_manager.cc:1434] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260501 14:02:50.101608 16254 tablet_bootstrap.cc:492] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: Bootstrap starting.
I20260501 14:02:50.108538 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
W20260501 14:02:50.110440 16066 leader_election.cc:343] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Illegal state: must be running to vote when last-logged opid is not known
I20260501 14:02:50.111559 16268 raft_consensus.cc:493] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:50.112198 16268 raft_consensus.cc:515] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.112489 16276 leader_election.cc:290] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:50.114267 16268 leader_election.cc:290] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:50.116017 15951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:50.116364 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:50.116930 15951 raft_consensus.cc:3060] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.117199 16099 raft_consensus.cc:2393] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f24495935b14436a8723aba380b53867 in current term 1: Already voted for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in this term.
I20260501 14:02:50.111485 16258 tablet_bootstrap.cc:492] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: No bootstrap required, opened a new log
I20260501 14:02:50.119133 16258 ts_tablet_manager.cc:1403] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.003s
I20260501 14:02:50.122601 16258 raft_consensus.cc:359] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.123391 16258 raft_consensus.cc:385] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:50.123860 16258 raft_consensus.cc:740] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Initialized, Role: FOLLOWER
I20260501 14:02:50.124658 16258 consensus_queue.cc:260] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.127049 16258 ts_tablet_manager.cc:1434] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260501 14:02:50.128042 16254 tablet_bootstrap.cc:654] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: Neither blocks nor log segments found. Creating new log.
I20260501 14:02:50.130628 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:50.132639 15989 leader_election.cc:304] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:50.134122 16268 raft_consensus.cc:3060] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.144333 16268 raft_consensus.cc:2749] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:50.147099 16254 tablet_bootstrap.cc:492] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: No bootstrap required, opened a new log
I20260501 14:02:50.149518 16254 ts_tablet_manager.cc:1403] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.011s
I20260501 14:02:50.154137 15951 raft_consensus.cc:2468] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 1.
I20260501 14:02:50.158990 16063 leader_election.cc:304] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: f24495935b14436a8723aba380b53867
I20260501 14:02:50.158797 16254 raft_consensus.cc:359] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.159999 16254 raft_consensus.cc:385] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260501 14:02:50.160295 16254 raft_consensus.cc:740] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Initialized, Role: FOLLOWER
I20260501 14:02:50.160604 16276 raft_consensus.cc:2804] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:50.161083 16254 consensus_queue.cc:260] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.161197 16276 raft_consensus.cc:697] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:50.163401 16254 ts_tablet_manager.cc:1434] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260501 14:02:50.163368 16276 consensus_queue.cc:237] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.166108 16243 consensus_queue.cc:1048] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:50.168951 16268 raft_consensus.cc:493] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:50.169572 16268 raft_consensus.cc:515] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.172729 15848 catalog_manager.cc:5671] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:50.173592 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:50.174491 16099 raft_consensus.cc:2468] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:50.178406 15989 leader_election.cc:304] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:50.179783 16242 raft_consensus.cc:2804] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260501 14:02:50.180168 16242 raft_consensus.cc:493] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:50.180486 16242 raft_consensus.cc:3060] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.180982 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:50.181768 15950 raft_consensus.cc:2468] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 0.
I20260501 14:02:50.176645 16268 leader_election.cc:290] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:50.185920 15846 catalog_manager.cc:5671] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 1 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:50.191248 16242 raft_consensus.cc:515] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.201012 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:50.201725 15950 raft_consensus.cc:3060] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.202629 16242 leader_election.cc:290] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:50.204846 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:50.205503 16099 raft_consensus.cc:3060] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.213840 15950 raft_consensus.cc:2468] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:50.215191 15989 leader_election.cc:304] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:50.216156 16242 raft_consensus.cc:2804] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader election won for term 1
I20260501 14:02:50.216658 16242 raft_consensus.cc:697] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:50.217526 16242 consensus_queue.cc:237] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.228446 16268 raft_consensus.cc:493] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:50.229063 16268 raft_consensus.cc:515] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.231253 16268 leader_election.cc:290] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:50.231527 16099 raft_consensus.cc:2468] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 1.
I20260501 14:02:50.233556 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:50.234521 15950 raft_consensus.cc:2393] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f24495935b14436a8723aba380b53867 in current term 1: Already voted for candidate 32b967e5364e4b218958697890d199d9 in this term.
I20260501 14:02:50.234565 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:50.235997 15989 leader_election.cc:304] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24495935b14436a8723aba380b53867; no voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:50.236749 16268 raft_consensus.cc:3060] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.252211 15848 catalog_manager.cc:5671] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 1 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:50.260944 16284 consensus_queue.cc:1048] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.253290 16268 raft_consensus.cc:2749] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:50.289811 16297 consensus_queue.cc:1048] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.302475 16285 consensus_queue.cc:1048] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.317034 16262 consensus_queue.cc:1048] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.352319 16285 consensus_queue.cc:1048] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.358408 16285 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:50.359038 16285 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:50.389954 15950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" is_pre_election: true
I20260501 14:02:50.390888 15950 raft_consensus.cc:2393] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b967e5364e4b218958697890d199d9 in current term 1: Already voted for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in this term.
I20260501 14:02:50.399235 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:50.400322 16026 raft_consensus.cc:2393] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b967e5364e4b218958697890d199d9 in current term 1: Already voted for candidate f24495935b14436a8723aba380b53867 in this term.
I20260501 14:02:50.401243 16285 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:50.402516 16066 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b967e5364e4b218958697890d199d9; no voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867
I20260501 14:02:50.403993 16285 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 0 FOLLOWER]: Advancing to term 1
I20260501 14:02:50.422070 16285 raft_consensus.cc:2749] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260501 14:02:50.571756 16266 consensus_queue.cc:1048] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.581235 16285 consensus_queue.cc:1048] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.617841 16242 consensus_queue.cc:1048] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.624470 16285 consensus_queue.cc:1048] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.660364 16242 consensus_queue.cc:1048] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260501 14:02:50.685410 16242 consensus_queue.cc:1048] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260501 14:02:50.971976 15897 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260501 14:02:51.640091 16323 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260501 14:02:51.640934 16323 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:51.644976 16097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9" is_pre_election: true
I20260501 14:02:51.646201 16097 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:51.644861 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867" is_pre_election: true
I20260501 14:02:51.646950 16026 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 1.
I20260501 14:02:51.647976 15914 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:51.648618 16323 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:51.649166 16297 raft_consensus.cc:2804] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260501 14:02:51.649626 16297 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260501 14:02:51.649963 16297 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:51.659576 16297 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:51.663072 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:51.663517 16097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:51.663769 16026 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:51.664364 16097 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:51.673307 16026 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:51.674510 16297 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:51.675464 15917 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:51.676599 16297 raft_consensus.cc:2804] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:51.677101 16297 raft_consensus.cc:697] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:51.678016 16297 consensus_queue.cc:237] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:51.681828 16097 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:51.701611 15847 catalog_manager.cc:5671] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 0 to 2, leader changed from <none> to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.097177 16026 raft_consensus.cc:1275] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:02:52.098479 16297 consensus_queue.cc:1048] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:52.119100 16097 raft_consensus.cc:1275] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260501 14:02:52.121012 16323 consensus_queue.cc:1048] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260501 14:02:52.192195 16026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee"
dest_uuid: "f24495935b14436a8723aba380b53867"
mode: GRACEFUL
new_leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:48364
I20260501 14:02:52.192806 16026 raft_consensus.cc:606] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Received request to transfer leadership to TS ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:52.198541 16097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6"
dest_uuid: "32b967e5364e4b218958697890d199d9"
mode: GRACEFUL
new_leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:38974
I20260501 14:02:52.199174 16097 raft_consensus.cc:606] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Received request to transfer leadership to TS ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:52.211932 16097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b06b8986a14221a8a02e790f179079"
dest_uuid: "32b967e5364e4b218958697890d199d9"
mode: GRACEFUL
new_leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:38974
I20260501 14:02:52.212590 16097 raft_consensus.cc:606] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Received request to transfer leadership to TS ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:52.218159 16097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea"
dest_uuid: "32b967e5364e4b218958697890d199d9"
mode: GRACEFUL
new_leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:38974
I20260501 14:02:52.218765 16097 raft_consensus.cc:606] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Received request to transfer leadership to TS ee89b6b958a44ebdbd9f0dd77ab70428
I20260501 14:02:52.224937 15949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
mode: GRACEFUL
new_leader_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:46830
I20260501 14:02:52.225693 15949 raft_consensus.cc:606] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Received request to transfer leadership to TS f24495935b14436a8723aba380b53867
I20260501 14:02:52.236791 15949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
mode: GRACEFUL
new_leader_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:46830
I20260501 14:02:52.237388 15949 raft_consensus.cc:606] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Received request to transfer leadership to TS f24495935b14436a8723aba380b53867
I20260501 14:02:52.242698 16097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4"
dest_uuid: "32b967e5364e4b218958697890d199d9"
mode: GRACEFUL
new_leader_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:38974
I20260501 14:02:52.243502 16097 raft_consensus.cc:606] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Received request to transfer leadership to TS f24495935b14436a8723aba380b53867
I20260501 14:02:52.251585 16026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55"
dest_uuid: "f24495935b14436a8723aba380b53867"
mode: GRACEFUL
new_leader_uuid: "32b967e5364e4b218958697890d199d9"
 from {username='slave'} at 127.0.0.1:48364
I20260501 14:02:52.252220 16026 raft_consensus.cc:606] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Received request to transfer leadership to TS 32b967e5364e4b218958697890d199d9
I20260501 14:02:52.254468 16285 raft_consensus.cc:993] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: : Instructing follower ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.255021 16329 raft_consensus.cc:1081] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Signalling peer ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.257133 15949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b06b8986a14221a8a02e790f179079"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:46816
I20260501 14:02:52.257817 15949 raft_consensus.cc:493] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.258229 15949 raft_consensus.cc:3060] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.268146 15949 raft_consensus.cc:515] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.271530 15949 leader_election.cc:290] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.271803 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:52.272785 16026 raft_consensus.cc:3060] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.272132 16097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b06b8986a14221a8a02e790f179079" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.273379 16097 raft_consensus.cc:3055] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.273731 16097 raft_consensus.cc:740] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:52.274667 16097 consensus_queue.cc:260] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.276273 16097 raft_consensus.cc:3060] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.278714 16026 raft_consensus.cc:2468] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.279919 15917 leader_election.cc:304] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:52.280639 16323 raft_consensus.cc:2804] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.281085 16323 raft_consensus.cc:697] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:52.281961 16323 consensus_queue.cc:237] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.284936 16097 raft_consensus.cc:2468] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.291764 15847 catalog_manager.cc:5671] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 1 to 2, leader changed from 32b967e5364e4b218958697890d199d9 (127.6.77.131) to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.322580 16266 raft_consensus.cc:993] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: : Instructing follower ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.323127 16242 raft_consensus.cc:1081] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Signalling peer ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.324985 15949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:46806
I20260501 14:02:52.325685 15949 raft_consensus.cc:493] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.326097 15949 raft_consensus.cc:3060] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.335456 15949 raft_consensus.cc:515] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.339042 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:52.339150 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb4427c37d247eebea4c5dcf23807ee" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.339787 16026 raft_consensus.cc:3055] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.339880 16099 raft_consensus.cc:3060] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.340466 16026 raft_consensus.cc:740] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:52.341351 16026 consensus_queue.cc:260] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.339963 15949 leader_election.cc:290] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.343008 16026 raft_consensus.cc:3060] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.349303 16099 raft_consensus.cc:2468] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.349462 16026 raft_consensus.cc:2468] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.350889 15914 leader_election.cc:304] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:52.351890 16323 raft_consensus.cc:2804] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.352345 16323 raft_consensus.cc:697] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:52.353143 16323 consensus_queue.cc:237] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.362591 15847 catalog_manager.cc:5671] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 1 to 2, leader changed from f24495935b14436a8723aba380b53867 (127.6.77.130) to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.497395 16329 raft_consensus.cc:993] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: : Instructing follower ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.497967 16285 raft_consensus.cc:1081] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Signalling peer ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.499794 15949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:46816
I20260501 14:02:52.500509 15949 raft_consensus.cc:493] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.500890 15949 raft_consensus.cc:3060] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.511624 15949 raft_consensus.cc:515] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.515036 15949 leader_election.cc:290] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.515246 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:52.516254 16026 raft_consensus.cc:3060] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.516230 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc9fa58ea554ffda67f03e0567e44ea" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.518008 16099 raft_consensus.cc:3055] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.518391 16099 raft_consensus.cc:740] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:52.519313 16099 consensus_queue.cc:260] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.520730 16099 raft_consensus.cc:3060] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.525942 16026 raft_consensus.cc:2468] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.527595 15917 leader_election.cc:304] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:52.528575 16340 raft_consensus.cc:2804] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.529117 16340 raft_consensus.cc:697] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:52.530157 16099 raft_consensus.cc:2468] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.530076 16340 consensus_queue.cc:237] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.540726 15847 catalog_manager.cc:5671] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 1 to 2, leader changed from 32b967e5364e4b218958697890d199d9 (127.6.77.131) to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.597249 16285 raft_consensus.cc:993] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: : Instructing follower f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:52.597779 16285 raft_consensus.cc:1081] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Signalling peer f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:52.599475 16024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4"
dest_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:48350
I20260501 14:02:52.600258 16024 raft_consensus.cc:493] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.600643 16024 raft_consensus.cc:3060] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.606671 16024 raft_consensus.cc:515] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.608315 16024 leader_election.cc:290] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.609390 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:52.609812 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5e73e6a0f5463c96570ba58eab30f4" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.610314 15949 raft_consensus.cc:3060] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.610455 16099 raft_consensus.cc:3055] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.610875 16099 raft_consensus.cc:740] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:52.611683 16099 consensus_queue.cc:260] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.613077 16099 raft_consensus.cc:3060] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.618224 15949 raft_consensus.cc:2468] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:52.619709 15989 leader_election.cc:304] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:52.620610 16242 raft_consensus.cc:2804] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.620729 16099 raft_consensus.cc:2468] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:52.621234 16242 raft_consensus.cc:697] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:52.622311 16242 consensus_queue.cc:237] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.633955 15847 catalog_manager.cc:5671] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 1 to 2, leader changed from 32b967e5364e4b218958697890d199d9 (127.6.77.131) to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.674700 16297 raft_consensus.cc:993] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: : Instructing follower f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:52.675326 16340 raft_consensus.cc:1081] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Signalling peer f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:52.677219 16024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6"
dest_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:48348
I20260501 14:02:52.677836 16024 raft_consensus.cc:493] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.678170 16024 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:52.684644 16024 raft_consensus.cc:515] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.686440 16024 leader_election.cc:290] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 3 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.687546 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:52.688014 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6aa88a147f34775a4189804844fa9b6" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.688392 15949 raft_consensus.cc:3055] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Stepping down as leader of term 2
I20260501 14:02:52.688840 16099 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:52.688858 15949 raft_consensus.cc:740] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:52.690061 15949 consensus_queue.cc:260] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.691200 15949 raft_consensus.cc:3060] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Advancing to term 3
I20260501 14:02:52.698536 15949 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 3.
I20260501 14:02:52.699972 16099 raft_consensus.cc:2468] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 3.
I20260501 14:02:52.700278 16285 raft_consensus.cc:993] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: : Instructing follower ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.700191 15989 leader_election.cc:304] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:52.700987 16285 raft_consensus.cc:1081] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Signalling peer ee89b6b958a44ebdbd9f0dd77ab70428 to start an election
I20260501 14:02:52.701278 16242 raft_consensus.cc:2804] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 3 FOLLOWER]: Leader election won for term 3
I20260501 14:02:52.702615 16242 raft_consensus.cc:697] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 3 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:52.702988 15949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
 from {username='slave'} at 127.0.0.1:46816
I20260501 14:02:52.703866 16242 consensus_queue.cc:237] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.704720 15949 raft_consensus.cc:493] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.705207 15949 raft_consensus.cc:3060] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.709575 16024 raft_consensus.cc:1275] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:52.711750 16340 consensus_queue.cc:1048] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:52.713258 15847 catalog_manager.cc:5671] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 2 to 3, leader changed from ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129) to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 3 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.724359 15949 raft_consensus.cc:515] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.729257 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:52.729907 16026 raft_consensus.cc:3060] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.732987 15949 leader_election.cc:290] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Requested vote from peers f24495935b14436a8723aba380b53867 (127.6.77.130:35671), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.734346 16097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d19fa53eaa41c1a438da0868001cf6" candidate_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.735092 16097 raft_consensus.cc:3055] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.735404 16097 raft_consensus.cc:740] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:52.736912 16097 consensus_queue.cc:260] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.738641 16097 raft_consensus.cc:3060] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.739521 16026 raft_consensus.cc:2468] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.725003 16099 raft_consensus.cc:1275] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:52.741557 15917 leader_election.cc:304] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee89b6b958a44ebdbd9f0dd77ab70428, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:52.742113 16297 consensus_queue.cc:1048] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:52.743746 16297 raft_consensus.cc:2804] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.748966 16097 raft_consensus.cc:2468] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee89b6b958a44ebdbd9f0dd77ab70428 in term 2.
I20260501 14:02:52.751926 16297 raft_consensus.cc:697] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Becoming Leader. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:52.753257 16297 consensus_queue.cc:237] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.768369 16346 raft_consensus.cc:993] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: : Instructing follower f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:52.768905 16346 raft_consensus.cc:1081] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Signalling peer f24495935b14436a8723aba380b53867 to start an election
I20260501 14:02:52.771298 16024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b"
dest_uuid: "f24495935b14436a8723aba380b53867"
 from {username='slave'} at 127.0.0.1:48348
I20260501 14:02:52.771993 16024 raft_consensus.cc:493] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.772382 16024 raft_consensus.cc:3060] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.782078 15849 catalog_manager.cc:5671] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 reported cstate change: term changed from 1 to 2, leader changed from 32b967e5364e4b218958697890d199d9 (127.6.77.131) to ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129). New cstate: current_term: 2 leader_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.794414 16024 raft_consensus.cc:515] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.797873 16024 leader_election.cc:290] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), 32b967e5364e4b218958697890d199d9 (127.6.77.131:35255)
I20260501 14:02:52.798722 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b967e5364e4b218958697890d199d9"
I20260501 14:02:52.799618 16099 raft_consensus.cc:3060] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.804276 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7cf3d6aa2e4eabbb159023e26e558b" candidate_uuid: "f24495935b14436a8723aba380b53867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:52.805213 15949 raft_consensus.cc:3055] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.805601 15949 raft_consensus.cc:740] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:52.806531 15949 consensus_queue.cc:260] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.808895 16099 raft_consensus.cc:2468] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:52.809753 16097 raft_consensus.cc:1240] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Rejecting Update request from peer ee89b6b958a44ebdbd9f0dd77ab70428 for earlier term 1. Current term is 2. Ops: []
I20260501 14:02:52.809928 15949 raft_consensus.cc:3060] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.810325 15989 leader_election.cc:304] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:52.811399 16242 raft_consensus.cc:2804] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.811964 16242 raft_consensus.cc:697] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Becoming Leader. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:52.812877 16242 consensus_queue.cc:237] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.818696 15949 raft_consensus.cc:2468] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24495935b14436a8723aba380b53867 in term 2.
I20260501 14:02:52.824746 16242 raft_consensus.cc:993] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: : Instructing follower 32b967e5364e4b218958697890d199d9 to start an election
I20260501 14:02:52.825362 16266 raft_consensus.cc:1081] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Signalling peer 32b967e5364e4b218958697890d199d9 to start an election
I20260501 14:02:52.827142 16097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55"
dest_uuid: "32b967e5364e4b218958697890d199d9"
 from {username='slave'} at 127.0.0.1:38952
I20260501 14:02:52.827917 16097 raft_consensus.cc:493] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:52.828416 16097 raft_consensus.cc:3060] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.827303 15847 catalog_manager.cc:5671] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 reported cstate change: term changed from 1 to 2, leader changed from ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129) to f24495935b14436a8723aba380b53867 (127.6.77.130). New cstate: current_term: 2 leader_uuid: "f24495935b14436a8723aba380b53867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260501 14:02:52.838207 16097 raft_consensus.cc:515] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.841065 16097 leader_election.cc:290] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:52.842113 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:52.842442 16099 raft_consensus.cc:1275] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:52.842883 16024 raft_consensus.cc:3055] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:52.843257 16024 raft_consensus.cc:740] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:52.844249 16340 consensus_queue.cc:1048] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:52.844822 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3bec5bf3824e79a198c92137852e55" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:52.844214 16024 consensus_queue.cc:260] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.845521 15949 raft_consensus.cc:3060] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.846534 16024 raft_consensus.cc:3060] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:52.854513 15949 raft_consensus.cc:2468] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 2.
I20260501 14:02:52.855319 16024 raft_consensus.cc:2468] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 2.
I20260501 14:02:52.856093 16063 leader_election.cc:304] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:52.857307 16285 raft_consensus.cc:2804] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:52.857969 16285 raft_consensus.cc:697] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 2 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:52.859059 16285 consensus_queue.cc:237] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:52.869428 16024 raft_consensus.cc:1275] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:52.871289 16340 consensus_queue.cc:1048] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:52.884228 15847 catalog_manager.cc:5671] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 1 to 2, leader changed from f24495935b14436a8723aba380b53867 (127.6.77.130) to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:53.042335 16099 raft_consensus.cc:1275] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.043977 16266 consensus_queue.cc:1048] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:53.060547 15949 raft_consensus.cc:1275] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.063107 16352 consensus_queue.cc:1048] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:53.090801 16024 raft_consensus.cc:1275] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.092649 16340 consensus_queue.cc:1048] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:53.104606 16099 raft_consensus.cc:1275] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.106992 16346 consensus_queue.cc:1048] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:53.181052 16099 raft_consensus.cc:1275] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 3 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 14:02:53.182715 16266 consensus_queue.cc:1048] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:53.193727 15949 raft_consensus.cc:1275] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 3 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260501 14:02:53.195317 16242 consensus_queue.cc:1048] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:53.257448 15949 raft_consensus.cc:1275] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer 32b967e5364e4b218958697890d199d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.258704 16285 consensus_queue.cc:1048] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:53.268102 16097 raft_consensus.cc:1275] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.270431 16345 consensus_queue.cc:1048] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:53.270417 16024 raft_consensus.cc:1275] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer 32b967e5364e4b218958697890d199d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.273123 16364 consensus_queue.cc:1048] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:53.281431 15949 raft_consensus.cc:1275] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.283985 16266 consensus_queue.cc:1048] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:53.294785 16026 raft_consensus.cc:1275] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer ee89b6b958a44ebdbd9f0dd77ab70428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.302260 16297 consensus_queue.cc:1048] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:53.305428 16097 raft_consensus.cc:1275] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Refusing update from remote peer f24495935b14436a8723aba380b53867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:53.310956 16242 consensus_queue.cc:1048] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:55.256134 15848 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50108:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260501 14:02:55.282081 15848 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50108:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260501 14:02:55.337391  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:55.584194 16415 tablet.cc:1724] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:55.664186 16398 log.cc:927] Time spent T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260501 14:02:55.665274 16411 log.cc:927] Time spent T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260501 14:02:55.693064 16408 log.cc:927] Time spent T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260501 14:02:55.693408 16424 tablet.cc:1724] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:55.662647 15917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:35671, user_credentials={real_user=slave}} blocked reactor thread for 110934us
W20260501 14:02:55.704355 16406 log.cc:927] Time spent T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: Append to log took a long time: real 0.169s	user 0.006s	sys 0.000s
W20260501 14:02:55.704795 16387 log.cc:927] Time spent T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
I20260501 14:02:55.712631 16428 tablet.cc:1724] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.746876 16434 tablet.cc:1724] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.774108 16432 tablet.cc:1724] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.830600 16427 tablet.cc:1724] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.833770 16433 tablet.cc:1724] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.836279 16437 tablet.cc:1724] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:55.871009 15989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.131:35255, user_credentials={real_user=slave}} blocked reactor thread for 63316us
I20260501 14:02:55.897933 16442 tablet.cc:1724] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.913738 16443 tablet.cc:1724] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.931249 16439 tablet.cc:1724] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.970526 16439 tablet.cc:1724] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.984386 16427 tablet.cc:1724] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.993255 16444 tablet.cc:1724] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.966164 16434 tablet.cc:1724] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:55.993386 15949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3"
dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
mode: GRACEFUL
new_leader_uuid: "32b967e5364e4b218958697890d199d9"
 from {username='slave'} at 127.0.0.1:43164
I20260501 14:02:55.997558 15949 raft_consensus.cc:606] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Received request to transfer leadership to TS 32b967e5364e4b218958697890d199d9
I20260501 14:02:55.997373 16415 tablet.cc:1724] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260501 14:02:56.015363 16066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.77.130:35671, user_credentials={real_user=slave}} blocked reactor thread for 58634.2us
I20260501 14:02:56.028957 16433 tablet.cc:1724] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.033051 16434 tablet.cc:1724] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.035611 16439 tablet.cc:1724] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.064316 16427 tablet.cc:1724] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.065783 16443 tablet.cc:1724] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.036676 16428 tablet.cc:1724] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.044468 16437 tablet.cc:1724] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.096074 16442 tablet.cc:1724] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.102394 16424 tablet.cc:1724] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.066978 16432 tablet.cc:1724] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.115927 16439 tablet.cc:1724] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260501 14:02:56.145418 16025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97c45da8661b45918be6cc5782a29636"
dest_uuid: "f24495935b14436a8723aba380b53867"
mode: GRACEFUL
new_leader_uuid: "32b967e5364e4b218958697890d199d9"
 from {username='slave'} at 127.0.0.1:59224
I20260501 14:02:56.146216 16025 raft_consensus.cc:606] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Received request to transfer leadership to TS 32b967e5364e4b218958697890d199d9
I20260501 14:02:56.148150  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260501 14:02:56.148912  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:56.165318 15847 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c: soft_deleted_table [id=9089483dc78b4c5089d746a3a0bf544e] alter complete (version 1)
I20260501 14:02:56.335500 16431 raft_consensus.cc:993] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: : Instructing follower 32b967e5364e4b218958697890d199d9 to start an election
I20260501 14:02:56.336222 16429 raft_consensus.cc:1081] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Signalling peer 32b967e5364e4b218958697890d199d9 to start an election
I20260501 14:02:56.337972 16094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97c45da8661b45918be6cc5782a29636"
dest_uuid: "32b967e5364e4b218958697890d199d9"
 from {username='slave'} at 127.0.0.1:38952
I20260501 14:02:56.338469 16094 raft_consensus.cc:493] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:56.338758 16094 raft_consensus.cc:3060] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:56.345656 16094 raft_consensus.cc:515] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:56.347533 16094 leader_election.cc:290] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:56.348385 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:56.349239 15949 raft_consensus.cc:3060] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:56.349284 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c45da8661b45918be6cc5782a29636" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:56.349929 16025 raft_consensus.cc:3055] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:56.350160 16025 raft_consensus.cc:740] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f24495935b14436a8723aba380b53867, State: Running, Role: LEADER
I20260501 14:02:56.350975 16025 consensus_queue.cc:260] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:56.352399 16025 raft_consensus.cc:3060] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:56.357102 15949 raft_consensus.cc:2468] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 2.
I20260501 14:02:56.358348 16063 leader_election.cc:304] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, ee89b6b958a44ebdbd9f0dd77ab70428; no voters: 
I20260501 14:02:56.359176 16447 raft_consensus.cc:2804] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:56.359625 16447 raft_consensus.cc:697] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 2 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:56.360013 16025 raft_consensus.cc:2468] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 2.
I20260501 14:02:56.360553 16447 consensus_queue.cc:237] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:56.370622 15848 catalog_manager.cc:5671] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 1 to 2, leader changed from f24495935b14436a8723aba380b53867 (127.6.77.130) to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:56.455983 16417 raft_consensus.cc:993] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: : Instructing follower 32b967e5364e4b218958697890d199d9 to start an election
I20260501 14:02:56.456653 16397 raft_consensus.cc:1081] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Signalling peer 32b967e5364e4b218958697890d199d9 to start an election
I20260501 14:02:56.458398 16094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3"
dest_uuid: "32b967e5364e4b218958697890d199d9"
 from {username='slave'} at 127.0.0.1:38958
I20260501 14:02:56.459055 16094 raft_consensus.cc:493] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260501 14:02:56.459498 16094 raft_consensus.cc:3060] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:56.466529 16094 raft_consensus.cc:515] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:56.468447 16094 leader_election.cc:290] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 2 election: Requested vote from peers ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975), f24495935b14436a8723aba380b53867 (127.6.77.130:35671)
I20260501 14:02:56.469244 15949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428"
I20260501 14:02:56.469523 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768a1078f82544009cd31d473dd93dd3" candidate_uuid: "32b967e5364e4b218958697890d199d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f24495935b14436a8723aba380b53867"
I20260501 14:02:56.469995 15949 raft_consensus.cc:3055] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Stepping down as leader of term 1
I20260501 14:02:56.470099 16025 raft_consensus.cc:3060] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:56.470379 15949 raft_consensus.cc:740] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee89b6b958a44ebdbd9f0dd77ab70428, State: Running, Role: LEADER
I20260501 14:02:56.471221 15949 consensus_queue.cc:260] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:56.472786 15949 raft_consensus.cc:3060] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Advancing to term 2
I20260501 14:02:56.478601 16025 raft_consensus.cc:2468] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 2.
I20260501 14:02:56.480017 16066 leader_election.cc:304] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b967e5364e4b218958697890d199d9, f24495935b14436a8723aba380b53867; no voters: 
I20260501 14:02:56.480804 16447 raft_consensus.cc:2804] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260501 14:02:56.480887 15949 raft_consensus.cc:2468] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b967e5364e4b218958697890d199d9 in term 2.
I20260501 14:02:56.481365 16447 raft_consensus.cc:697] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 2 LEADER]: Becoming Leader. State: Replica: 32b967e5364e4b218958697890d199d9, State: Running, Role: LEADER
I20260501 14:02:56.482506 16447 consensus_queue.cc:237] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } }
I20260501 14:02:56.491508 15848 catalog_manager.cc:5671] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 reported cstate change: term changed from 1 to 2, leader changed from ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129) to 32b967e5364e4b218958697890d199d9 (127.6.77.131). New cstate: current_term: 2 leader_uuid: "32b967e5364e4b218958697890d199d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b967e5364e4b218958697890d199d9" member_type: VOTER last_known_addr { host: "127.6.77.131" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260501 14:02:56.829314 15949 raft_consensus.cc:1275] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer 32b967e5364e4b218958697890d199d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:56.830648 16447 consensus_queue.cc:1048] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:56.845225 16026 raft_consensus.cc:1275] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer 32b967e5364e4b218958697890d199d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:56.850467 16371 consensus_queue.cc:1048] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:57.039019 15949 raft_consensus.cc:1275] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Refusing update from remote peer 32b967e5364e4b218958697890d199d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:57.040383 16456 consensus_queue.cc:1048] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee89b6b958a44ebdbd9f0dd77ab70428" member_type: VOTER last_known_addr { host: "127.6.77.129" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260501 14:02:57.052996 16026 raft_consensus.cc:1275] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Refusing update from remote peer 32b967e5364e4b218958697890d199d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260501 14:02:57.056607 16456 consensus_queue.cc:1048] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24495935b14436a8723aba380b53867" member_type: VOTER last_known_addr { host: "127.6.77.130" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260501 14:02:57.150272  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:57.158912  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:57.159474  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:58.160557  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:58.165757  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:58.166272  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:02:59.167351  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:02:59.172446  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:02:59.172885  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:00.173854  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:03:00.179246  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:03:00.179764  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:01.181013  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:03:01.186623  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:03:01.187100  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:02.188285  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:03:02.194888  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:03:02.195446  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:03.196521  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:03:03.201797  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:03:03.202304  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:04.203640  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:03:04.210795  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:03:04.211340  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:05.212589  6454 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260501 14:03:05.219208  6454 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260501 14:03:05.219693  6454 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260501 14:03:06.298573  6454 tablet_server.cc:179] TabletServer@127.6.77.129:0 shutting down...
I20260501 14:03:06.346148  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:03:06.347515  6454 tablet_replica.cc:333] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.349191  6454 raft_consensus.cc:2243] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.350523  6454 raft_consensus.cc:2272] T b6aa88a147f34775a4189804844fa9b6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260501 14:03:06.350711 15989 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260501 14:03:06.355224 15989 consensus_peers.cc:597] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.355695  6454 tablet_replica.cc:333] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.356986  6454 raft_consensus.cc:2243] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.358527  6454 raft_consensus.cc:2272] T 5dc9fa58ea554ffda67f03e0567e44ea P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.362746  6454 tablet_replica.cc:333] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.363524  6454 raft_consensus.cc:2243] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.364910  6454 raft_consensus.cc:2272] T c4e892eac359422db5beea872f9f3823 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:03:06.366248 16063 consensus_peers.cc:597] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.368687  6454 tablet_replica.cc:333] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.369750  6454 raft_consensus.cc:2243] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.370759  6454 raft_consensus.cc:2272] T 4b7cf3d6aa2e4eabbb159023e26e558b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.374315  6454 tablet_replica.cc:333] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.374992  6454 raft_consensus.cc:2243] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.375573  6454 raft_consensus.cc:2272] T c9ad56305ce44a4e9bcab985d3ab6b20 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.379316  6454 tablet_replica.cc:333] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.380570  6454 raft_consensus.cc:2243] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.381281  6454 raft_consensus.cc:2272] T 0d5e625e7d764028a83aa151a0e6ad1b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.385301  6454 tablet_replica.cc:333] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.386286  6454 raft_consensus.cc:2243] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.387097  6454 raft_consensus.cc:2272] T 16ecb3450f444c34a071008a424a82c9 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.391108  6454 tablet_replica.cc:333] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.391719  6454 raft_consensus.cc:2243] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.392805  6454 raft_consensus.cc:2272] T 34e803d8e72440a3ae5abe977157ea3d P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.395529  6454 tablet_replica.cc:333] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.396201  6454 raft_consensus.cc:2243] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.396762  6454 raft_consensus.cc:2272] T db5e73e6a0f5463c96570ba58eab30f4 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.399326  6454 tablet_replica.cc:333] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.400159  6454 raft_consensus.cc:2243] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.400997  6454 raft_consensus.cc:2272] T 2d3bec5bf3824e79a198c92137852e55 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.404582  6454 tablet_replica.cc:333] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.405259  6454 raft_consensus.cc:2243] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.405948  6454 raft_consensus.cc:2272] T 63c3b3ddeded4aaaa0ae6ab6092e969b P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.408715  6454 tablet_replica.cc:333] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.409426  6454 raft_consensus.cc:2243] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.409970  6454 raft_consensus.cc:2272] T a3e51dd7499d46568dcd081266ea72ca P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.412744  6454 tablet_replica.cc:333] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.413324  6454 raft_consensus.cc:2243] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.414397  6454 raft_consensus.cc:2272] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P ee89b6b958a44ebdbd9f0dd77ab70428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.417867  6454 tablet_replica.cc:333] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.418805  6454 raft_consensus.cc:2243] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.419505  6454 raft_consensus.cc:2272] T 97c45da8661b45918be6cc5782a29636 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:03:06.420055 15989 consensus_peers.cc:597] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.422796  6454 tablet_replica.cc:333] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.423692  6454 raft_consensus.cc:2243] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.424387  6454 raft_consensus.cc:2272] T 768a1078f82544009cd31d473dd93dd3 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.428395  6454 tablet_replica.cc:333] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.429028  6454 raft_consensus.cc:2243] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.430402  6454 raft_consensus.cc:2272] T 95b06b8986a14221a8a02e790f179079 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:03:06.433660 15989 consensus_peers.cc:597] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.433831  6454 tablet_replica.cc:333] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.434566  6454 raft_consensus.cc:2243] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.435598  6454 raft_consensus.cc:2272] T 97d19fa53eaa41c1a438da0868001cf6 P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.438444  6454 tablet_replica.cc:333] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428: stopping tablet replica
I20260501 14:03:06.439023  6454 raft_consensus.cc:2243] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.440059  6454 raft_consensus.cc:2272] T feb4427c37d247eebea4c5dcf23807ee P ee89b6b958a44ebdbd9f0dd77ab70428 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:03:06.448498 15989 consensus_peers.cc:597] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.514391  6454 tablet_server.cc:196] TabletServer@127.6.77.129:0 shutdown complete.
I20260501 14:03:06.567229  6454 tablet_server.cc:179] TabletServer@127.6.77.130:0 shutting down...
W20260501 14:03:06.575659 16063 consensus_peers.cc:597] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:32975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:03:06.584299 16066 consensus_peers.cc:597] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 -> Peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Couldn't send request to peer f24495935b14436a8723aba380b53867. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.604641  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:03:06.605792  6454 tablet_replica.cc:333] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867: stopping tablet replica
W20260501 14:03:06.607066 15989 consensus_peers.cc:597] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:32975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.607110  6454 raft_consensus.cc:2243] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.608291  6454 raft_consensus.cc:2272] T 5dc9fa58ea554ffda67f03e0567e44ea P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.611254  6454 tablet_replica.cc:333] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.611979  6454 raft_consensus.cc:2243] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 3 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.612987  6454 raft_consensus.cc:2272] T b6aa88a147f34775a4189804844fa9b6 P f24495935b14436a8723aba380b53867 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.615604  6454 tablet_replica.cc:333] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.616286  6454 raft_consensus.cc:2243] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.616819  6454 raft_consensus.cc:2272] T 95b06b8986a14221a8a02e790f179079 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.619516  6454 tablet_replica.cc:333] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.620261  6454 raft_consensus.cc:2243] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.620817  6454 raft_consensus.cc:2272] T feb4427c37d247eebea4c5dcf23807ee P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.623232  6454 tablet_replica.cc:333] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.623800  6454 raft_consensus.cc:2243] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.624397  6454 raft_consensus.cc:2272] T 97d19fa53eaa41c1a438da0868001cf6 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.626857  6454 tablet_replica.cc:333] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.627494  6454 raft_consensus.cc:2243] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.628566  6454 raft_consensus.cc:2272] T 0d5e625e7d764028a83aa151a0e6ad1b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.631244  6454 tablet_replica.cc:333] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.631785  6454 raft_consensus.cc:2243] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.632889  6454 raft_consensus.cc:2272] T a3e51dd7499d46568dcd081266ea72ca P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.635439  6454 tablet_replica.cc:333] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.636019  6454 raft_consensus.cc:2243] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.636473  6454 raft_consensus.cc:2272] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.639081  6454 tablet_replica.cc:333] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.639634  6454 raft_consensus.cc:2243] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.640120  6454 raft_consensus.cc:2272] T 768a1078f82544009cd31d473dd93dd3 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.642549  6454 tablet_replica.cc:333] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.643214  6454 raft_consensus.cc:2243] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.643731  6454 raft_consensus.cc:2272] T 97c45da8661b45918be6cc5782a29636 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.646075  6454 tablet_replica.cc:333] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.646684  6454 raft_consensus.cc:2243] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.647733  6454 raft_consensus.cc:2272] T 4b7cf3d6aa2e4eabbb159023e26e558b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.650393  6454 tablet_replica.cc:333] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.651016  6454 raft_consensus.cc:2243] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.651552  6454 raft_consensus.cc:2272] T c9ad56305ce44a4e9bcab985d3ab6b20 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.654765  6454 tablet_replica.cc:333] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.655685  6454 raft_consensus.cc:2243] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.656383  6454 raft_consensus.cc:2272] T c4e892eac359422db5beea872f9f3823 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260501 14:03:06.656854 16063 consensus_peers.cc:597] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:32975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.659411  6454 tablet_replica.cc:333] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.660223  6454 raft_consensus.cc:2243] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.661195  6454 raft_consensus.cc:2272] T db5e73e6a0f5463c96570ba58eab30f4 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.663882  6454 tablet_replica.cc:333] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.664489  6454 raft_consensus.cc:2243] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.665126  6454 raft_consensus.cc:2272] T 2d3bec5bf3824e79a198c92137852e55 P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.667601  6454 tablet_replica.cc:333] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.668192  6454 raft_consensus.cc:2243] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.669176  6454 raft_consensus.cc:2272] T 63c3b3ddeded4aaaa0ae6ab6092e969b P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.671551  6454 tablet_replica.cc:333] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.672096  6454 raft_consensus.cc:2243] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.672940  6454 raft_consensus.cc:2272] T 16ecb3450f444c34a071008a424a82c9 P f24495935b14436a8723aba380b53867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.675235  6454 tablet_replica.cc:333] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867: stopping tablet replica
I20260501 14:03:06.675690  6454 raft_consensus.cc:2243] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.676225  6454 raft_consensus.cc:2272] T 34e803d8e72440a3ae5abe977157ea3d P f24495935b14436a8723aba380b53867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.725339  6454 tablet_server.cc:196] TabletServer@127.6.77.130:0 shutdown complete.
W20260501 14:03:06.737200 16066 consensus_peers.cc:597] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 -> Peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Couldn't send request to peer f24495935b14436a8723aba380b53867. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:35671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260501 14:03:06.759971 16066 consensus_peers.cc:597] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 -> Peer f24495935b14436a8723aba380b53867 (127.6.77.130:35671): Couldn't send request to peer f24495935b14436a8723aba380b53867. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.130:35671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.778431  6454 tablet_server.cc:179] TabletServer@127.6.77.131:0 shutting down...
W20260501 14:03:06.805410 16063 consensus_peers.cc:597] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 -> Peer ee89b6b958a44ebdbd9f0dd77ab70428 (127.6.77.129:32975): Couldn't send request to peer ee89b6b958a44ebdbd9f0dd77ab70428. Status: Network error: Client connection negotiation failed: client connection to 127.6.77.129:32975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260501 14:03:06.825660  6454 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260501 14:03:06.826709  6454 tablet_replica.cc:333] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.827561  6454 raft_consensus.cc:2243] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.828254  6454 raft_consensus.cc:2272] T b6aa88a147f34775a4189804844fa9b6 P 32b967e5364e4b218958697890d199d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.831171  6454 tablet_replica.cc:333] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.831961  6454 raft_consensus.cc:2243] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.832573  6454 raft_consensus.cc:2272] T 5dc9fa58ea554ffda67f03e0567e44ea P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.834986  6454 tablet_replica.cc:333] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.835628  6454 raft_consensus.cc:2243] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.836270  6454 raft_consensus.cc:2272] T 95b06b8986a14221a8a02e790f179079 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.838717  6454 tablet_replica.cc:333] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.839389  6454 raft_consensus.cc:2243] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.840020  6454 raft_consensus.cc:2272] T feb4427c37d247eebea4c5dcf23807ee P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.842657  6454 tablet_replica.cc:333] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.843389  6454 raft_consensus.cc:2243] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.844210  6454 raft_consensus.cc:2272] T 97d19fa53eaa41c1a438da0868001cf6 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.847450  6454 tablet_replica.cc:333] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.848222  6454 raft_consensus.cc:2243] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.848702  6454 raft_consensus.cc:2272] T 3b0fbc22f9264d4e9cc3daa8e5d5fdcf P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.851132  6454 tablet_replica.cc:333] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.851688  6454 raft_consensus.cc:2243] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.852221  6454 raft_consensus.cc:2272] T a3e51dd7499d46568dcd081266ea72ca P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.854576  6454 tablet_replica.cc:333] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.855126  6454 raft_consensus.cc:2243] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.856366  6454 raft_consensus.cc:2272] T 768a1078f82544009cd31d473dd93dd3 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.858765  6454 tablet_replica.cc:333] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.859315  6454 raft_consensus.cc:2243] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.860248  6454 raft_consensus.cc:2272] T 97c45da8661b45918be6cc5782a29636 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.862432  6454 tablet_replica.cc:333] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.862991  6454 raft_consensus.cc:2243] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.863466  6454 raft_consensus.cc:2272] T c4e892eac359422db5beea872f9f3823 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.866060  6454 tablet_replica.cc:333] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.866884  6454 raft_consensus.cc:2243] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.867403  6454 raft_consensus.cc:2272] T 4b7cf3d6aa2e4eabbb159023e26e558b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.870056  6454 tablet_replica.cc:333] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.870661  6454 raft_consensus.cc:2243] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.871641  6454 raft_consensus.cc:2272] T c9ad56305ce44a4e9bcab985d3ab6b20 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.874251  6454 tablet_replica.cc:333] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.874876  6454 raft_consensus.cc:2243] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.875339  6454 raft_consensus.cc:2272] T 0d5e625e7d764028a83aa151a0e6ad1b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.877851  6454 tablet_replica.cc:333] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.878402  6454 raft_consensus.cc:2243] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 2 LEADER]: Raft consensus shutting down.
I20260501 14:03:06.879472  6454 raft_consensus.cc:2272] T 2d3bec5bf3824e79a198c92137852e55 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.882094  6454 tablet_replica.cc:333] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.882597  6454 raft_consensus.cc:2243] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.883072  6454 raft_consensus.cc:2272] T db5e73e6a0f5463c96570ba58eab30f4 P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.885383  6454 tablet_replica.cc:333] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.885864  6454 raft_consensus.cc:2243] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.886289  6454 raft_consensus.cc:2272] T 63c3b3ddeded4aaaa0ae6ab6092e969b P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.888578  6454 tablet_replica.cc:333] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.889037  6454 raft_consensus.cc:2243] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.889503  6454 raft_consensus.cc:2272] T 16ecb3450f444c34a071008a424a82c9 P 32b967e5364e4b218958697890d199d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.891778  6454 tablet_replica.cc:333] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9: stopping tablet replica
I20260501 14:03:06.892334  6454 raft_consensus.cc:2243] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260501 14:03:06.892762  6454 raft_consensus.cc:2272] T 34e803d8e72440a3ae5abe977157ea3d P 32b967e5364e4b218958697890d199d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:06.940026  6454 tablet_server.cc:196] TabletServer@127.6.77.131:0 shutdown complete.
I20260501 14:03:06.986877  6454 master.cc:562] Master@127.6.77.190:45679 shutting down...
I20260501 14:03:07.014401  6454 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 1 LEADER]: Raft consensus shutting down.
I20260501 14:03:07.015090  6454 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260501 14:03:07.015398  6454 tablet_replica.cc:333] T 00000000000000000000000000000000 P ff98535708514e6eb92baf205ae7015c: stopping tablet replica
I20260501 14:03:07.058913  6454 master.cc:584] Master@127.6.77.190:45679 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (23569 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44794 ms total)

[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (351879 ms total)
[  PASSED  ] 5 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260501 14:03:07.125283  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2240 messages since previous log ~34 seconds ago
I20260501 14:03:07.125578  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2239 messages since previous log ~34 seconds ago
I20260501 14:03:07.125813  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2235 messages since previous log ~34 seconds ago
I20260501 14:03:07.126026  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 44 messages since previous log ~65 seconds ago
I20260501 14:03:07.126215  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 44 messages since previous log ~65 seconds ago
I20260501 14:03:07.126434  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:4729: suppressed but not reported on 1 messages since previous log ~85 seconds ago
I20260501 14:03:07.126722  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260501 14:03:07.127079  6454 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2404: suppressed but not reported on 107 messages since previous log ~43 seconds ago